Home » Other » Suggestions & Feedback » Downtime - Out of disk space
Downtime - Out of disk space [message #251986] Tue, 17 July 2007 10:55 Go to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
The server ran out of disk space and we had to do some emergency cleanups.

Down since: Unsure, estimated to be +- 09:00 CDT
Service restored: 10:30 CDT
icon14.gif  Re: Downtime - Out of disk space [message #251990 is a reply to message #251986] Tue, 17 July 2007 11:05 Go to previous messageGo to next message
DreamzZ
Messages: 1666
Registered: May 2007
Location: Dreamzland
Senior Member
No Message Body
Re: Downtime - Out of disk space [message #251998 is a reply to message #251986] Tue, 17 July 2007 11:17 Go to previous messageGo to next message
Michel Cadot
Messages: 68634
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator
I thought I was censored during this whole afternoon (Paris time).

Laughing
Michel
Re: Downtime - Out of disk space [message #252003 is a reply to message #251998] Tue, 17 July 2007 11:34 Go to previous messageGo to next message
Littlefoot
Messages: 21807
Registered: June 2005
Location: Croatia, Europe
Senior Member
Account Moderator
I believe my problems (described here) were caused by low disk space. Today, for example, everything seems to be fine. Thank you!
Re: Downtime - Out of disk space [message #252005 is a reply to message #252003] Tue, 17 July 2007 11:41 Go to previous messageGo to next message
Michel Cadot
Messages: 68634
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator
I don't think this was the reason.
As I said, it happens to me almost every day when there is a high answering activity.

Regards
Michel
Re: Downtime - Out of disk space [message #252018 is a reply to message #252005] Tue, 17 July 2007 12:32 Go to previous messageGo to next message
Littlefoot
Messages: 21807
Registered: June 2005
Location: Croatia, Europe
Senior Member
Account Moderator
Hmmmm ... I think I have an explanation for your situation: you have entered the Michel mutating error. As you've mentioned "when there is a high answering activity", it means that YOU cause problems for yourself. I don't have that kind of statistics (average number of messages per day), but I bet you are the leader on that list.

So - if you want to avoid such problems - don't burden the server that much and everything will be just fine.

Capisci? /forum/fa/917/0/
Re: Downtime - Out of disk space [message #252035 is a reply to message #252018] Tue, 17 July 2007 12:57 Go to previous messageGo to next message
Michel Cadot
Messages: 68634
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator
Of course, that's so simple, silly me! /forum/fa/1620/0/

Michel
Re: Downtime - Out of disk space [message #252058 is a reply to message #252035] Tue, 17 July 2007 14:02 Go to previous messageGo to next message
DreamzZ
Messages: 1666
Registered: May 2007
Location: Dreamzland
Senior Member
Hey Michel why you keep striking your head please stop it other wise you will forget how to ANSWER in the FORUM. Wink
Embarassed
Re: Downtime - Out of disk space [message #252071 is a reply to message #252005] Tue, 17 July 2007 14:45 Go to previous messageGo to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
Quote:
As I said, it happens to me almost every day when there is a high answering activity.


I'm sure this is a separate problem. Please mail/ PM the details to me whenever it happens.
Re: Downtime - Out of disk space [message #252081 is a reply to message #252071] Tue, 17 July 2007 15:08 Go to previous messageGo to next message
Michel Cadot
Messages: 68634
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator
OK, will do it.

Regards
Michel
Re: Downtime - Out of disk space [message #252685 is a reply to message #251986] Thu, 19 July 2007 11:38 Go to previous messageGo to next message
MarcL
Messages: 455
Registered: November 2006
Location: Connecticut, USA
Senior Member
Was there a disk space problem again today on 19-Jul around 8:00AM GMT - 5 ?

The site seemed to be very slow and sluggish.

Just curious.

Re: Downtime - Out of disk space [message #252699 is a reply to message #252685] Thu, 19 July 2007 12:53 Go to previous messageGo to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
Nope. The symptom for out of disk space is complete site failure (MySQL cannot establish connections).

BTW: We've put some monitoring scripts in place, so, I doubt if it will happen anytime soon again.
Re: Downtime - Out of disk space [message #252863 is a reply to message #252699] Fri, 20 July 2007 07:41 Go to previous messageGo to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
It just happened again. The component causing these problems will be upgraded over the weekend.
Re: Downtime - Out of disk space [message #253067 is a reply to message #251986] Sun, 22 July 2007 02:05 Go to previous messageGo to next message
Arju
Messages: 1554
Registered: June 2007
Location: Dhaka,Bangladesh. Mobile:...
Senior Member

I cannot access this site almost every day at 3 PM Bangladesh Time.
I don't think that it is disk space problem because it is happening every day.
Re: Downtime - Out of disk space [message #253334 is a reply to message #253067] Mon, 23 July 2007 10:08 Go to previous messageGo to next message
DreamzZ
Messages: 1666
Registered: May 2007
Location: Dreamzland
Senior Member
Use this timezone you will not facing that problem.

SQL> ALTER database SET TIME_ZONE = 'Dreamzland';
Database altered.


SQL> select DBTIMEZONE from dual;
DBTIMEZONE
---------------
Dreamzland



Wink Laughing
Re: Downtime - Out of disk space [message #253408 is a reply to message #253334] Mon, 23 July 2007 15:34 Go to previous messageGo to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
I trust all these problems are now sorted out.
Re: Downtime - Out of disk space [message #253417 is a reply to message #253408] Mon, 23 July 2007 16:06 Go to previous messageGo to next message
Littlefoot
Messages: 21807
Registered: June 2005
Location: Croatia, Europe
Senior Member
Account Moderator
What was causing them? Could you say a word or two about the problem and its solution, please?
Re: Downtime - Out of disk space [message #253463 is a reply to message #253408] Tue, 24 July 2007 01:12 Go to previous messageGo to next message
Michel Cadot
Messages: 68634
Registered: March 2007
Location: Nanterre, France, http://...
Senior Member
Account Moderator
I confirm there was no problem yesterday (Monday).

Regards
Michel
Re: Downtime - Out of disk space [message #253495 is a reply to message #253417] Tue, 24 July 2007 02:21 Go to previous messageGo to next message
Frank Naude
Messages: 4579
Registered: April 1998
Senior Member
We had two problems:

1) PHP was logging excessive notice messages. This caused logrotate to use a lot of CPU resources. The solution was to identify the programs logging messages and upgrade them or fix them manually.

2) Databases were getting too busy. The solution was to instigate more aggressive caching. For example, the wiki is now serving from a file system cache.
Re: Downtime - Out of disk space [message #253497 is a reply to message #253495] Tue, 24 July 2007 02:24 Go to previous message
Littlefoot
Messages: 21807
Registered: June 2005
Location: Croatia, Europe
Senior Member
Account Moderator
Thank you for the explanation, Frank!
Previous Topic: Exclude locked topics from search.
Next Topic: What is "Topic Exchange"?
Goto Forum:
  


Current Time: Tue Apr 16 02:59:52 CDT 2024