Eratosphere

Eratosphere (https://www.ablemuse.com/erato/index.php)
-   Staff Announcements (https://www.ablemuse.com/erato/forumdisplay.php?f=25)
-   -   The Latest Downtime/State of the Sphere (https://www.ablemuse.com/erato/showthread.php?t=35765)

Alex Pepple 05-22-2024 02:47 AM

The Latest Downtime/State of the Sphere
 
Dear Eratosphereans,

It’s been quite a long time since we suffered a server outage, thanks to the security measures I implemented after recovering from past attacks. Your contributions also greatly enhanced our server's resources.

However, these security measures proved insufficient against ongoing denial of service attacks, which filled up the disk storage and caused a crash. This situation persisted for over 24 hours, and many of you who tried to access the site must have noticed the downtime.

I apologize for not informing you sooner. I was fully occupied diagnosing the source of the excess data to combat the attacks and had no time to send updates. At one point, I considered upgrading to a server with much more disk space, which would have been extremely expensive. Fortunately, after extensive debugging and investigation, I identified the issue and where the disk space was being consumed.

It took almost an entire business day to remove the problematic files and restore the server to operational status. After the unclogging—to illustrate how bad things were—we went from 99+% full to only 19% full! To prevent this from happening again, I have implemented an automatic script to clean up those specific areas of the server daily.

The worst is behind us now, and everything is back to normal. I'm glad to report that there was no loss of user data; I managed to recover and restore everything to its pre-failure state.

Thank you all for your support.

Onward with writing, reading, and editing!

Cheers,
…Alex

Ann Drysdale 05-22-2024 04:16 AM

Thank you, Alex.

Joe Crocker 05-22-2024 06:59 AM

Yes. Thanks Alex. It sounds like a bit of a nightmare. But it also sounds like you've got to the bottom of it. :)

Jim Moonan 05-22-2024 07:06 AM

.
Labor of love. Guardian of the words. Thanks Alex.

.

Carl Copeland 05-22-2024 07:32 AM

Yeah, withdrawal symptoms were minor. Thanks for the quick fix, Alex!

Michael Cantor 05-22-2024 10:48 AM

Thank you, Alex.

Siham Karami 05-22-2024 10:50 AM

Thanks so much, Alex. Such efforts are truly heroic. Many companies are suffering from weird glitches on their systems these days, so I hear from my daughter who’s into this stuff, and so to be able so resolve it single-handedly is quite an accomplishment. :)

Alex Pepple 05-22-2024 12:43 PM

Thank you all for the good words, Ann, Joe, Jim, Carl, Michael, Siham ... and everyone else!

Cheers,
...Alex

Alex Pepple 05-23-2024 09:22 AM

Also, the server appears to run faster after the unclogging of the hackers’ data dumping! Can you report back here if you've noticed this ... or not?

Cheers,
...Alex

Susan McLean 05-27-2024 03:21 PM

Thanks for all your work, Alex.

Susan


All times are GMT -5. The time now is 04:17 PM.

Powered by vBulletin® Version 3.7.4
Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.