Oops, my server went Kaboom…again!

This is one of this days when you think everything is fine but then, you discover the painful truth…You were wrong. It seems the experts at my hosting company did something that went terribly bad and for the couple of days, everything was just nuts…Updating the blog and commenting on it were a pain in the butt. It was slow that even a Ninja Turtle was faster than this. There are still some problems with this..like 500 server error messages…Here are the details…

Some customers are experiencing problems with their sites not loading properly. This is due to networking issues that have cropped up and our admin team is working hard to correct the problem. We’ll update this post as soon as this is resolved. We apologize for the inconvenience this has caused.

Update (2009-11-14 13:30 PST):

Our admin and dev teams are working together to resolve this and have hotfixed our move script so that we can correct the problem. We’ll update this post again when we have more information.

Update (2009-11-14 15:25 PST):

We were able to narrow down the issue (it was specific to customers with a unique IP that was not in the right part of our network to be moved to the new host machine) and have fixed it. We’re finishing up the configs that will get everything running so most of the effected customers are back up but we’ll update this again when those have all completed.

Update (2009-11-14 16:50 PST):

We believe this issue is fully resolved and have fixed the root cause so it will not occur again. We do apologize again for the inconvenience caused as well as the length of time required to fix this issue.

Then, more things came…

We are experiencing packet loss on multiple machine. As a result, this is causing a lag when attempting to access your site. Our admins are currently working towards resolving the issue. Again, we are really sorry for all the recent problems. Your continued patience is greatly appreciated. Please check back for future updates.

UPDATE 2009-11-16 14:50PM PST: The swtich to our core router was oversaturated. Our administration team has added 2GB to the switch. We will continue to monitor the network. Sorry again for any inconvenience this has caused. Please check back for more updates.

UPDATE 2009-11-16 18:00PM PST: We have not noticed any more latency on the network. It appears to be under control. Our administration team will continue to actively monitor the stability of the network. Again, we sincerely apologize for the inconvenience this has caused. Thanks for hanging in there with us! However if you are still encountering stability issues, please submit a support request.

Image Source

I wonder whats next…2012??? My most sincere apologies for any inconvinience that this caused to you, our fellow reader. If you find any more problems with this site, please let me know…Thanks for your visit.

Tweet This Post

Related posts:

1. We’re back on track, Thank Goodness!
2. Oops, Haruhi Endless Eight did it Again!
3. Queen’s Blade Season 2 Ep. 03: Evil Risty is Hot!
4. Featured Blog of the Week, Thanks, Anime Blips!
5. Megami Magazine #114 Preview!