badmin
Shared on Tue, 07/21/2015 - 09:14Last night one of the hard drives that housed our database had a Catastrophic failure. By complete luck I was able to recover from an weekly back-up that I had earlier this week. I was until about 5am trying to get everything back to normal again. I'm still not quite sure how far or bad the corruptions spread. For now I know that it knocked out the database completely as well as our email systems.
The good news is that everything was recovered from last week. The bad news is that any posts from after 4 days ago didn't survive. I've since switched to daily backups instead of weekly in case this happens in the future. We've repaired the drive and everything should be back to normal. However if you see any strange PHP errors please let me know ASAP in case we have to roll back again.
Sorry for any incoviences or loss of epic posts. This was a random occurance from an otherwise solid hosting company that we've been working with for the past 10 years. For my own sanity I hope this doesn't happen again, but if you feel the site is slow or not responding at a decent speed let me know in replys below. Thanks again.
- badmin's blog
- Log in or register to post comments
Comments
Submitted by CrypticCat on Tue, 07/21/2015 - 09:33
Well.., that's what happens. My DA:I report wasn't the stuff of legends exactly, so no big loss. It gives me the room to write a better blog about it.
As I PM'd you, I thought that you did a roll-back for some reason, though I didn't expect a server-crash.
Right now, the site is a little slow for me, but you have to keep in mind that I'm overseas and my ISP isn't the best one; merely the cheapest. From here, it can only get better.
Submitted by badmin on Tue, 07/21/2015 - 10:06
I'll keep on eye on the speed. We may need to start thinking about moving the site to cloud based and get rid of the old dedicated box. I think we're still a bit behind the times when it comes to our server stuff. Hopefully you didnt lose too much and the next blog post will be even better.
Submitted by CiaranORian on Wed, 07/22/2015 - 05:37
I disagree. DAI post was EPIC!
Submitted by CiaranORian on Wed, 07/22/2015 - 05:36
Site is definitely slower than it was when ver4 first launched.
Submitted by badmin on Wed, 07/22/2015 - 13:59
That's odd. Speeds should have actually improved over all. I'll look more into the issues if I see them come up
Submitted by CiaranORian on Thu, 07/23/2015 - 05:33
Dont get me wrong its lightning fast compared to ver3.