Advertisement
by Card Cleaver » Sat Apr 20, 2024 9:18 am
North East Germany wrote:Just out of curiosity, does anyone know how much it would cost to ensure this could never happen again?
I'm only speaking for myself here but I'm sure there are others like me that would be willing to chip in to make sure this kind of thing cannot happen again.
by Bisofeyr » Sat Apr 20, 2024 9:36 am
Refuge Isle wrote:Sometimes I think that video games give people a false idea of how complex problems work. For example, in many games, when you start a research project or long-term engineering project, you often see a progress bar and linear progression along it. However, in real life, the journey to the end point is not predictably linear, and the end point itself may be ambiguous. Consequently, time estimates getting there optimistic at best and arbitrary at worst. The best (read: optimistic) estimate is available on the main game page, but it is not a countdown.
The real time remaining is unknown or cannot be known. The game will be back up whenever the admins (who have real jobs and lives outside the game) are able to devote the time necessary to conduct the high level work of properly rebuilding the disk to a stable state with the minimal possible data loss. Much progress has been made so far, but more work needs to be done.
by Montrandec » Sat Apr 20, 2024 9:45 am
Nothing of the sort has been said so far, so much so that the new season hopes have been dashed (rightly so! I'd be glad to explain why this makes very little sense.)Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
by Republics of the Solar Union » Sat Apr 20, 2024 9:48 am
Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
by United Calanworie » Sat Apr 20, 2024 10:06 am
Dytarma wrote:Are they (whoever does the job) also checking the other hard drives/ssd's for potential failures that could occur in the future as well?
Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
Republics of the Solar Union wrote:Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
Simply out, the mods have real lives and jobs. They are working hard to restore this disk which spectacularly failed, and is resisting to any attempt to restore from it. And it isn't black and white on a screen, saying "Recovering: At x percentage", it's running a lot of obscure commands and receiving a lot of obscure outputs demotivating at best. It's spending countless hours waiting for a success only to be given a failure. And put on top of it all, having the pressure of fixing a game that many people play. And to put coding more features on top of it would be just one box too overweight, and a crash nobody would dream of.
by Safiniatin » Sat Apr 20, 2024 10:07 am
Republics of the Solar Union wrote:Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
Simply out, the mods have real lives and jobs. They are working hard to restore this disk which spectacularly failed, and is resisting to any attempt to restore from it. And it isn't black and white on a screen, saying "Recovering: At x percentage", it's running a lot of obscure commands and receiving a lot of obscure outputs demotivating at best. It's spending countless hours waiting for a success only to be given a failure. And put on top of it all, having the pressure of fixing a game that many people play. And to put coding more features on top of it would be just one box too overweight, and a crash nobody would dream of.
by United Calanworie » Sat Apr 20, 2024 10:08 am
Safiniatin wrote:Republics of the Solar Union wrote:Simply out, the mods have real lives and jobs. They are working hard to restore this disk which spectacularly failed, and is resisting to any attempt to restore from it. And it isn't black and white on a screen, saying "Recovering: At x percentage", it's running a lot of obscure commands and receiving a lot of obscure outputs demotivating at best. It's spending countless hours waiting for a success only to be given a failure. And put on top of it all, having the pressure of fixing a game that many people play. And to put coding more features on top of it would be just one box too overweight, and a crash nobody would dream of.
This is quite a cinéma cliche. Now most servers use Linux who has ddrescue, who quite helps A LOT to repair disk partitions, and obviously it's definitely not impossible for it to fail. But i think you talk about what ancestor ddrescue has, the venerable partclone.
by Safiniatin » Sat Apr 20, 2024 10:08 am
United Calanworie wrote:The Southern Dependencies wrote:Yes, smaller ones.
No. They aren't. Don't say things that you have no knowledge of, because all you're doing is scaring people who are genuinely worried. We have not lost any data associated with regions aside from polls.Inferior wrote:I dont know but since they got most of it done I estimate by the 23rd or sooner. THIS IS NOT AN ACTUAL ETA THIS IS AN ESTIMATION!
You aren't on the tech team, you aren't on the mod team, you have no idea what the ETA is. As with the first poster I've replied to, don't say things if you don't know what you're talking about. All you're doing is telling people things that you've pulled out of your ass. Knock it off.Dytarma wrote:Are they (whoever does the job) also checking the other hard drives/ssd's for potential failures that could occur in the future as well?
We monitor the SMART errors on our drives and replace them when a sufficient number of SMART errors are registered -- for the sake of transparency, we replaced disks on the gameside server during this downtime out of an abundance of caution for the SMART errors that we were getting.Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
Absolutely not. Every available minute of admin time currently has been devoted to fixing the outage.Republics of the Solar Union wrote:Simply out, the mods have real lives and jobs. They are working hard to restore this disk which spectacularly failed, and is resisting to any attempt to restore from it. And it isn't black and white on a screen, saying "Recovering: At x percentage", it's running a lot of obscure commands and receiving a lot of obscure outputs demotivating at best. It's spending countless hours waiting for a success only to be given a failure. And put on top of it all, having the pressure of fixing a game that many people play. And to put coding more features on top of it would be just one box too overweight, and a crash nobody would dream of.
Yeah basically this. I don't think I've run so many random frantic greps like `ls -ltr /var/cache/apt/archives | grep [package]` and `dpkg -l | grep [package]-$(uname -r)` for... a while. "oh god help what version is this module" was playing through my head for a while, and then it turned into "aw fuck okay which thing went down???" and then then there was some frantic `apt installs` and then keyboard smashes that vaguely resemble commands.
by Safiniatin » Sat Apr 20, 2024 10:09 am
United Calanworie wrote::kiss:Safiniatin wrote:This is quite a cinéma cliche. Now most servers use Linux who has ddrescue, who quite helps A LOT to repair disk partitions, and obviously it's definitely not impossible for it to fail. But i think you talk about what ancestor ddrescue has, the venerable partclone.
Yeah ddrescue did not help here. Lol.
by United Calanworie » Sat Apr 20, 2024 10:13 am
Safiniatin wrote:United Calanworie wrote::kiss:
Yeah ddrescue did not help here. Lol.
Because you didn't use it. apt install ddrescue; sudo drescue /dev/sda and tada! Unless your disk is ruined and definitely dead it should work if not well you gotta need photorec and testdisk, other very venerable tools.
by The Southern Dependencies » Sat Apr 20, 2024 10:16 am
United Calanworie wrote:The Southern Dependencies wrote:Yes, smaller ones.
No. They aren't. Don't say things that you have no knowledge of, because all you're doing is scaring people who are genuinely worried. We have not lost any data associated with regions aside from polls.Inferior wrote:I dont know but since they got most of it done I estimate by the 23rd or sooner. THIS IS NOT AN ACTUAL ETA THIS IS AN ESTIMATION!
You aren't on the tech team, you aren't on the mod team, you have no idea what the ETA is. As with the first poster I've replied to, don't say things if you don't know what you're talking about. All you're doing is telling people things that you've pulled out of your ass. Knock it off.Dytarma wrote:Are they (whoever does the job) also checking the other hard drives/ssd's for potential failures that could occur in the future as well?
We monitor the SMART errors on our drives and replace them when a sufficient number of SMART errors are registered -- for the sake of transparency, we replaced disks on the gameside server during this downtime out of an abundance of caution for the SMART errors that we were getting.Kinqueven wrote:Along with the shutdown, will there be new updates? E.G. New themes, new card season, etc.?
Absolutely not. Every available minute of admin time currently has been devoted to fixing the outage.Republics of the Solar Union wrote:Simply out, the mods have real lives and jobs. They are working hard to restore this disk which spectacularly failed, and is resisting to any attempt to restore from it. And it isn't black and white on a screen, saying "Recovering: At x percentage", it's running a lot of obscure commands and receiving a lot of obscure outputs demotivating at best. It's spending countless hours waiting for a success only to be given a failure. And put on top of it all, having the pressure of fixing a game that many people play. And to put coding more features on top of it would be just one box too overweight, and a crash nobody would dream of.
Yeah basically this. I don't think I've run so many random frantic greps like `ls -ltr /var/cache/apt/archives | grep [package]` and `dpkg -l | grep [package]-$(uname -r)` for... a while. "oh god help what version is this module" was playing through my head for a while, and then it turned into "aw fuck okay which thing went down???" and then then there was some frantic `apt installs` and then keyboard smashes that vaguely resemble commands.
by Sufokia » Sat Apr 20, 2024 10:17 am
Domais wrote:I understand that the CTE timer will be extended from 28 days to 35 days, will the same 7-day extension be granted for vacation mode nations?
by Safiniatin » Sat Apr 20, 2024 10:18 am
United Calanworie wrote:Safiniatin wrote:Because you didn't use it. apt install ddrescue; sudo drescue /dev/sda and tada! Unless your disk is ruined and definitely dead it should work if not well you gotta need photorec and testdisk, other very venerable tools.
Correct. We didn't use it. ddrescue requires that you are able to mount the disk.
by Safiniatin » Sat Apr 20, 2024 10:20 am
United Calanworie wrote:Safiniatin wrote:Because you didn't use it. apt install ddrescue; sudo drescue /dev/sda and tada! Unless your disk is ruined and definitely dead it should work if not well you gotta need photorec and testdisk, other very venerable tools.
Correct. We didn't use it. ddrescue requires that you are able to mount the disk.
by Safiniatin » Sat Apr 20, 2024 10:26 am
United Calanworie wrote:Safiniatin wrote:Because you didn't use it. apt install ddrescue; sudo drescue /dev/sda and tada! Unless your disk is ruined and definitely dead it should work if not well you gotta need photorec and testdisk, other very venerable tools.
Correct. We didn't use it. ddrescue requires that you are able to mount the disk.
by Tungstan » Sat Apr 20, 2024 10:26 am
When on a thread about a database failure, saying something like that is going to make people assume you’re referring to the data.The Southern Dependencies wrote:I was not referring to data when I made that statement, not was it my intention to refer to data, I was referring moreso to activity and recruitment and numbers. But okay.
by Alcrosnia » Sat Apr 20, 2024 10:29 am
United Calanworie wrote:Got questions about the ongoing database problems? Ask them here.
You will likely find it useful to read the Admin thread.
by Safiniatin » Sat Apr 20, 2024 10:29 am
by Safiniatin » Sat Apr 20, 2024 10:30 am
Alcrosnia wrote:United Calanworie wrote:Got questions about the ongoing database problems? Ask them here.
You will likely find it useful to read the Admin thread.
WHEN WILL IT OPEN, LIKE WHEN??? I have waited 5 days and it is still not here
It still says 'in a day or two'
by Safiniatin » Sat Apr 20, 2024 10:33 am
Tungstan wrote:When on a thread about a database failure, saying something like that is going to make people assume you’re referring to the data.The Southern Dependencies wrote:I was not referring to data when I made that statement, not was it my intention to refer to data, I was referring moreso to activity and recruitment and numbers. But okay.
Don’t want that assumption to happen? Clarify what you’re talking about—it would’ve taken maybe two more sentences to do so.
by Alcrosnia » Sat Apr 20, 2024 10:33 am
Safiniatin wrote:Alcrosnia wrote:WHEN WILL IT OPEN, LIKE WHEN??? I have waited 5 days and it is still not here
It still says 'in a day or two'
Calm down. This is a moment of crisis. The mods seem to be unexperienced in Linux maintenance. Plus they're already super stressed which just slows them down and now you're stressing them more.
by United Calanworie » Sat Apr 20, 2024 10:35 am
by Safiniatin » Sat Apr 20, 2024 10:37 am
Advertisement
Users browsing this forum: No registered users
Advertisement