NATION

PASSWORD

When will pre-crash census data be visible again?

Bug reports, general help, ideas for improvements, and questions about how things are meant to work.
User avatar
Tinhampton
Post Marshal
 
Posts: 16156
Founded: Oct 05, 2016
Civil Rights Lovefest

When will pre-crash census data be visible again?

Postby Tinhampton » Wed Oct 09, 2024 9:00 am

All national census data from February 2016 (when this sort of data started to be published, as part of the Fast Issues update) up until the server crash in April 2024 is still invisible, almost six months after we went back online. Examples of this can be seen on my WA Endorsements trend page and Kyupaa's Population trend page, both of which have April 25th as their first data point. (However, regional population history graphs have all data available.)

There was some concern about this a few months after the crash, but site staff did not say anything except to clarify that the data would be visible again one day. Do we have an ETA on this or are Elu, Aav and friends still working on it?
Last edited by Tinhampton on Wed Oct 09, 2024 9:02 am, edited 1 time in total.
The Self-Administrative City of TINHAMPTON (pop. 329,537): Saffron Howard, Mayor (UCP); Lydia Anderson, WA Delegate-Ambassador

Authorships & co-authorships: SC#250, SC#251, Issue #1115, SC#267, LGA#484, LGA#491, LGA#533, LGA#540, LGA#549, SC#356, LGA#559, LGA#562, LGA#567, LGA#578, SC#374, LGA#582, SC#375, LGA#589, LGA#590, SC#382, SC#385, LGA#597, LGA#607, SC#415, LGA#647, LGA#656, LGA#664, LGA#671, LGA#674, LGA#675, LGA#677, LGA#680, Issue #1580, LGA#682, LGA#683, LGA#684, LGA#692, LGA#693, LGA#715, LGA#757, SC#526, LGA#763, LGA#788, LGA#791, LGA#792, LGA#798, LGA#799, LGA#800, LGA#807, LGA#814, LGA#817
The rest of my CV: Cup of Harmony 73 champions; Torchbearer of Aeternum; fourth-most-prolific WA author of all time; proclaimer of WZTC's move to Palmetto
Tinhampton the player: 50yo Tory woman w/Asperger's; Cambridge graduate; currently reading nothing (I'm too busy)

User avatar
Sedgistan
Site Director
 
Posts: 38259
Founded: Oct 20, 2006
Anarchy

Postby Sedgistan » Wed Oct 09, 2024 9:04 am

We have the data, but we're waiting for admin time to get it restored, as it's not a simple task (a previous attempt was made but ran into issues -- it is possible though, just complex). There's no ETA on that.
Last edited by Sedgistan on Wed Oct 09, 2024 9:04 am, edited 1 time in total.

User avatar
Vylixan
Diplomat
 
Posts: 574
Founded: Mar 19, 2006
Tyranny by Majority

Postby Vylixan » Thu Oct 10, 2024 3:15 am

Not all census data is invisible, nations that were CTE at the time of the crash don't have this problem.
For example: https://www.nationstates.net/nation=rot ... ensusid=86

User avatar
Enzonar
Diplomat
 
Posts: 739
Founded: Nov 30, 2020
Psychotic Dictatorship

Postby Enzonar » Thu Oct 10, 2024 1:40 pm

Is the crash also the reason for every nation having a default flag?
I need to make an actual factbook
If my nation was based off my political views, I would be in prison.
Ingsoc is wimpy
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣶⣿⣿⣿⣿⣿⣄
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣿⣿⣿⠿⠟⠛⠻⣿⠆
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⣿⣆⣀⣀⠀⣿⠂
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⠻⣿⣿⣿⠅⠛⠋⠈⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠘⢼⣿⣿⣿⣃⠠⠀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣿⣿⣟⡿⠃
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣛⣛⣫⡄⠀⢸⣦⣀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣠⣴⣾⡆⠸⣿⣿⣿⡷⠂⠨⣿⣿⣿⣿⣶⣦⣤⣀
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣤⣾⣿⣿⣿⣿⡇⢀⣿⡿⠋⠁⢀⡶⠪⣉⢸⣿⣿⣿⣿⣿⣇
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣿⣿⣿⣿⣿⣿⣿⣿⡏⢸⣿⣷⣿⣿⣷⣦⡙⣿⣿⣿⣿⣿⡏
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠈⣿⣿⣿⣿⣿⣿⣿⣿⣇⢸⣿⣿⣿⣿⣿⣷⣦⣿⣿⣿⣿⣿⡇
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢠⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡇
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣄
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣠⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿
⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠃

User avatar
Refuge Isle
Retired Moderator
 
Posts: 2721
Founded: Dec 14, 2018
Ex-Nation

Postby Refuge Isle » Thu Oct 10, 2024 2:25 pm

Enzonar wrote:Is the crash also the reason for every nation having a default flag?

Every nation does not have a default flag...

User avatar
The Ice States
Senator
 
Posts: 4472
Founded: Jun 23, 2022
Compulsory Consumerist State

Postby The Ice States » Mon Oct 14, 2024 7:17 pm

Something I noticed a while ago is also that dispatch views were reset; for example I don't think these dispatches with 10+ upvotes were only ever read once.
Old GA Stat Effects · Style Guide · WA Authorship

"Petty tyrant", "antithetical to a better future for the WA".

User avatar
United Calanworie
Technical Moderator
 
Posts: 6991
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Mon Oct 14, 2024 7:27 pm

That is correct
@queerlyfe | She/Her/Hers
Getting Help Request (GHR) | One Stop Rules Shop (OSRS) | Routine Actions thread | NS Announcements Discord
Script Rules | API Documentation | Approved Image Hosts | How Bots are Regulated | NS Coders Discord

"...that I will support and defend the Constitution of the United States against all enemies, foreign and domestic..."
You are such a crybaby [...] all you do is lock threads and be a bitch to people, nobody likes you, you aren’t cool, you lock every thread for stupid reasons, often times not giving a reason, [...] all you do is sit on your computer all day on NationStates, locking threads at a rate 5x higher than any other mod [...] stop trying so hard to impress people, literally nobody like you.
Have a good day

User avatar
Tinhampton
Post Marshal
 
Posts: 16156
Founded: Oct 05, 2016
Civil Rights Lovefest

Postby Tinhampton » Tue Oct 15, 2024 12:32 am

Pile-on, but this dispatch shows as not having been edited even though I did edit it, a lot, between June 2023 and the crash.
The Self-Administrative City of TINHAMPTON (pop. 329,537): Saffron Howard, Mayor (UCP); Lydia Anderson, WA Delegate-Ambassador

Authorships & co-authorships: SC#250, SC#251, Issue #1115, SC#267, LGA#484, LGA#491, LGA#533, LGA#540, LGA#549, SC#356, LGA#559, LGA#562, LGA#567, LGA#578, SC#374, LGA#582, SC#375, LGA#589, LGA#590, SC#382, SC#385, LGA#597, LGA#607, SC#415, LGA#647, LGA#656, LGA#664, LGA#671, LGA#674, LGA#675, LGA#677, LGA#680, Issue #1580, LGA#682, LGA#683, LGA#684, LGA#692, LGA#693, LGA#715, LGA#757, SC#526, LGA#763, LGA#788, LGA#791, LGA#792, LGA#798, LGA#799, LGA#800, LGA#807, LGA#814, LGA#817
The rest of my CV: Cup of Harmony 73 champions; Torchbearer of Aeternum; fourth-most-prolific WA author of all time; proclaimer of WZTC's move to Palmetto
Tinhampton the player: 50yo Tory woman w/Asperger's; Cambridge graduate; currently reading nothing (I'm too busy)

User avatar
The Galactic Empire of Zimbabwae2
Spokesperson
 
Posts: 130
Founded: Feb 18, 2023
Compulsory Consumerist State

Postby The Galactic Empire of Zimbabwae2 » Sun Oct 20, 2024 3:14 pm

Vylixan wrote:Not all census data is invisible, nations that were CTE at the time of the crash don't have this problem.
For example: https://www.nationstates.net/nation=rot ... ensusid=86

That's interesting. I couldn't find any info on why some nations still had their data.

What would be the technical reason for why nations that were CTE didn't have this problem?

I thought that redundant systems worked to keep entire backups at specific points in time, so I'm not seeing why this would happen? Though I am sure there is some technical reason
editors dislike linguistic dis-ambiguity more than most people
- infvalues <- if you're interested
- don't have a bad day!

User avatar
Eluvatar
Director of Technology
 
Posts: 3258
Founded: Mar 31, 2006
New York Times Democracy

Postby Eluvatar » Sat Jun 21, 2025 8:24 am

The Galactic Empire of Zimbabwae2 wrote:
Vylixan wrote:Not all census data is invisible, nations that were CTE at the time of the crash don't have this problem.
For example: https://www.nationstates.net/nation=rot ... ensusid=86

That's interesting. I couldn't find any info on why some nations still had their data.

What would be the technical reason for why nations that were CTE didn't have this problem?

I thought that redundant systems worked to keep entire backups at specific points in time, so I'm not seeing why this would happen? Though I am sure there is some technical reason


The reason is that when a nation CTEs, its census history is removed from the database and archived outside of it to save space.

This reason is also part of why restoring the census_history from the pre-crash database is a little tricky. We need to deal with the census history of the nations which have CTEd since April 2024.

But we made some progress in that direction yesterday and I'm cautiously optimistic that we can restore most of the the data sometime in the next few weeks (a few censuses - liberal, conservative, apathetic, business, wealth gaps, and advanced - we'll have to come back to as their database files are more messed up).
To Serve and Protect: UDL

Eluvatar - Taijitu member

User avatar
Eluvatar
Director of Technology
 
Posts: 3258
Founded: Mar 31, 2006
New York Times Democracy

Postby Eluvatar » Thu Oct 02, 2025 8:46 am

Scratch weeks, say months. We made some progress yesterday, though.

We still need to double check that our code and plan is going to work but expect visible movement on this soon-ish. May involve downtime.
To Serve and Protect: UDL

Eluvatar - Taijitu member

User avatar
Vylixan
Diplomat
 
Posts: 574
Founded: Mar 19, 2006
Tyranny by Majority

Postby Vylixan » Fri Oct 03, 2025 11:53 am

Awesome news!
Slow and steady wins the day :bow: .

User avatar
Eluvatar
Director of Technology
 
Posts: 3258
Founded: Mar 31, 2006
New York Times Democracy

Postby Eluvatar » Mon Jun 22, 2026 1:04 pm

We'd been unable to get back to this for some months, but I can report some progress again. It will certainly take at at least some weeks, but hopefully I'll be able to give an update with a more specific timeline sometime in the next couple weeks.
To Serve and Protect: UDL

Eluvatar - Taijitu member


Advertisement

Remove ads

Return to Technical

Who is online

Users browsing this forum: Russisch

Advertisement

Remove ads