NATION

PASSWORD

Ongoing Database Problems: Discussion/Questions

Bug reports, general help, ideas for improvements, and questions about how things are meant to work.
User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Ongoing Database Problems: Discussion/Questions

Postby United Calanworie » Sun Apr 14, 2024 2:56 pm

Got questions about the ongoing database problems? Ask them here.

You will likely find it useful to read the Admin thread.
Last edited by United Calanworie on Fri Apr 19, 2024 2:53 pm, edited 1 time in total.
Reason: modedit: stealing post
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Sun Apr 14, 2024 2:57 pm

We're aware, admin hath been flagged.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
Cupic
Political Columnist
 
Posts: 2
Founded: Apr 13, 2024
Civil Rights Lovefest

Database error - Blocking me from using region.

Postby Cupic » Sun Apr 14, 2024 2:58 pm

[violet] wrote:I've made a few changes to the NS API. By which I mean this:

http://www.nationstates.net/pages/api.html

This has previously been known as regiondata.cgi and nationdata.cgi, both of which continue to work at their old addresses. They essentially forward to this one now. which have been retired as of August 2013.

The API exists so that people can build NS-based sites, such as NSDossier and NSEconomy. We want to support such efforts.

Please visit the API documentation page for information. The major change is that very high rates of queries (more than 100/minute) will result in the IP address being denied service for 15 minutes. This is to ensure regular players don't suffer slowdowns because of overzealous scripts.

In general, scripts should not attempt to look up every resident of a region all at once. This can result in dozens, hundreds, or thousands of near-simultaneous requests to the server, which are difficult or impossible to service. If you need information on large numbers of nations, you should trawl them from the API as a speed-limited background job and store the data locally on your server.

Please let me know if you have any questions or concerns!

Background: This is the result of events documented in the "Scripts banned" thread.

Hello! My screen shows a database error, saying "Database connection error at Sun Apr 14 14:55:38 2024" . What do I do?

User avatar
Ineva
Minister
 
Posts: 3084
Founded: Dec 16, 2023
Corporate Bordello

Postby Ineva » Sun Apr 14, 2024 3:13 pm

Cupic wrote:
[violet] wrote:I've made a few changes to the NS API. By which I mean this:

http://www.nationstates.net/pages/api.html

This has previously been known as regiondata.cgi and nationdata.cgi, both of which continue to work at their old addresses. They essentially forward to this one now. which have been retired as of August 2013.

The API exists so that people can build NS-based sites, such as NSDossier and NSEconomy. We want to support such efforts.

Please visit the API documentation page for information. The major change is that very high rates of queries (more than 100/minute) will result in the IP address being denied service for 15 minutes. This is to ensure regular players don't suffer slowdowns because of overzealous scripts.

In general, scripts should not attempt to look up every resident of a region all at once. This can result in dozens, hundreds, or thousands of near-simultaneous requests to the server, which are difficult or impossible to service. If you need information on large numbers of nations, you should trawl them from the API as a speed-limited background job and store the data locally on your server.

Please let me know if you have any questions or concerns!

Background: This is the result of events documented in the "Scripts banned" thread.

Hello! My screen shows a database error, saying "Database connection error at Sun Apr 14 14:55:38 2024" . What do I do?

In the words of the late George Harrison, "It's gonna take patience and time."
Ineva
Ineva, OoC.
Observant CaTETholic.
Second-best F7er of April 2024!
Want a news box? Use the pre tag.
Ineva represents my real political views.
Establish foreign relations with Ineva here.
If you have any questions about G-d, TG me.
Ineva is like Israel. It is not actually Israel.
This Index classifies Ineva as Tier 8, Type 4, Class 2.
IC population is 11.12 million. Everything else is canon.
A cordial thank you to Statesburg for teaching me about the pre tag.
Abortion is murder.
Stand with ISRAEL.
FTR2TS = Genocide.
- Inevan Signature News - Etwepe becomes Registered Ally | Nu Elysium becomes Registered Foe | Memorial service held for Goo Goo | Memorial service held for The second Akane Kurokawa | Ancientania becomes Registered Ally | Ravemath becomes Registered Ally

User avatar
Querria
Ambassador
 
Posts: 1328
Founded: Mar 15, 2013
Inoffensive Centrist Democracy

Postby Querria » Sun Apr 14, 2024 3:14 pm

Oh cool. Thought I had unintentionally done a no-no. Never got a ban, so no idea what it looks like. Hope the [Database error] gets resolved soon.
The Civilization Index| RPs & Stories
Join the Midnight Vale.
LFPD Soveriegn wrote:WHY IS EVERYTHING BLOODY BLUE

Forsher wrote:I blame the French.
Collectivism sucks, Embrace Individuality.
Adding nothing of substance to online discourse since Xmas 2023. Just a content creator playing games.

User avatar
Almonaster Nuevo
Negotiator
 
Posts: 6956
Founded: Mar 11, 2007
Civil Rights Lovefest

Postby Almonaster Nuevo » Sun Apr 14, 2024 3:16 pm

Cupic wrote:What do I do?

Do nothing...
Relax.
Rest in the arms of the dragon.
Last edited by Almonaster Nuevo on Sun Apr 14, 2024 3:17 pm, edited 1 time in total.
Christian Democrats wrote:Would you mind explaining what's funny? I'm not seeing any humor.
The Blaatschapen wrote:I'll still graze the forums with my presence
Please do not TG me about graphics requests. That's what the threads are there for.

User avatar
Vonum
Diplomat
 
Posts: 884
Founded: Oct 07, 2021
Inoffensive Centrist Democracy

Postby Vonum » Sun Apr 14, 2024 3:20 pm

How long will this take, approximately? I've got people to message!
>>>>>>
Zara Del Rey wins Vonum their 5th NationVision Win!
Lika Hittuni, the renowned 'Female Rapist' has been arrested. She is in custody after raping 7 men.
Police stop a riot supporting Nazism in downtown Miami
<<<<<<
Maddeloffu: 23ºC, Sunny
Xertæ: 24ºC, Sunny
Exeta: 23ºC, Sunny
Miami: 31ºC, Sunny
Lijkyao: 21ºC, Sunny
Craonyao: 22ºC, Sunny
Onacita: 27ºC, Sunny

Nationa Informatia: Very hot, very sunny.

5-time NV Winner

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Sun Apr 14, 2024 3:24 pm

Vonum wrote:How long will this take, approximately? I've got people to message!

It'll take however long it takes. Database crashes aren't anything that we can predict, nor predict how long they take to fix. Admin is actively working on the issue. We're trying some first steps, but if it gets more involved, it could be substantially longer.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
Barbariax
Secretary
 
Posts: 39
Founded: Aug 08, 2016
Anarchy

Postby Barbariax » Sun Apr 14, 2024 3:25 pm

Panic, the end times have come!!

User avatar
Roxium
Civil Servant
 
Posts: 6
Founded: Sep 10, 2016
Liberal Democratic Socialists

Postby Roxium » Sun Apr 14, 2024 6:50 pm

Any updates yet?

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Tue Apr 16, 2024 1:07 am

Good morning everyone. This is a bit of a longer announcement, and it quickly describes where we're at, what kind of data loss we think we'll have, and steps that we're trying to take to mitigate it.

The disk that failed contained several tables on it, but the ones of primary concern to most players are going to be:
  • Telegram API keys
  • Telegram templates (not the text of the templates themselves, this is an accessory table used to help speed along processes involving templated telegrams being sent)
  • The telegram queue (the status of recruitment/campaign telegrams that had recently been sent out)
  • Recruitment telegram stats
  • And the biggest one: Cards.

I'm going to talk about cards first here as that's the largest community that's going to be affected the most. We've likely lost months worth of data in terms of:
  • card ownership
  • trades
  • bank data
  • collections
  • bids, asks, auctions
There's a potential that we will be able to recover some of that data. Unfortunately, the disk failed in a rather spectacular manner, and is resistant to our attempts to recover anything from it. We will keep you updated.

As to the telegrams information:
The API keys are gone. You'll have to file a GHR to get a new key once we're back online. Hopefully that's not too much of an issue. We're looking into rebuilding the other tables from the main telegrams table, as it contains all the information that is required to build the other tables. It should be possible to recover relatively quickly. It's likely that mass telegrams will be restored to whatever state they were in up to approximately a week ago for the largest telegrams.

We're continuing our efforts at data recovery, and will let you know when we know more re. data loss. In the meantime, we're also trying to bring the game back up with critically impacted areas (e.g. cards, telegrams) disabled while we do our best to restore the data that we can.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
Barinive
Spokesperson
 
Posts: 144
Founded: Oct 16, 2023
Moralistic Democracy

Postby Barinive » Tue Apr 16, 2024 1:10 am

I thought it was an in-progress update until i saw the technical difficulties screen [Posting this to test if nations on forums still work]
Btw, i know that the forums and main game are different websites, but are nations dependent on the main game or is it a different account?
Syncretic centrist and fiscal conservative irl and in character
Considering changing the lore - if you want the lore changed TG me
Canon and non canon guide

User avatar
New Westmore
Spokesperson
 
Posts: 159
Founded: Jul 21, 2022
Democratic Socialists

Postby New Westmore » Tue Apr 16, 2024 1:12 am

[COMTEST]

anyway, are we also expecting to have lost data as well regarding things like RMB messages and cosmetic stuff like our flags and dispatches?
World Assembly Delegation

President (GA/SC)
Esther Lynn (she/her)

MoFA (GA)
Dennis Mercer (he/him)

MoD (SC)
Allie McMurdo (she/they/them)
(Extended bio)
View my old sigs

Comments made in NSGP
and elsewhere do not represent
the East Pacific unless specified.
Democratic Republic of New Westmore
Per Ardua, Ad Astra | Minister of Outreach of The East Pacific

Dalesburg Chronicle - Headlines gathered. Opinions probed.
A man has fallen into the river in Dalesburg City; helicopters have not found him yet | Anti-Corruption Watchdog Chairman caught out in corruption scandal | Talks with Omonia and OUS over East Aislada continue to deteriorate | "Skibidi" voted word of the year by Monash Dictionary; lambasted for choosing such a "dumb word"


------- | >xx< | -------

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Tue Apr 16, 2024 1:15 am

New Westmore wrote:[COMTEST]

anyway, are we also expecting to have lost data as well regarding things like RMB messages and cosmetic stuff like our flags and dispatches?

As of my post -- no. We have to rebuild the RMB page index, but that doesn't have anything to do with the messages themselves, merely their display.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
The Southern Dependencies
Secretary
 
Posts: 40
Founded: Jan 16, 2023
Democratic Socialists

Postby The Southern Dependencies » Tue Apr 16, 2024 1:16 am

What's the expected time for recovery of the site other than "a few days", if such an estimation can be given?

User avatar
Troc
Civil Servant
 
Posts: 6
Founded: Mar 16, 2023
Moralistic Democracy

Postby Troc » Tue Apr 16, 2024 1:16 am

how bout cards?
Democratic Repubilc of Troc
Troc Demokraattinen Tasavalta
Troc Demokraatlik Vabariik
Troc Demokráhtalaš Dásseváldi
Troc Demokraattlaž Tääʹssväʹldd
Troc Demokraatlâš Täsiväldi

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Tue Apr 16, 2024 1:18 am

The Southern Dependencies wrote:What's the expected time for recovery of the site other than "a few days", if such an estimation can be given?

We don't have one. Hopefully within a few days.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
Valentine Z
Postmaster-General
 
Posts: 13128
Founded: Nov 08, 2015
Scandinavian Liberal Paradise

Postby Valentine Z » Tue Apr 16, 2024 1:18 am

Troc wrote:how bout cards?

As per Aav's post, yeah that is affected big time.
Val's Stuff. ♡ ^_^ ♡ For You
If you are reading my sig, I want you to have the best day ever ! You are worth it, do not let anyone get you down !
Glory to De Geweldige Sierlijke Katachtige Utopia en Zijne Autonome Machten ov Valentine Z !
(✿◠‿◠) ☆ \(^_^)/ ☆

Issues Thread Photography Stuff Project: Save F7. Stats Analysis

The Sixty! Valentian Stories! Gwen's Adventures!

• Never trouble trouble until trouble troubles you.
• World Map is a cat playing with Australia.
Let Fate sort it out.

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Tue Apr 16, 2024 1:18 am

Troc wrote:how bout cards?

United Calanworie wrote:I'm going to talk about cards first here as that's the largest community that's going to be affected the most. We've likely lost months worth of data in terms of:
  • card ownership
  • trades
  • bank data
  • collections
  • bids, asks, auctions
There's a potential that we will be able to recover some of that data. Unfortunately, the disk failed in a rather spectacular manner, and is resistant to our attempts to recover anything from it. We will keep you updated.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

User avatar
The Southern Dependencies
Secretary
 
Posts: 40
Founded: Jan 16, 2023
Democratic Socialists

Postby The Southern Dependencies » Tue Apr 16, 2024 1:19 am

United Calanworie wrote:
The Southern Dependencies wrote:What's the expected time for recovery of the site other than "a few days", if such an estimation can be given?

We don't have one. Hopefully within a few days.

Understandable, thanks for the help anyways! ^-^

User avatar
New Westmore
Spokesperson
 
Posts: 159
Founded: Jul 21, 2022
Democratic Socialists

Postby New Westmore » Tue Apr 16, 2024 1:19 am

United Calanworie wrote:
New Westmore wrote:[COMTEST]

anyway, are we also expecting to have lost data as well regarding things like RMB messages and cosmetic stuff like our flags and dispatches?

As of my post -- no. We have to rebuild the RMB page index, but that doesn't have anything to do with the messages themselves, merely their display.

I see. Another question - will the whole site be revamped cosmetically and technologically as well once the database is fixed, or will it remain untouched in that regard?
World Assembly Delegation

President (GA/SC)
Esther Lynn (she/her)

MoFA (GA)
Dennis Mercer (he/him)

MoD (SC)
Allie McMurdo (she/they/them)
(Extended bio)
View my old sigs

Comments made in NSGP
and elsewhere do not represent
the East Pacific unless specified.
Democratic Republic of New Westmore
Per Ardua, Ad Astra | Minister of Outreach of The East Pacific

Dalesburg Chronicle - Headlines gathered. Opinions probed.
A man has fallen into the river in Dalesburg City; helicopters have not found him yet | Anti-Corruption Watchdog Chairman caught out in corruption scandal | Talks with Omonia and OUS over East Aislada continue to deteriorate | "Skibidi" voted word of the year by Monash Dictionary; lambasted for choosing such a "dumb word"


------- | >xx< | -------

User avatar
Indo States
Minister
 
Posts: 3351
Founded: Jan 05, 2018
Psychotic Dictatorship

Postby Indo States » Tue Apr 16, 2024 1:19 am

I'm wondering if dispatches are also affected by the database failure?
Fédération Fatimanienné - Fatiman Federation
Country of Freedom and Education


I DO NOT USE NATIONSTATES STATS

User avatar
Ferranghia
Lobbyist
 
Posts: 11
Founded: Dec 10, 2015
Corrupt Dictatorship

Postby Ferranghia » Tue Apr 16, 2024 1:20 am

United Calanworie wrote:Unfortunately, the disk failed in a rather spectacular manner,


Part of me hopes for a very flashy sparks shower as the disk blasted open filling the room with smoke and that pleasant smell of burned electronics
Admiral of Ferranghia and master of the puppet government of the_dorvan_protectorate_of_ferranghia
Slowly building the Nationstates API C# Library

User avatar
The Southern Dependencies
Secretary
 
Posts: 40
Founded: Jan 16, 2023
Democratic Socialists

Postby The Southern Dependencies » Tue Apr 16, 2024 1:22 am

Will there be any attempt to modernise what is, quite clearly, in my opinion, an outdated system? This website is, after all, very ancient.
Last edited by The Southern Dependencies on Tue Apr 16, 2024 1:22 am, edited 1 time in total.

User avatar
United Calanworie
Technical Moderator
 
Posts: 3920
Founded: Dec 12, 2018
Democratic Socialists

Postby United Calanworie » Tue Apr 16, 2024 1:24 am

New Westmore wrote:
United Calanworie wrote:As of my post -- no. We have to rebuild the RMB page index, but that doesn't have anything to do with the messages themselves, merely their display.

I see. Another question - will the whole site be revamped cosmetically and technologically as well once the database is fixed, or will it remain untouched in that regard?

The Southern Dependencies wrote:Will there be any attempt to modernise what is, quite clearly, in my opinion, an outdated system? This website is, after all, very ancient.

Yeah uh. Our tech team time has been spent putting out fires and repairing the servers, not creating new shiny things like CSS.
Trans rights are human rights.
||||||||||||||||||||
Discord: Aav#7546 @queerlyfe
She/Her/Hers
My telegrams are not for Moderation enquiries, those belong in a GHR. Feel free to reach out if you want to just chat.

Next

Advertisement

Remove ads

Return to Technical

Who is online

Users browsing this forum: Dakota

Advertisement

Remove ads