Posted: Tue Sep 13, 2022 10:11 pmFerranghia wrote:Hithere's a value that's being printed in the census XML in scientific notation
Which region is this? Will be easier to fix if I can test.
Which region is this? Will be easier to fix if I can test.
NationStates
Because sometimes even national leaders just want to hang out
https://forum.nationstates.net/
NationStates API (nationdata/regiondata)
Page 92 of 97
Posted: Tue Sep 13, 2022 10:11 pmWhich region is this? Will be easier to fix if I can test.
Posted: Wed Sep 14, 2022 12:48 amI don't know exactly which nation Ferranghia was looking at, but I can easily enough find other examples by just looking at the top nations for the relevant score.
Try this one.
Posted: Wed Sep 14, 2022 5:20 amRight, sorry.
I was looking at my own nation, Ferranghia. Here's the link for my country's census.
The specific URL I was calling was the one with the complete census, but that shouldn't be the issue.
Posted: Sat Oct 08, 2022 10:13 amHi. This may be the wrong thread, but If I may ask a question about the NS API.
I'm making a python script that will automatically login to my puppet.
I keep getting 403 errors and I don't know why. I believe my trouble is that I'm incorrectly formatting header and body data, I'm fairly to new web-scripting so I'm not sure.
I'm making a python script that will automatically login to my puppet.
import requests
header={
'X-Password':'****************'
}
Data={'UserAgent':'*********************'}
url="https://www.nationstates.net/cgi-bin/api.cgi?nation=realm_defense_group_northwest&q=notices"
reply=requests.post(url,data=Data,headers=header)
print(reply)
I keep getting 403 errors and I don't know why. I believe my trouble is that I'm incorrectly formatting header and body data, I'm fairly to new web-scripting so I'm not sure.
Posted: Sat Oct 08, 2022 11:35 amEstingberg wrote:Hi. This may be the wrong thread, but If I may ask a question about the NS API.
I'm making a python script that will automatically login to my puppet.import requests
header={
'X-Password':'****************'
}
Data={'UserAgent':'*********************'}
url="https://www.nationstates.net/cgi-bin/api.cgi?nation=realm_defense_group_northwest&q=notices"
reply=requests.post(url,data=Data,headers=header)
print(reply)
I keep getting 403 errors and I don't know why. I believe my trouble is that I'm incorrectly formatting header and body data, I'm fairly to new web-scripting so I'm not sure.
Try making a GET request instead of POST, our documentation doesn't specify which route it accepts but I would think it's probably GET.
Posted: Sat Oct 08, 2022 2:46 pmAlso, the user agent should be a header, not POST fields.
Posted: Sat Oct 08, 2022 9:37 pmGET and POST work equally well.United Calanworie wrote:Try making a GET request instead of POST, our documentation doesn't specify which route it accepts but I would think it's probably GET.
For things that actually make a change server-side, like logging in, the official HTTP standard strongly recommends using POST, even if GET technically works. Personally I use POST even for read-only requests that don't make any change, just because it's very slightly more convenient for me to code.
But yes, as Eluvatar says, the user agent should be a header, not a GET/POST field.
Posted: Sat Oct 15, 2022 11:01 amI'm using the NaStyAPI python module to make a script. It appears that I accidently broke the rate limit.
firstly, If I'm IP banned, why was I able to immediately log to my main nation right thereafter? Secondly, could my personal accounts be subject deletion if this accident were to happen again?
firstly, If I'm IP banned, why was I able to immediately log to my main nation right thereafter? Secondly, could my personal accounts be subject deletion if this accident were to happen again?
Posted: Sat Oct 15, 2022 11:28 amIt's only an API ban, not a site ban.
Secondly, could my personal accounts be subject deletion if this accident were to happen again?
Generally no, you do not receive moderation action for API scripts -- that's why the API self-enforces its ratelimit with a temporary IP ban. Some exceptions may apply, but those are for deliberately designed broken scripts that damage the site.
Posted: Sat Oct 15, 2022 12:39 pmAnother Question; why on earth is
Producing this garbage data:
A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
Producing this garbage data:
A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
Posted: Sat Oct 15, 2022 2:02 pmEstingberg wrote:Another Question; why on earth is
Producing this garbage data:
A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
I honestly have no answer for you on that one -- it happened to me the other day when I accidentally dropped the headers from one of the requests I made to fetch a daily dump.
Posted: Sat Oct 15, 2022 2:08 pmEstingberg wrote:A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
Try using a secure connection: https://www.nationstates.net/cgi-bin/api.cgi?nation=estingberg;q=census;scale=0;mode=score
Posted: Thu Nov 17, 2022 11:27 pmI was doing some testing with the private command in the NationStates API for making RMB posts and ran into a few issues with text encoding (and believe this is the appropriate place to report it?).
For instance, trying to post the string Héllø wörld — → ∮ E⋅da = Q, n → ∞, ∑ f(i) = ∏ g(i), ∀x∈ℝ: ⌈x⌉ = −⌊−x⌋, α ∧ ¬β = ¬(¬α ∨ β), produces the output Héllø wörld ? ? ? E?da = Q, n ? ?, ? f(i) = ? g(i), ?x??: ?x? = ???x?, ? ? ¬? = ¬(¬? ? ?), (see here).
For instance, trying to post the string Héllø wörld — → ∮ E⋅da = Q, n → ∞, ∑ f(i) = ∏ g(i), ∀x∈ℝ: ⌈x⌉ = −⌊−x⌋, α ∧ ¬β = ¬(¬α ∨ β), produces the output Héllø wörld ? ? ? E?da = Q, n ? ?, ? f(i) = ? g(i), ?x??: ?x? = ???x?, ? ? ¬? = ¬(¬? ? ?), (see here).
Posted: Thu Nov 17, 2022 11:30 pmEsfalsa wrote:I was doing some testing with the private command in the NationStates API for making RMB posts and ran into a few issues with text encoding (and believe this is the appropriate place to report it?).
For instance, trying to post the string Héllø wörld — → ∮ E⋅da = Q, n → ∞, ∑ f(i) = ∏ g(i), ∀x∈ℝ: ⌈x⌉ = −⌊−x⌋, α ∧ ¬β = ¬(¬α ∨ β), produces the output Héllø wörld ? ? ? E?da = Q, n ? ?, ? f(i) = ? g(i), ?x??: ?x? = ???x?, ? ? ¬? = ¬(¬? ? ?), (see here).
RMB posts are in windows 1252, at least according to my brief check. Try that?
Posted: Fri Nov 18, 2022 12:04 amThe RMB accepts UTF-8 when posted through the manual form, though (proof). It seems to be an inconsistency between the manual interface and the API.
Esfalsa is already specifying the intended character encoding of the POST data in the request, so unless there's something about how this is supposed to be specified in the HTTP standard that I'm unaware of, the API is being non-compliant by ignoring the "charset=utf-8" specifier.
Esfalsa is already specifying the intended character encoding of the POST data in the request, so unless there's something about how this is supposed to be specified in the HTTP standard that I'm unaware of, the API is being non-compliant by ignoring the "charset=utf-8" specifier.
Posted: Fri Nov 18, 2022 12:58 amTo clarify, the reason I posted was that my understanding from a prior conversation on Discord is that site staff is currently working towards UTF-8 support and that I should make a post if anything doesn't work with that.
That said, thanks for taking a look Aav — it's good to know what's currently supported. Characters supported by Windows 1252 do seem to output fine (even with charset=utf-8 in the Content-Type header). I did some further testing and it seems HTML escape sequences work fine too, so that's a workaround for now I suppose.
That said, thanks for taking a look Aav — it's good to know what's currently supported. Characters supported by Windows 1252 do seem to output fine (even with charset=utf-8 in the Content-Type header). I did some further testing and it seems HTML escape sequences work fine too, so that's a workaround for now I suppose.
Posted: Fri Nov 18, 2022 1:15 amHmm, wait. So you're submitting them as UTF-8 characters, rather than in their Windows-1252 representations, but they work so long as they happen to be Windows-1252 characters too? That suggests there's some kind of "double conversion" issue going on, with the input being converted from UTF-8 to Windows-1252 and then back from Windows-1252 to UTF-8.Esfalsa wrote:Characters supported by Windows 1252 do seem to output fine (even with charset=utf-8 in the Content-Type header).
Which shouldn't work, since HTTP POST data isn't HTML data. It's erroneous for ampersands to not be preserved literally.
Previous times this topic has come up:
http://forum.nationstates.net/viewtopic.php?f=15&t=483646
http://forum.nationstates.net/viewtopic.php?f=15&t=514105
Also, while on the subject of character encodings and the proper way to escape them, while it's an extremely minor thing, I would still like to bring up this old report of mine, where the reply data from the API incorrectly uses a JavaScript/JSON/etc. escape where an XML escape is expected.
Posted: Sat Nov 19, 2022 9:54 pmEstingberg wrote:Another Question; why on earth is
Producing this garbage data:
A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
I'm a little late to the party, but you should by setting a User-Agent header, not UserAgent. That's the likely issue here.
Posted: Sun Nov 27, 2022 4:26 pmEstingberg wrote:A summary of the data is that it's an html page from Cloudflare saying "Checking if the site connection is secure" that lacks the data I'm looking for.
I think that's a page that CloudFlare throws up when it finds the request particularly suspicious.
We have disabled all the anti-bot stuff we can on the API, but you can still trigger a CloudFlare check for mysterious reasons based on where you are, what it knows about you, and what you seem to be trying to do. Sometimes I think it happens just because your query coincidentally looks a bit like a known hack.
Posted: Tue Nov 29, 2022 12:20 amJust to be clear, the API is solely for the gameside of things, yes? That is to say, I wouldn't be able to use it to web scrape the forums?
Posted: Tue Nov 29, 2022 8:48 amVistulange wrote:Just to be clear, the API is solely for the gameside of things, yes? That is to say, I wouldn't be able to use it to web scrape the forums?
That is correct. Please keep in mind that scraping the forums manually must abide by the Script Rules and is unsupported and frowned upon for anything more than a small amount.
Posted: Tue Nov 29, 2022 2:42 pmRoavin wrote:Vistulange wrote:Just to be clear, the API is solely for the gameside of things, yes? That is to say, I wouldn't be able to use it to web scrape the forums?
That is correct. Please keep in mind that scraping the forums manually must abide by the Script Rules and is unsupported and frowned upon for anything more than a small amount.
Alright, thank you, that was very informative!
Posted: Wed Dec 07, 2022 12:33 pmCould there be a region shard added to the API to view authorised recruiters for a region?
Posted: Sat Dec 24, 2022 9:09 amHey, I know all eyes are on the other part of the technical forum right now, but I'd like to know if functionality for changing a nation's settings are being worked on. More specifically, I'd like there to be a private shard that works similarly to ?nation= for a nation's settings, as well as some sort of private command to change said settings. This would help me with a project I'm working on. Thanks!
I'll get a formal API request up later if no one's done it before.
I'll get a formal API request up later if no one's done it before.
Posted: Wed Jan 11, 2023 10:28 pmThe Ice States wrote:Could there be a region shard added to the API to view authorised recruiters for a region?
Bumping this request.