NationStates

-=[ WFE Archive ]=-
Link

With the absence of a working, updating, World Factbook Entry archive for defenders to use, detagging has become less effective, and although I am a raider (I guess), I figured I would help them out. Additionally, you can use this archive for whatever purposes you want.

The website is simple to use, you head over to the website, enter in the region you want to view, hit 'Enter', and bask in the glory of WFE records.

Want to link a region's records to a friend? Easy, just copy-paste the link you get from searching the region. Want to send them a specific record? Click on the date for that record, and send them that link, instead.

-=[ Details ]=-
At the moment, I think I will be updating the records every week, although I am open to input on this. Along with this, I don't think I will need to ever purge older records, but if I ever do, it'd be records that are like a year old hopefully. The database should have plenty of space to expand.

I don't have any rate-limiting built in, but try not to spam searches, as it'll slow down the database. I was considering adding flags, but as far as I know, the flag links provided from the data dump aren't permanent, as I believe they delete files when they are no longer a regions flag after a while. Correct me if I am wrong.

If there are any other features you might want added, let me know here, in telegrams, or on Discord: bowzin#6742
If there are ever any errors with the database/website, let me know as soon as possible!

Hope you guys get some good use out of this!

Thanks! I had been working on a similar project (with out the web interface)

But I figure I can still share as mine will run locally in the event that this tool and my stash stop being updated

here turns out there's a lot of files to upload so I've been working them up as I can to run the tool grab it from the gimme that code file. You will need python to run it.

Thanks for the handy website tho

Edit: as a note mine does go as far back as the dump files are. For a complete index check the zip folder

Source: https://www.bowzin.com/wfe_archive?region=Minoa

I think that any duplicate records can be merged: Minoa doesn't update their WFE as much as an active region, such as the Feeder/Sinker or Raider/Defender headquarters regions.

In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?

Tinhampton wrote:In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?

Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.

9003 wrote:

Tinhampton wrote:In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?

Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.

This is indeed correct, my dump-reader is in python. Also, some characters are set to be altered to prevent any injection hacking.

Do you ever intend to go back further then what you have now for regions that have been taged when you started this the regional dumps go back to 2018ish

Edit if needed I have the zip I linked above to save time rather then going back and reading all the old dumps.


Likewise do you think you'll be able to get the flag index back ever or not? Understanding that takes significantly more over head

9003 wrote:Do you ever intend to go back further then what you have now for regions that have been taged when you started this the regional dumps go back to 2018ish

Edit if needed I have the zip I linked above to save time rather then going back and reading all the old dumps.


Likewise do you think you'll be able to get the flag index back ever or not? Understanding that takes significantly more over head

I'm open to doing that, would just take me some time to add a bunch of dumps-worth of data to the db
As for flags, I don't have much space on the server, and I don't want to be filling it up with flag files atm. Maybe in the future I will consider it when I can upgrade the server.

Bowzin wrote:

9003 wrote:Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.

This is indeed correct, my dump-reader is in python. Also, some characters are set to be altered to prevent any injection hacking.

You can convert references to the actual unicode characters thus: (st is the string to convert)

import html
st = html.escape(html.unescape(st),quote=True)

This converts all &# escaped characters to actual unicode while keeping & < > ' " escaped. Docs. If you want to keep quotes unescaped set that parameter to false. If you want &<> to be unescaped as well then just use unescape.

Thank you so much I will add that to my code right away. It'll be more helpful then trying to guess or Google what each one is.

I note that your WFE Archive has not saved any WFEs since May 13th 2020. Why is this?

Bowzin wrote:As for flags, I don't have much space on the server, and I don't want to be filling it up with flag files atm. Maybe in the future I will consider it when I can upgrade the server.

If you base64 encode the flag images you can store them in the Database as text much like WFEs - however I would only do this after setting up triggers to prevent duplicate entries.