NATION

PASSWORD

Bowzin's WFE Archive - 3/18/20

Bug reports, general help, ideas for improvements, and questions about how things are meant to work.
User avatar
Bowzin
Envoy
 
Posts: 258
Founded: Aug 13, 2018
Left-Leaning College State

Bowzin's WFE Archive - 3/18/20

Postby Bowzin » Thu Mar 19, 2020 1:56 pm

-=[ WFE Archive ]=-
Link

With the absence of a working, updating, World Factbook Entry archive for defenders to use, detagging has become less effective, and although I am a raider (I guess), I figured I would help them out. Additionally, you can use this archive for whatever purposes you want.

The website is simple to use, you head over to the website, enter in the region you want to view, hit 'Enter', and bask in the glory of WFE records.

Want to link a region's records to a friend? Easy, just copy-paste the link you get from searching the region. Want to send them a specific record? Click on the date for that record, and send them that link, instead.

-=[ Details ]=-
At the moment, I think I will be updating the records every week, although I am open to input on this. Along with this, I don't think I will need to ever purge older records, but if I ever do, it'd be records that are like a year old hopefully. The database should have plenty of space to expand.

I don't have any rate-limiting built in, but try not to spam searches, as it'll slow down the database. I was considering adding flags, but as far as I know, the flag links provided from the data dump aren't permanent, as I believe they delete files when they are no longer a regions flag after a while. Correct me if I am wrong.

If there are any other features you might want added, let me know here, in telegrams, or on Discord: bowzin#6742
If there are ever any errors with the database/website, let me know as soon as possible!

Hope you guys get some good use out of this!
Bowzin Vytherov-Skollvaldr
| Statsminister of Balder |
Want to know my whole story? Check my Resume Dispatch

User avatar
9003
Chargé d'Affaires
 
Posts: 384
Founded: Oct 25, 2012
Father Knows Best State

Postby 9003 » Thu Mar 19, 2020 2:07 pm

Thanks! I had been working on a similar project (with out the web interface)

But I figure I can still share as mine will run locally in the event that this tool and my stash stop being updated

here turns out there's a lot of files to upload so I've been working them up as I can to run the tool grab it from the gimme that code file. You will need python to run it.

Thanks for the handy website tho

Edit: as a note mine does go as far back as the dump files are. For a complete index check the zip folder
Last edited by 9003 on Thu Mar 19, 2020 2:09 pm, edited 1 time in total.
proud member of PETZ people for the Ethical Treatment of Zombies

Active member of The cards market place discord

User avatar
Minoa
Senator
 
Posts: 4641
Founded: Oct 05, 2011
Civil Rights Lovefest

Postby Minoa » Sat Mar 21, 2020 6:41 am

Source: https://www.bowzin.com/wfe_archive?region=Minoa

I think that any duplicate records can be merged: Minoa doesn't update their WFE as much as an active region, such as the Feeder/Sinker or Raider/Defender headquarters regions.
Mme A. d'Oiseau, B.A. (State of Minoa)

User avatar
Tinhampton
Negotiator
 
Posts: 6825
Founded: Oct 05, 2016
Anarchy

Postby Tinhampton » Sat Mar 21, 2020 4:59 pm

In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?
Author: SC#250, SC#251, SC#267, GA#484
Joint author: Issue #1115 (with Turbeaux)
Co-author: GA#491 (by The Greater Soviet North America)
New recipe - now contains 4.9g of sugar per 100ml
RiderSyl wrote:If an enchantress made it so one raid could bring about world peace, Unibot would ask raiders to just sign a petition instead.

User avatar
9003
Chargé d'Affaires
 
Posts: 384
Founded: Oct 25, 2012
Father Knows Best State

Postby 9003 » Sat Mar 21, 2020 6:49 pm

Tinhampton wrote:In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?



Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.
proud member of PETZ people for the Ethical Treatment of Zombies

Active member of The cards market place discord

User avatar
Bowzin
Envoy
 
Posts: 258
Founded: Aug 13, 2018
Left-Leaning College State

Postby Bowzin » Sun Mar 22, 2020 2:39 am

9003 wrote:
Tinhampton wrote:In the link to Minoa's WFE provided above, "hoşgeldiniz" (the Turkish word for "welcome") displays as "hoşgeldiniz." Why does Bowzin's WFE Archive not (currently) support accented and non-Latin-script characters?



Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.

This is indeed correct, my dump-reader is in python. Also, some characters are set to be altered to prevent any injection hacking.
Bowzin Vytherov-Skollvaldr
| Statsminister of Balder |
Want to know my whole story? Check my Resume Dispatch

User avatar
9003
Chargé d'Affaires
 
Posts: 384
Founded: Oct 25, 2012
Father Knows Best State

Postby 9003 » Sun Mar 22, 2020 7:05 am

Do you ever intend to go back further then what you have now for regions that have been taged when you started this the regional dumps go back to 2018ish

Edit if needed I have the zip I linked above to save time rather then going back and reading all the old dumps.


Likewise do you think you'll be able to get the flag index back ever or not? Understanding that takes significantly more over head
Last edited by 9003 on Sun Mar 22, 2020 7:06 am, edited 1 time in total.
proud member of PETZ people for the Ethical Treatment of Zombies

Active member of The cards market place discord

User avatar
Bowzin
Envoy
 
Posts: 258
Founded: Aug 13, 2018
Left-Leaning College State

Postby Bowzin » Sun Mar 22, 2020 3:19 pm

9003 wrote:Do you ever intend to go back further then what you have now for regions that have been taged when you started this the regional dumps go back to 2018ish

Edit if needed I have the zip I linked above to save time rather then going back and reading all the old dumps.


Likewise do you think you'll be able to get the flag index back ever or not? Understanding that takes significantly more over head

I'm open to doing that, would just take me some time to add a bunch of dumps-worth of data to the db
As for flags, I don't have much space on the server, and I don't want to be filling it up with flag files atm. Maybe in the future I will consider it when I can upgrade the server.
Bowzin Vytherov-Skollvaldr
| Statsminister of Balder |
Want to know my whole story? Check my Resume Dispatch

User avatar
Merni
Ambassador
 
Posts: 1135
Founded: May 03, 2016
Democratic Socialists

Postby Merni » Mon Mar 23, 2020 2:51 am

Bowzin wrote:
9003 wrote:Not the coder of the doc but taking a stab at it being becuse it's written in Python so some things are encoded that way when read from the dump files. Any non standard charecter so ' ; also can sometimes have werid results like that always the same and you can Google what they are supposed to be If needed.

This is indeed correct, my dump-reader is in python. Also, some characters are set to be altered to prevent any injection hacking.

You can convert references to the actual unicode characters thus: (st is the string to convert)
import html
st = html.escape(html.unescape(st),quote=True)

This converts all &# escaped characters to actual unicode while keeping & < > ' " escaped. Docs. If you want to keep quotes unescaped set that parameter to false. If you want &<> to be unescaped as well then just use unescape.
Last edited by Merni on Mon Mar 23, 2020 2:54 am, edited 1 time in total.
COVID19 still exists! | Free time? Help Gutenberg!
The Labyrinth | GA Committee List | Tools written by me | NS Parliament 2: Zhang Xiaoqing
I've noticed that everybody that is for abortion has already been born. — Ronald Reagan

When the people are being beaten with a stick, they are not much happier if it is called 'the People’s Stick.' — Mikhail Bakunin (to Karl Marx)

You're supposed to be employing the arts of diplomacy, not the ruddy great thumping sledgehammers of diplomacy. — Ardchoille

The West won the world not by the superiority of its ideas or values or religion [...] but rather by its superiority in applying organised violence. — Samuel P. Huntington (even he said that!)

Compass E:-7.75 S:-3.64

User avatar
9003
Chargé d'Affaires
 
Posts: 384
Founded: Oct 25, 2012
Father Knows Best State

Postby 9003 » Mon Mar 23, 2020 7:42 am

Thank you so much I will add that to my code right away. It'll be more helpful then trying to guess or Google what each one is.
proud member of PETZ people for the Ethical Treatment of Zombies

Active member of The cards market place discord

User avatar
Tinhampton
Negotiator
 
Posts: 6825
Founded: Oct 05, 2016
Anarchy

Postby Tinhampton » Thu Jun 11, 2020 5:25 am

I note that your WFE Archive has not saved any WFEs since May 13th 2020. Why is this?
Author: SC#250, SC#251, SC#267, GA#484
Joint author: Issue #1115 (with Turbeaux)
Co-author: GA#491 (by The Greater Soviet North America)
New recipe - now contains 4.9g of sugar per 100ml
RiderSyl wrote:If an enchantress made it so one raid could bring about world peace, Unibot would ask raiders to just sign a petition instead.

User avatar
Aurum Raider
Spokesperson
 
Posts: 190
Founded: Sep 18, 2014
Iron Fist Consumerists

Postby Aurum Raider » Thu Jun 11, 2020 3:24 pm

Bowzin wrote:As for flags, I don't have much space on the server, and I don't want to be filling it up with flag files atm. Maybe in the future I will consider it when I can upgrade the server.

If you base64 encode the flag images you can store them in the Database as text much like WFEs - however I would only do this after setting up triggers to prevent duplicate entries.
Atagait Vytherov-Denral, Supreme Doggo of An Incidentally Hazardous Area
Raider Purist | Your Region's Persona Inesistente


Advertisement

Remove ads

Return to Technical

Who is online

Users browsing this forum: All Wild Things, Ballotonia, Dominioan, Iverbad, Sheitlein, Skundi, Socialist States of Ludistan, The Cosmic Mainframe, The Dream of Kirby

Advertisement

Remove ads