NS Stats - Trends, Correlations, Anti-Correlations, Oh My!

[Trotterdam]

I wonder if I can get more precise data, like HDI to > 2 decimal places.

Nope, with the exception of a rare few redundant calls. Specifically, http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=gdp gives more digits of accuracy than http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=census&scale=76&mode=score.

There's also http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=income+richest+poorest, but that gives less digits of accuracy than http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=census&scale=72+73+74&mode=score, so it's not very useful (it serves mainly to give you the exact same numbers that are reported on the national overview page).

[Valentine Z]

I wonder if I can get more precise data, like HDI to > 2 decimal places.

Nope, with the exception of a rare few redundant calls. Specifically, http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=gdp gives more digits of accuracy than http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=census&scale=76&mode=score.

There's also http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=income+richest+poorest, but that gives less digits of accuracy than http://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=census&scale=72+73+74&mode=score, so it's not very useful (it serves mainly to give you the exact same numbers that are reported on the national overview page).

I found the one for HDI, though by total accident...

https://www.nationstates.net/cgi-bin/api.cgi?nation=valentine_z&q=hdi

<NATION id="valentine_z">
<HDI-ECONOMY>100</HDI-ECONOMY>
<HDI-SMART>100</HDI-SMART>
<HDI-LIFESPAN>97.8252212500143</HDI-LIFESPAN>
<HDI>99.2750737500048</HDI>
</NATION>

So there are more precise digits! 99.2750737500048 from this, which in turn is displayed as 99.28 on the NS Stats page. I wonder why it wasn't listed in the public shards.

---

Additional Testing:

This is my puppet, Victoriaans Nederlands. Same query with HDI.

<NATION id="victoriaans_nederlands">
<HDI-ECONOMY>100</HDI-ECONOMY>
<HDI-SMART>100</HDI-SMART>
<HDI-LIFESPAN>96.1256196589631</HDI-LIFESPAN>
<HDI>98.708539886321</HDI>
</NATION>

This is after answering Issue 276, Option 3 (Helping the circus clowns):

<NATION id="victoriaans_nederlands">
<HDI-ECONOMY>100</HDI-ECONOMY>
<HDI-SMART>100</HDI-SMART>
<HDI-LIFESPAN>96.1270843959348</HDI-LIFESPAN>
<HDI>98.7090281319783</HDI>
</NATION>

---

With all of these said, I'm not sure if I can actually use them to my fullest advantage. There has to be a way to get precise data for all the stats, but I'm not sure how as of the time being.

My adventures continues on a relevant thread!

[Valentine Z]

While it is not too important and is very, very independent from the rest of the stats, a new kind of stats is out!

The Most Valuable International Artwork in the World. Basically, your deck's value.

[Candlewhisper Archive]

Huh, that's cool. We had no heads up on this at all in the Editing team, but it's nice to see added.

[Valentine Z]

Huh, that's cool. We had no heads up on this at all in the Editing team, but it's nice to see added.

Ah, that's strange indeed. Granted, it's one of those stats that doesn't have any relations to issues at all (maybe save for getting cards from issues), but I would have thought that the staff members know about it.

Still, hoping to see how my DV changes with time! Probably won't be included in this graph for the most parts, since it has no relation to anything.

[Angshire]

This whole thread measuring correlations and anti-correlations is definitely interesting!

I have a couple of requests that I'd be interested to see:

1.) Compassion vs Niceness (It's assumed that these are correlated to one another, but I'd still want to see the graph)
2.) Defense Forces vs Pacifism (It's also generally assumed they are anti-correlated, but I've seen some nations with high numbers in both)
3.) Economy vs Economic Freedom (I think itd be interesting to see whether nations that lean more socialist vs nations leaning more capitalist have be performing economies)

[Nouveau Yathrib]

This whole thread measuring correlations and anti-correlations is definitely interesting!

I have a couple of requests that I'd be interested to see:

1.) Compassion vs Niceness (It's assumed that these are correlated to one another, but I'd still want to see the graph)

I’ve heard one of them is the other + Cheerfulness but idk if that’s true

[Valentine Z]

With my exams over and my codes going strong, I will be gathering the needed data soon and doing the plottings!

Stay tuned! ^^

[Valentine Z]

The 1st Trawl of the 2nd Batch has been done as of 24th and 25th of December 2019. There are a whopping 19 524 nations this time, 87 stats, 2 values for each stat (Score and World Rank). As a result, there are a crazy amount of data this time to work with, at a staggering 3 397 176 data points (1 698 588 data points with just nations and stats, without world rank).

Regions included in this trawl, along with my puppets: 10000 Islands, Capitalist Paradise, Europe, Forest, NationStates, Osiris, Texas, The Free Nations Region, The North Pacific, Two Letters.

---

And as requested, Niceness vs Compassion! I messed up the axis ordering on the titles.

There are 5 graphs: Linear-Linear, Log-Log, Linear-Log, Log-Linear, and Linear-Linear again with zooming in. From what I can see, there is a strong positive correlation between Compassion and Niceness, at Niceness = 0.7178 * Compassion - 16.027, R-squared Value of 0.926. In other words, there is a very strong linear positive correlation and you can see that as Compassion increases, so does Niceness. There are some rare exceptions (with Compassion = 86.14, Niceness = 0.81) but these are very small.

One special trait is that in the middle, if you look at the log-log plot, there are horizontal steps between 1 < Y < 10. At these ranges, there are multiple values for X (Compassion), around 25 < X < 45. Compassion can vary without Niceness changing for these parts. This is not a result of nations answering issues; most of these nations actually have answered a few issues to get their stats affected. Just that, for this particular midpoint, it is like that.

[Valentine Z]

The revisit to the trend! So, this was something I have been doing as well. In fact, this is the very first thing that came into my mind: What if you can have a high DF and high Pacifism? Can I get both? The answer is.... well, not really in the long-run. Here's how!

Linear-Linear:

Log-Linear:

Log-Log:

Linear-Log:

There are two graphs and zoomed-in for the linear axes because you will realise that there are negative values for Defense Forces. As you can see, you can get a fair share of Defense Forces and Pacifism in the long run, but eventually... it will drop to the point where the DF and Pacifism are somewhat anti-correlated. It's not a pure anti-correlation, but on the extremes, you can only get either one.

Either extreme DF, or extreme Pacifism. It seems like you can't have both, even if you are extremely committed.

[Valentine Z]

Ahh, now this is a very unique and interesting trend! We will take a look at the graphs first! Given the data not being too sparse out, I am only going with Linear-Linear.

Looks pretty interesting, doesn't it? You have the usual trend going on - As the Economic Freedom increases, so does the Economy. The interesting thing is that there is a "Forbidden Zone" from -10 to 0 on the Economic Freedom. Maybe the data that I got, the 19000+ nations, doesn't have EF in that range. Maybe it's something else... I am not very sure myself!

You have the usual trend... and you also have the trend that both Socialist (low EF) and Capitalist (high EF) nations can have a very good Economy, as you can see from the close-up. However, there are more Capitalist nations than Socialist nations when it comes to the number of High-Economy nations. That is, the High-Economy nations can exist for both sides, but there are more on the Capitalist side.

What's interesting is the trend that goes at very high EF, starting at 80. You see a buckle there, along with the slowly decreasing Economy. It would seem that an Anarchy, or those with very, very high freedom of doing business, doesn't fare so well. Even Northern Borland, the granddaddies of Capitalist Economies and having such a huge Economic Output, doesn't have an 100.00 on the Rand Index (Economic Freedom); they have 82.56 and 53.44, as of the time of this writing.

And this is not because they are older nations, either. Here's the same trend, but filtered out so that it only shows the Top 1% Population (< 1600th World Rank for Population), with 150 Data Points.

In short? Both capitalists and communists can have a slice of the hot high-economy action, but the fairly capitalist and free ones get a higher chance. But don't get too free or laxed, or your economy will get damaged... ever so slightly! It's not too drastic of a change, and you can still prosper with 100.00+ Economy at 100.00 Economic Freedom.

[Marxist Germany]

Great choice!

[Valentine Z]

Great choice!

Thanks! These 3 are suggestions by Angshire, so I got a few in my mind, and you can certainly suggest the trends and relations you want to see. ^^

[Aclion]

That's one hell of a project. Do you really plan to look at all the stat relationships?

Looks pretty interesting, doesn't it? You have the usual trend going on - As the Economic Freedom increases, so does the Economy. The interesting thing is that there is a "Forbidden Zone" from -10 to 0 on the Economic Freedom. Maybe the data that I got, the 19000+ nations, doesn't have EF in that range. Maybe it's something else... I am not very sure myself!

Maybe it's just very hard to take enough pro economic freedom options without accidentally privatizing something.

This is definitely an interesting one. I wonder what's causing so many capitalist(possible socialist too though there not really enough data to tell) nations to fall specifically within the 65 to 83ish range.

Great choice!

I agree. I'm interested in how economic freedom relates to other factors in real nations, particularly Environmental Beauty and wealth inequality, so it should be fascinating to getting a deeper look at how the game handles it.

Great choice!

Thanks! These 3 are suggestions by Angshire, so I got a few in my mind, and you can certainly suggest the trends and relations you want to see. ^^

Well I mentioned two already, but Environmental beauty and Trout fishing always seemed to have an interesting dynamic, so i'd be interested to see what trends appear.

[Valentine Z]

That's one hell of a project. Do you really plan to look at all the stat relationships?

Yeah, eventually! ^^ There will be quite a lot of combinations. For some of them like Wealth Gaps and Income Equality, I find that they are very directly correlated, so for those, I will give a passing remark instead of more in-depth analysis.

It will be long-term, that's for sure! More stats to cover, and with the new Betas coming up, I will be doing trawls to keep up with it!

[Aclion]

That's one hell of a project. Do you really plan to look at all the stat relationships?

Yeah, eventually! ^^ There will be quite a lot of combinations. For some of them like Wealth Gaps and Income Equality, I find that they are very directly correlated, so for those, I will give a passing remark instead of more in-depth analysis.

It will be long-term, that's for sure! More stats to cover, and with the new Betas coming up, I will be doing trawls to keep up with it!

Yeah i can understand that. I believe that's on record as being an inverse.

[Valentine Z]

Yeah, eventually! ^^ There will be quite a lot of combinations. For some of them like Wealth Gaps and Income Equality, I find that they are very directly correlated, so for those, I will give a passing remark instead of more in-depth analysis.

It will be long-term, that's for sure! More stats to cover, and with the new Betas coming up, I will be doing trawls to keep up with it!

Yeah i can understand that. I believe that's on record as being an inverse.

Oh yeah, direct anti-correlation, or inverse relationship as you say, not a direct correlation. Whoops! ><

[Angshire]

I loved this economy vs economic freedom one! It also thought up of a couple of other one, maybe you could add to your schedule, if you have the time:

1.) Average Income vs. Wealth Gaps
2.) Culture vs. Weather
3.) Civil Rights vs. Crime

[Valentine Z]

I loved this economy vs economic freedom one! It also thought up of a couple of other one, maybe you could add to your schedule, if you have the time:

1.) Average Income vs. Wealth Gaps
2.) Culture vs. Weather
3.) Civil Rights vs. Crime

And as you requested, it shall be done! Stay tuned! :3 I will try to put up 1-2 tomorrow!

I will do up Aclion's Env. Beauty vs Wealth Gap first.

-----

Note to self: Use smaller data point indicators. Bigger ones make it too crowded.

[Aclion]

I loved this economy vs economic freedom one! It also thought up of a couple of other one, maybe you could add to your schedule, if you have the time:

1.) Average Income vs. Wealth Gaps
2.) Culture vs. Weather
3.) Civil Rights vs. Crime

And as you requested, it shall be done! Stay tuned! :3 I will try to put up 1-2 tomorrow!

I will do up Aclion's Env. Beauty vs Wealth Gap first.

I actually meant Economic freedom vs Env. Beauty and Economic freedom vs Wealth Gaps >.< sorry.
...though now i'm curious...

Note to self: Use smaller data point indicators. Bigger ones make it too crowded.

These look like google sheets charts. If so there's an option for cross shaped indicators which work well for that

[Valentine Z]

Ahh sure, no problem! ^^

Oh yeah, I could change it into crosses. I’m using Excel but same thing, there’s an option for it. Thanks for the suggestion!

[Valentine Z]

As requested, Environmental Beauty (EB) vs Economic Freedom (EF)! Interesting trends all around, let's get to it!

Linear-Linear, Zoomed Out.

Log-Linear, Zoomed Out.

Log-Linear, Zoomed In.

Linear-Linear, Zoomed In.

So... what can we see here? The data collected would indicate that there are just a lot more capitalist (EF > 0) nations than the socialist ones, at least going by the Rand Index. Apart from the outlier being Tzo (the one with 22580.84 on EB), there are a fair share of capitalist and socialist nations with good or bad environments. With that said, the more socialist countries (negative EF) tends to work better with the EB, attributing to perhaps not letting the businesses trash the place too hard. It's all about being moderate for these two trends. Don't be too free, or too communist either. If you are too free, chances are good that you are letting businesses do whatever they want with little to no care for the environments. The socialist ones fare better, but they will drop their EB if their EF gets a little too low. Not as much as 100 EF nations, so the -100 EF nations can do well.

Here's a better Log-Linear graphs of the Socialist and Capitalist nations, separately.

Socialist (-100 <= EF <= 0). One from left-to-right, another from right-to-left.

Capitalist (0 <= EF <= 100)

[Angshire]

I came up with one additional request that I want to see, and that is the public services.

1.) Public Education vs Public Healthcare
2.) Public Education vs Public Transport
3.) Public Healthcare vs Public Transport

[Candlewhisper Archive]

My theory is that generally bigger governments will spend more all over, but some spending types are likely to be found more together, like military / police, and foreign aid / welfare, as your hardline right wingers tend to like spending on men in uniforms while your bleeding heart liberals love the government to place money in upturned palms.

I'd suggest that it might be interesting to look at percentages spent on each department, and to see if there's any departments that tend to correlate in spending. Percentages will mean more than absolute amounts, as bigger nations will tend to spend more on all departments anyway, probably.

Anyway you can do something like that?

[Nouveau Yathrib]

Ahh, now this is a very unique and interesting trend! We will take a look at the graphs first! Given the data not being too sparse out, I am only going with Linear-Linear.

(Image)
(Image)

Looks pretty interesting, doesn't it? You have the usual trend going on - As the Economic Freedom increases, so does the Economy. The interesting thing is that there is a "Forbidden Zone" from -10 to 0 on the Economic Freedom. Maybe the data that I got, the 19000+ nations, doesn't have EF in that range. Maybe it's something else... I am not very sure myself!

You have the usual trend... and you also have the trend that both Socialist (low EF) and Capitalist (high EF) nations can have a very good Economy, as you can see from the close-up. However, there are more Capitalist nations than Socialist nations when it comes to the number of High-Economy nations. That is, the High-Economy nations can exist for both sides, but there are more on the Capitalist side.

What's interesting is the trend that goes at very high EF, starting at 80. You see a buckle there, along with the slowly decreasing Economy. It would seem that an Anarchy, or those with very, very high freedom of doing business, doesn't fare so well. Even Northern Borland, the granddaddies of Capitalist Economies and having such a huge Economic Output, doesn't have an 100.00 on the Rand Index (Economic Freedom); they have 82.56 and 53.44, as of the time of this writing.

And this is not because they are older nations, either. Here's the same trend, but filtered out so that it only shows the Top 1% Population (< 1600th World Rank for Population), with 150 Data Points.

(Image)

In short? Both capitalists and communists can have a slice of the hot high-economy action, but the fairly capitalist and free ones get a higher chance. But don't get too free or laxed, or your economy will get damaged... ever so slightly! It's not too drastic of a change, and you can still prosper with 100.00+ Economy at 100.00 Economic Freedom.

<0 numbers for Economic Freedom just mean your economy is centrally planned (either by the government or by AI). The game still allows for "low" or "high" levels of economic freedom within the central planning paradigm, so you can have a "Capitalist Paradise" with a centrally planned economy if your Economic Freedom is between -33.0 and 0.0.

-100.0 to -67.0 EF = true communism
-67.0 to -33.0 EF = generic socialism
-33.0 to 0.0 EF = pro-corporate socialism/state capitalism?
0.0 to 33.0 EF = social democracy
33.0 to 67.0 EF = generic capitalism
67.0 to 100.0 EF = true free-market capitalism