Posts from September 2014 (43)

Team Ratings for the Preliminary Finals

The basic method is described on my Department home page. I have made some changes to the methodology this year, including shrinking the ratings between seasons.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 198 matches played, 116 of which were correctly predicted, a success rate of 58.6%.

Here are the predictions for last week’s games.

Predictions for the Preliminary Finals

Here are the predictions for the Preliminary Finals. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Team Ratings for Round 8

The basic method is described on my Department home page. I have made some changes to the methodology this year, including shrinking the ratings between seasons.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 28 matches played, 21 of which were correctly predicted, a success rate of 75%.

Here are the predictions for last week’s games.

Predictions for Round 8

Here are the predictions for Round 8. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Reviewing the ratings I noticed I have been giving Wellington a ridiculously high rating given their disastrous performance this year. I discovered a problem with my code which meant I have not been updating ratings properly. I have some different code for the ITM Cup because of the strange nature of the fixtures where teams can play more than one game a week.

Team Ratings for Round 7

Here are the team ratings prior to Round 7, along with the ratings at the start of the season. I have created a brief description of the method I use for predicting rugby games. Go to my Department home page to see this.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 46 matches played, 30 of which were correctly predicted, a success rate of 65.2%.

Here are the predictions for last week’s games.

Predictions for Round 7

Here are the predictions for Round 7. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

New Zealand’s favourite biscuit.

I just clicked on a link on the homepage of the NZ Herald which says “NZ@Noon: NZ’s favourite biscuit revealed” which took me to an article with a snippet saying:

Bay of Plenty voters have taken to the polls. Find out which biscuit triumphed in the annual nationwide biscuit election.

This lead to another article with the headline: “Mallowpuffs voted Bay’s best biscuit” which includes the following (emphasis mine):

Bay of Plenty voters have taken to the polls and voted Mallowpuffs Original their favourite biscuit in an annual nationwide biscuit election.

Around the country, close to 5,000 votes were cast by biscuit-lovers who also voted Mallowpuffs Original as the national favourite, ahead of 57 other contenders.

Kiwi women were once again more passionate about pledging their support, contributing 94 percent of the votes nationwide.

The 2014 Bikkielections poll was conducted via an application on Griffin’s Facebook page from September 9 to 21 following weeks of campaigning via billboards, radio promotions, polling booths and street sampling. The poll has a margin of error of plus or minus zero percent.

That’s a first, right?

Says the Herald (reprinting the Daily Mail)

If you have always found doing sums a struggle, you might just be able to blame your mother.

Because research has linked a woman’s hormone levels in pregnancy with her child’s maths skills at age five.

Boys and girls whose mothers were very low in the hormone thyroxine were almost twice as likely to do badly in arithmetic tests, it found.

The hormone in question is thyroxine, produced by the thyroid, and the basic issue is that iodine deficiency is getting more common again. In Australia and New Zealand, iodine has been added to bread since September 2009 to address this problem. In Australia, the fortification of bread has been fairly successful; there doesn’t seem to be data for New Zealand, but there’s no reason to expect it to be different. So the story  may not be applicable to New Zealanders.

Also, as with the cannabis paper a couple of weeks ago, the “twice as likely” is simply wrong.  Doing badly in arithmetic was defined as being in the bottom 50%, and it’s not plausible that low-thyroxine kids are twice as likely to be in the bottom half.  In fact, it’s the odds ratio for being in the lower 50% of students in maths that was 1.79.  Since the overall odds of being in the bottom half is 1:1, if you multiply by 1.79 you get 1.79:1, which is a probability of 64% of being in the bottom half.

A difference between 50% and 64% is not “almost twice as likely”, and “blame” is a completely inappropriate term — this is new research, so even if it’s true (it could be) and relevant to New Zealand (it probably isn’t) it would not be something for which ‘blame’ would be appropriate. There’s entirely too much blaming mothers already.

Turnout of enrolled voters was up 3 percentage points over 2011, but enrollment was down, so as a fraction of the eligible population, turnout was only up half a percentage point.

From the Herald’s interactive, the remarkably boring trends through the count

The election in 48s. See how little movement there was over the night: http://t.co/qDBsD1lxZK

— Rowan Crawford (@wombleton) September 21, 2014

There are a few electorates that are, arguably, still uncertain, but by 9pm the main real uncertainty at the nationwide level was whether Hone Harawira would win Te Tai Tokerau, and that wasn’t going to affect who was in government.  By 10pm it was pretty clear Harawira was out (though he hadn’t conceded) and that Internet Mana had been, in his opponent’s memorable phrase, “all steam and no hangi.”

Jonathan Marshall (@jmarshallnz) has posted swings in each electorate, for the party vote and electorate vote. He also has an interactive Sainte-Laguë seat allocation calculator and has published the data (complete apart from special votes) in a convenient form for y’all to play with.

David Heffernan (@kiwipollguy) collected a bunch of poll, poll average, and pundit predictions, and writes about them here. The basic summary is that they weren’t very good, though there weren’t any totally loony ones, as there were for the last US Presidential election. Our pundits seem to be moderately well calibrated to reality, but there’s a lot of uncertainty in the system and the improvement from averaging seems pretty small.  The only systematic bias is that the Greens did a bit worse than expected.

Based on his criterion, which is squared prediction error scaled basically by party vote, two single polls — 3 News/Reid at the high end and Herald Digipoll at the low end — spanned almost the entire range of prediction error.

The variation between predictions isn’t actually much bigger than you’d expect by chance. The prediction errors have the mean you’d expect from a random sample of about 400 people, and apart from two outliers they have the right spread as well. On the graph, the red curve is a chi-squared distribution with 9 degrees of freedom, and the black curve is the distribution of the 23 estimates. The outliers are Wikipedia and the last 3 News/Reid Research poll.

About half the predictions were qualitatively wrong: they had National needing New Zealand First or the Conservatives for a majority. The Conservatives were clearly treated unfairly by the MMP threshold. If someone is going to be, I’m glad it’s them, but a party with more votes than the Māori Party, Internet Mana, ACT, United Future, and Legalise Cannabis put together should have a chance to prove their unsuitability in Parliament.

Each week, we would like to invite readers of Stats Chat to submit nominations for our Stat of the Week competition and be in with the chance to win an iTunes voucher.

Here’s how it works:

• Anyone may add a comment on this post to nominate their Stat of the Week candidate before midday Friday September 26 2014.
• Statistics can be bad, exemplary or fascinating.
• The statistic must be in the NZ media during the period of September 20 – 26 2014 inclusive.
• Quote the statistic, when and where it was published and tell us why it should be our Stat of the Week.

Next Monday at midday we’ll announce the winner of this week’s Stat of the Week competition, and start a new one.

(more…)

If you’d like to comment on or debate any of this week’s Stat of the Week nominations, please do so below!

Data collection edition

• Too Much Information:  Clemson University, in South Carolina, was “requiring students and faculty to complete an online course through a third party website that asks invasive questions about sexual history.

• Too Little Information: New Zealand insurers are not willing to cooperate with price-comparison websites of the sort that exist elsewhere in the world.  These have led to lower prices where they have been introduced, but the insurers say their real concern is that people won’t get the most appropriate cover. (Herald today, Stuff back in March)

• Just Right (maybe):  Apple says that with the new iOS8 operating system it is unable to unlock phones and decrypt data, and so will be able to refuse government demands to do so. Of course, the government can still grab lots of metadata, and as John Gilmore points out, there’s nothing but Apple’s bare word to go on.

via Don Bradshaw