Stats Chat

Usually when there are complaints about cancer screening in New Zealand it’s people complaining there isn’t enough.  The Herald has an interesting example of the opposite, under the headline, “Cervical test switch ‘wrong’“.  The ‘switch’ is from looking for actual abnormal cells on screening to just looking for high-risk strains of the virus HPV, which are responsible for nearly all cervical cancer.

Everyone agrees that viral testing is important, and that, all things being equal it is more sensitive.  The specialists who are complaining say that the initial screen should look for abnormal cells as well, and only proceed further if they are found. The problem with screening based just on the virus is that it will lead to a bigger increase in repeat screening, biopsy, and treatment, with added inconvenience, risk and expense.

Also, as they say in the NZ Medical Journal

The detection of a sexually transmitted infection rather than a significant cytological abnormality is a major change in the aim of screening. This may reduce screening participation. Any reduction in screening coverage will reduce protection from cervical cancer.

I’m not an expert on cervical screening, so I don’t know the answers, but the issues being raised are the right sort of questions to ask about a change in a successful population screening program.

Some headlines:

Herald: “Dead people on Facebook could outnumber the living”

Stuff: “There will be more dead people than living on Facebook”

But not any time soon:

Daily Mail: “Facebook will become the world’s biggest virtual graveyard with more profiles of dead people than living users by the end of the century, say experts”

So who are these experts? They are a statistician, Hachem Saddiki. The original idea came from Fusion, where Kristen V. Brown raised the question of when declining growth and lack of automatic deletion after death would lead to a majority of dead accounts, and looked for someone to work it out.

The Fusion story talks about some of the uncertainties — how fast will Facebook grow, what will happen to death rates across the world.  It doesn’t consider death rates of companies and technologies, though.

A 2012 report said

According to the report, the 61-year tenure for the average firm in 1958 narrowed to 25 years in 1980—to 18 years in 2011. At the current churn rate, 75% of the S&P 500 will be replaced by 2027.

You might expect Facebook to last longer than average, but there must be some chance it doesn’t make it to four times the average.

Much more importantly, will Facebook survive the technology transitions in anything like its current form — the equivalent of moving from player piano to Spotify in the music world?

Mark Twain noted in Life on the Mississippi

“In the space of one hundred and seventy six years the Lower Mississippi has shortened itself two hundred and forty-two miles. That is an average of a trifle over a mile and a third per year.”

His conclusion might well apply to the Facebook prediction: “One gets such wholesale returns of conjecture out of such a trifling investment of fact.”

• What Every Journalist Should Know About Science,  from the Neiman Foundation at Harvard — and they mean ‘know about how science works’ not ‘know about squid or neutrinos’ (via Harkanwal Singh)

• “Uber officials suggested that if an email address or rider/driver last name contains the word “rape” like “Jason Rape” or “Don Draper” it will be included when queried. … misspellings of the word “rate” and expressions like “you raped my wallet” accounted for false positives in the search results seen in the obtained screenshots.” So maybe we have a return of the ‘Scunthorpe’ problem, but maybe that’s as bogus an explanation as it sounds. From Buzzfeed.

• In Stuff’s list of the 17 most dangerous foods, the entry on the Jamaican vegetable ‘ackee’ says “In 2011 there were 35 poisoning cases” and also “1 in 1000 people develop ackee fruit poisoning each year in the Caribbean”.  This fails simple arithmetic: there are more than 35000 people in the Caribbean. A 1991 analysis by the CDC found a rate of 1 in 100,000 restricted to Jamaica, which seems much more plausible.  The list is also wrong about absinthe, and is unusual in considering rhubarb leaves to be a food.

• A visualisation of the ages people get married (in the US), from Flowing Data

• “If Bernie Sanders were to defeat Hillary Clinton in Michigan’s Democratic primary, it would be “among the greatest polling errors in primary history,”” He did. It was. Fivethirtyeight.com tries to explain how.

Auckland commuters know the frustration well: You’re waiting for a bus, and the electronic board shows it’s three minutes away. Ten minutes later, you’re still standing there, wondering what’s going on. Or the board may say a bus is 10 minutes away – but it suddenly turns up when you’re not paying attention.

Department of Statistics doctoral student Tom Elliott, pictured, also knows that irritation well – he was once a regular bus user – and his PhD research aims to come up with a model that leads to better predictions. Read the full story here.

The Herald (and/or the Otago Daily Times) say

 New Zealand is the fifth most literate country in the world.

and

New Zealand ranked higher than Germany (9), Canada (10), the US (11), UK (14) and Australia (15).

Newshub had a similar story and the NZEI welcomed the finding.  One of the nice things about the Herald story is it provides a link. If you follow that link, the ratings look a bit different.

There are five other rankings in addition to the “Final Rank”, but none of them has NZ at number five.

So, where did the numbers come from? It can’t be a mistake at the Herald, because Newshub had the same numbers (as did Finland Today, and basically everyone except the Washington Post)

Although nobody links, I did track down the press release. It has the ranks given by the Herald, and it has the quotes they used from the creator of the ranking.  The stories would have been written before the site went live, so the reporters wouldn’t have been able to check the site even if it had occurred to them to do so.  I have no idea how the press release managed to disagree with the site itself, and while it would be nice to see corrections published, I won’t hold my breath.

Underlying this relatively minor example is a problem with the intersection of ‘instant news’ and science that I’ve mentioned before.  Science stories are often written before the research is published, and often released before it is published. This is unnecessary except for the biggest events: the science would be just as true (or not) and just as interesting (or not) a day later.

At least the final rank still shows NZ beating Australia.

Team Ratings for Round 3

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 17 matches played, 10 of which were correctly predicted, a success rate of 58.8%.
Here are the predictions for last week’s games.

Predictions for Round 3

Here are the predictions for Round 3. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Team Ratings for Round 2

The basic method is described on my Department home page.

Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Performance So Far

So far there have been 8 matches played, 6 of which were correctly predicted, a success rate of 75%.
Here are the predictions for last week’s games.

Predictions for Round 2

Here are the predictions for Round 2. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

My first Listener column, a couple of years ago was on the US gender pay gap and what it does and doesn’t mean. It’s now open-access.

Stuff has a story under the lead

Now that it’s autumn, flu season isn’t far off and there’s plenty you could be doing in the kitchen to give your body that extra oomph for the cold months ahead.

Sadly they don’t mean making a phone call to book a flu vaccine shot: they have a list of herbs and spices with unsupported health claims.

Take the first, cinnamon.  Stuff says “It is high in antioxidants, is an anti-inflammatory and has an effect in lowering blood sugar.”  The  National Center for Complementary and Integrative Health , who are about as sympathetic as you can get to this sort of thing “High-quality clinical evidence (i.e., studies in people) to support the use of cinnamon for any medical condition is generally lacking. An analysis of five clinical trials concluded that cinnamon does not appear to affect factors related to diabetes and heart disease.”

Or, for a total failure to do arithmetic, saffron. Stuff says “It is a good source of vitamins, magnesium and iron.” Now, it’s true that saffron is high in nutrients for its weight. A mere 100g of saffron will supply about two-thirds of your daily iron and magnesium, and substantial amounts of vitamins C and B-6. By weight, it does better than spinach. But the typical serving of saffron is a small fraction of a gram, with nutrient contents that would round to zero in any sensible display.

Following the lines of previous StatsChat food advice, I think the photo caption  just needs a bit of editing: “Herbs and spices are an easy way to add healthy elements  flavour to your diet.

(via Mark Hanna and Bart Janssen)

• From Pro Publica, an extended investigation (with detailed simulations) of what will happen to Houston when a big cyclone hits it.  And a “making of” post.

• From 538: A plagiarism scandal in the crossword world: the sort of thing that only computerised searches can really do.

• From Public Address: An example of unfunded drugs other than Keytruda (pembrolizumab) that might be higher up a priority list

• Sensible presentation of stats in a Herald story on seatbelts and crashes

• “Data is a toxic asset” from computer security expert Bruce Schneier

• From Fusion: “How this company tracked 16,000 Iowa caucus-goers via their phones”

• And finally, two notes on the flag referendum. First, if the current flag doesn’t win, New Zealand will go down in history as the new example of opinion-poll failure, since current polls give it an almost 2-1 lead. Second, in case it turns out to be necessary, a mnemonic for the official number of leaflets on the fern: it’s the number of players on a team for the Silver Ferns (netball, 7), plus the White Ferns (cricket, 11), plus the Black Ferns (rugby union, 15) — a celebration of NZ women’s sports.