Stat of the Week Competition Discussion: May 9 – 15 2015
If you’d like to comment on or debate any of this week’s Stat of the Week nominations, please do so below!
If you’d like to comment on or debate any of this week’s Stat of the Week nominations, please do so below!
There has been an alarming upward trend in the costs of similar treatments, as more drugs are developed and come on to the market, new Pharmac figures show.
I would argue that this is almost precisely not the problem. The story covers two important issues, but doesn’t distinguish them well.
The first issue is that many expensive new drugs aren’t very good. To get a drug approved for marketing you don’t need to show it’s better than the current stuff, and it often isn’t. Similar treatments might still be useful to have, if they give other options for people with side effects or have more convenient dosing, but they are often more expensive.
The United States is very bad at not using treatments that are similar (or worse) but more expensive, so these drugs are a problem there. Here, we’re quite good at not using them, so they don’t matter all that much. As long as Pharmac enjoys popular support and the media doesn’t buy into too many drug-industry publicity campaigns, we can ignore the expensive new drugs that aren’t worth the cost.
A second issue is that a subset of the expensive new drugs aren’t similar. The story quotes the price differences for ‘anthracycline’ (doxorubicin or epirubicin) and two newer breast cancer drugs, docetaxel and trastuzumab, as evidence of increases over the years.
Anthracyclines haven’t gone away. In fact, they’re quite a bit less expensive now than they were in 2002. The reason Pharmac now buys docetaxel and trastuzumab is that they’re worth the extra cost for at least some women. The existence of trastuzumab is not a problem for the healthcare system, it’s an opportunity.
There is a problem coming, though: many of the new drugs have names ending in ‘mab’.
Monoclonal antibodies, ‘mab’s, are one of the classes of ‘biologics’: big, complex molecules made by living cells. Making and testing generic versions of biologics (called ‘biosimilars‘) is much harder than running up off-brand doxorubicin. Even when the patents run out on the ‘mab’s and ‘ept’s, a competitive market might be a while in developing and prices will stay higher. It’s not so much the expensive on-patent drugs that are a worrying change, it’s the prospect of expensive off-patent drugs in the future.
The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.
Current Rating | Rating at Season Start | Difference | |
---|---|---|---|
Crusaders | 7.73 | 10.42 | -2.70 |
Waratahs | 6.87 | 10.00 | -3.10 |
Hurricanes | 5.98 | 2.89 | 3.10 |
Chiefs | 4.32 | 2.23 | 2.10 |
Brumbies | 3.36 | 2.20 | 1.20 |
Bulls | 3.04 | 2.88 | 0.20 |
Stormers | 2.60 | 1.68 | 0.90 |
Highlanders | 2.09 | -2.54 | 4.60 |
Blues | 0.43 | 1.44 | -1.00 |
Sharks | -2.00 | 3.91 | -5.90 |
Lions | -2.83 | -3.39 | 0.60 |
Rebels | -4.66 | -9.53 | 4.90 |
Cheetahs | -5.64 | -5.55 | -0.10 |
Force | -5.74 | -4.67 | -1.10 |
Reds | -8.56 | -4.98 | -3.60 |
So far there have been 80 matches played, 52 of which were correctly predicted, a success rate of 65%.
Here are the predictions for last week’s games.
Game | Date | Score | Prediction | Correct | |
---|---|---|---|---|---|
1 | Highlanders vs. Sharks | May 01 | 48 – 15 | 5.60 | TRUE |
2 | Brumbies vs. Waratahs | May 01 | 10 – 13 | 1.10 | FALSE |
3 | Blues vs. Force | May 02 | 41 – 24 | 9.70 | TRUE |
4 | Hurricanes vs. Crusaders | May 02 | 29 – 23 | 1.60 | TRUE |
5 | Rebels vs. Chiefs | May 02 | 16 – 15 | -5.30 | FALSE |
6 | Cheetahs vs. Stormers | May 02 | 25 – 17 | -5.90 | FALSE |
7 | Bulls vs. Lions | May 02 | 35 – 33 | 11.00 | TRUE |
Here are the predictions for Round 13. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.
Game | Date | Winner | Prediction | |
---|---|---|---|---|
1 | Crusaders vs. Reds | May 08 | Crusaders | 20.80 |
2 | Rebels vs. Blues | May 08 | Blues | -0.60 |
3 | Hurricanes vs. Sharks | May 09 | Hurricanes | 12.50 |
4 | Force vs. Waratahs | May 09 | Waratahs | -8.60 |
5 | Lions vs. Highlanders | May 09 | Highlanders | -0.40 |
6 | Stormers vs. Brumbies | May 09 | Stormers | 3.70 |
This graphic and the accompanying story in the Herald produced a certain amount of skeptical discussion on Twitter today.
It looks a bit as though there is an effect of birth month, and the Herald backs this up with citations to Malcolm Gladwell on ice hockey.
The first question is whether there is any real evidence of a pattern. There is, though it’s not overwhelming. If you did this for random sets of 173 people, about 1 in 80 times there would be 60 or more in the same quarter (and yes, I did use actual birth frequencies rather than just treating all quarters as equal). The story also looks at the Black Caps, where evidence is a lot weaker because the numbers are smaller.
On the other hand, we are comparing to a pre-existing hypothesis here. If you asked whether the data were a better fit to equal distribution over quarters or to Gladwell’s ice-hockey statistic of a majority in the first quarter, they are a much better fit to equal distribution over quarters.
The next step is to go slightly further than Gladwell, who is not (to put it mildly) a primary source. The fact that he says there is a study showing X is good evidence that there is a study showing X, but it isn’t terribly good evidence that X is true. His books are written to communicate an idea, not to provide balanced reporting or scientific reference. The hockey analysis he quotes was the first study of the topic, not the last word.
It turns out that even for ice-hockey things are more complicated
Using publically available data of hockey players from 2000–2009, we find that the relative age effect, as described by Nolan and Howell (2010) and Gladwell (2008), is moderate for the average Canadian National Hockey League player and reverses when examining the most elite professional players (i.e. All-Star and Olympic Team rosters).
So, if you expect the ice-hockey phenomenon to show up in New Zealand, the ‘most elite professional players’, the All Blacks might be the wrong place to look.
On the other hand Rugby League in the UK does show very strong relative age effects even into the national teams — more like the 50% in first quarter that Gladwell quotes for ice hockey. Further evidence that things are more complicated comes from soccer. A paper (PDF) looking at junior and professional soccer found imbalances in date of birth, again getting weaker at higher levels. They also had an interesting natural experiment when the eligibility date changed in Australia, from January 1 to August 1.
As the graph shows, the change in eligibility date was followed by a change in birth-date distribution, but not how you might expect. An August 1 cutoff saw a stronger first-quarter peak than the January 1 cutoff.
Overall, it really does seem to be true that relative age effects have an impact on junior sports participation, and possibly even high-level professional acheivement. You still might not expect the ‘majority born in the first quarter’ effect to translate from the NHL as a whole to the All Blacks, and the data suggest it doesn’t.
Rather more important, however, are relative age effects in education. After all, there’s a roughly 99.9% chance that your child isn’t going to be an All Black, but education is pretty much inevitable. There’s similar evidence that the school-age cutoff has an effect on educational attainment, which is weaker than the sports effects, but impacts a lot more people. In Britain, where the school cutoff is September 1:
Analysis shows that approximately 6% fewer August-born children reached the expected level of attainment in the 3 core subjects at GCSE (English, mathematics and science) relative to September-born children (August born girls 55%; boys 44%; September born girls 61% boys 50%)
In New Zealand, with a March 1 cutoff, you’d expect worse average school performance for kids born on the dates the Herald story is recommending.
As with future All Blacks, the real issue here isn’t when to conceive. The real issue is that the system isn’t working as well for some people. The All Blacks (or more likely the Blues) might play better if they weren’t missing key players born in the wrong month. The education system, at least in the UK, would work better if it taught all children as well as it teaches those born in autumn. One of these matters.
The StatsNZ press release on marriages, civil unions, and divorces to December 2014 points out the dramatic fall in same-sex civil unions with 2014 being the first full year of marriage equality. Interestingly, if you look at the detailed data, opposite-sex civil unions have also fallen by about 50%, from a low but previously stable level.
An important emerging area of statistics is algorithmic transparency: what information is your black-box analytics system really relying on, and should it?
From Matt Levine
The materiality standard that controls so much of securities law comes from an earlier, simpler time; a time when reasonable people could look at a piece of information and say “oh, yes, of course that will move the stock up” (or down), and if they couldn’t then they wouldn’t bother with it. Modern financial markets are not so intuitive: Algorithms are interested in information that reasonable humans cannot process, with the result that reasonable humans can’t always predict how significant any piece of information is. That’s a world that is more complicated for investors, but it also seems to me to be more complicated for insider trading regulation. And I’m not sure that regulation has really kept up.
There’s a depressing chart at Fusion, originally from the Economist, that shows international comparisons for infant mortality, homicide, life expectancy, and imprisonment, with White America and Black America broken out as if they were separate countries.
Originally, I was just going to link to the chart, but I thought I should look at how Māori/Pākehā disparities compare. European-ancestry New Zealanders and Māori make up roughly the same proportions of the NZ population as self-identified White and Black do in the US. The comparison is depressing, but also interesting: showing how ratios and differences give you different results.
First, infant mortality. Felix Salmon writes
A look at infant mortality, a key indicator of development, is just as grim. Iceland has 1.6 deaths per 1,000 births; South Korea has 3.2. “White America” is pretty bad — by developed-country standards — with 5.1 deaths per 1,000 births. But “Black America,” again, is much, much worse: at 11.2 deaths per 1,000 births, it’s worse than Romania or China.
According to the Ministry of Health, Māori infant mortality was 7.7/1000 in 2011 compared to 3.7/1000 for non-Māori, non-Pacific. According to StatsNZ, the rate for Māori was lower in 2012 (the numbers don’t quite match: different definitions or provisional data). So, the Māori/Pakeha ratio is similar to the Black/White ratio in the US, but the difference is quite a bit smaller here.
Incarceration rates show a similar pattern. In the US, the rate is 2207/100k for Blacks and 380/100k for Whites. In New Zealand, the rates are (about) 700/100k for Māori and 100/100k for European-ancestry. The NZ figures include people on remand; I don’t know if the US figures do. The ratio is a bit lower in New Zealand, but the difference is dramatically lower.
Homicide rates are harder to compare, because New Zealand only started collecting ethnicity of victims last year, and because NZ.Stat will only show you one month of data at a time. However, it looks as though the ratio is a lot less than the nearly 9 in the US. More importantly, the overall rate is much lower here: our rate is 0.9 per 100k, the overall US rate is 4.5 per 100k.
If the Māori/Pākehā disparities are slightly less serious than US Black/White disparities as ratios but much less serious as differences, which comparison is the right one? To some extent this depends on the question: risk ratios may be more relevant as indicators of structural problems, but risk differences are what actually matter to individuals.
Each week, we would like to invite readers of Stats Chat to submit nominations for our Stat of the Week competition and be in with the chance to win an iTunes voucher.
Here’s how it works:
Next Monday at midday we’ll announce the winner of this week’s Stat of the Week competition, and start a new one.