Posts written by Thomas Lumley (2565)

avatar

Thomas Lumley (@tslumley) is Professor of Biostatistics at the University of Auckland. His research interests include semiparametric models, survey sampling, statistical computing, foundations of statistics, and whatever methodological problems his medical collaborators come up with. He also blogs at Biased and Inefficient

March 12, 2025

More Panadol scare headlines

The New York Post is saying

Attention-deficit/hyperactivity disorder is a common behavioral condition that affects approximately 7 million US children, including about a million kids diagnosed since 2016.

The reason for the recent rise in diagnoses is under debate — a new study in the journal Nature Mental Health suggests the culprit could be in your medicine cabinet.

They’re talking about paracetamol (or as Americans call it, acetaminophen).  There’s a new study that looks at a fairly small group of US mothers and kids and finds weak evidence of a correlation between ADHD diagnosis in the kid and use of paracetamol by the mother.   You might remember this topic from previous StatsChat episodes.  There was  originally a Danish study that was surprised to stumble across a correlation. A New Zealand study checking up on the correlation also found it.

A Spanish study resulted in the NZ Herald (from the Daily Mail) scare headline One paracetamol in pregnancy could raise risk of autism. This was especially egregious since not only did the study say nothing about ‘one paracetamol’ and wasn’t really about autism, it actually found lower rates of the symptoms in kids whose mothers took paracetamol. The study argued that while the rates were lower in those kids, they should have been even lower based on other risk factors.   At this point it was all plausible and maybe a bit concerning but not reason for major change in medical practice — after all, mothers aren’t taking Panadol for fun.

In 2023, a combination of most of the published studies estimated a slight increase in risk, about 25%.  On the other hand, A very big Swedish study, using data from everyone born in Sweden from 1995 to 2019, then found no suggestion of a correlation.

So what’s the point of this new study? Well, one of the issues in interpreting these correlation studies is that many of them didn’t know for sure who actually took paracetamol.  For normal people this would be a big issue — lots of medications include paracetamol, and you might easily miss some, or just forget. Pregnant women, though, tend not to just casually take cough syrup or whatever.  Even so, if you happened to have data lying around from blood samples which told you who had taken paracetamol, you might be interested in seeing what the correlation was like.   So they did. And the correlation was broadly similar to what the small, early studies had seen: kids whose mothers blood samples showed paracetamol were about twice as likely to have ADHD.  That’s nice to know, even if it’s not a big change in the evidence.

We still have the conflict between ‘no sign of a correlation’ in the big Swedish study and ‘about 25% higher’ in the combined smaller studies.  It’s possible that paracetamol has an effect and that the Swedish study missed it because it didn’t measure paracetamol use as accurately. It’s also possible that the reasons for taking paracetamol (eg illness, fever) are what causes ADHD. Or it could all be some sort of bias and the Swedish study could be correct. It’s hard to tell.  Ask your doctor, etc.

The new study, of course, does not suggest paracetamol is responsible for recent trends in ADHD diagnosis: that claim is down to the New York Post, and is pretty clearly wrong. Here’s the trend:

Paracetamol became popular as a relatively safe, over-the-counter treatment a long time ago now. It might have been response for an ADHD trend in, say,  the 1980s, but not a trend in the 21st century.

Briefly

  • The New York Times has an interactive with graphs showing how everything changed when Covid started.  It’s also an explanation of why it’s hard to estimate the effects of specific actions on Covid: everything changed at once
  • Visualising how different languages represent animal noises: the spellings can look very different, but the underlying phonetics are more similar
  • “The answer to the how-many-significant-digits problem is the same as the answer to the what-to-graph problem: The click-through solution“. Or in other words, you can have tables without stupid numbers of digits and let people who want detail click to see it
  • The website of the US Centers for Disease Control as it existed on Jan 6 has been copied to RestoredCDC.org, hosted in Europe.  This won’t help with ongoing data collection, but it does make the past data from the CDC more reliably available.
March 7, 2025

Painkillers and dementia

Q: Did you see that ibuprofen prevents dementia?

A: No

Q: Common 3p anti-inflammatory pill ‘can help prevent dementia’ says new study And Prolonged Use Of Anti-Inflammatory Pills May Help Prevent Dementia: StudyAnd…

A: No

Q: Those quotes in the first headline imply someone really said it

A: Well, that used to be the convention, but apparently not in this case.

Q: Mice?

A: No, not mice. People

Q: Correlations, or randomised trials?

A: Correlations

Q: Is there a paper?

A:  There is a paper.

Q: Has anyone looked at this correlation before?

A: Oh my yes. So many people. There are even randomised trials. The Cochrane Review says “no evidence that it works, and it may be dangerous”

Q: What do the scientists say about that?

A: The trials were too short to show the effect, or they started too late in the disease process.

Q: Is that possible?

A: Sure, it’s possible. Lots of things are possible.

Q: So you don’t believe the paper?

A: It’s a perfectly reasonable paper for consenting scientists in private (I know some of the authors), but it doesn’t justify the recommendation of long-term treatment with these drugs for the prevention of dementia, especially given the potential adverse effects

Q: Well, that’s your opinion. What do the scientists who wrote the paper say?

A: Our results.. do not justify the recommendation of long-term treatment with NSAIDs for the prevention of dementia, given its potential adverse effects. 

Age distributions

A question from a reader, based on  this NZ Herald article
“Bowel cancer does not discriminate on race. Māori and Pacific peoples have a similar risk of developing bowel cancer compared to other population groups at a given age.
“It was true that a higher proportion of bowel cancers occur in Māori and Pacific peoples at a younger age, but that is because the overall demographics of those groups are younger. It has always been age that determines bowel cancer risk, not race”

I thought that this required more explanation. Proportion at an age does not seem to me to depend on the demographics of those ages

It’s a good question.  The minister is plausibly correct that the younger age at diagnosis for Māori and Pacific Peoples is driven substantially by demographics.   That is, one reason that few very elderly Māori get diagnosed with bowel cancer is that there aren’t many very elderly Māori.  Fewer Māori make it to be very elderly, and also the Māori population is increasing both because of higher birth rate and because more people are now identifying as Māori to the healthcare system.   If you have the same age-specific incidence rates in two groups, but one group averages younger, the incidence in the younger group will tend to be at younger ages.

That’s not the whole story, or even most of it, for this decision.  The age distribution being quoted is age at diagnosis (because that’s what you have for cancer), but diagnosis isn’t equally distributed. According to the HQSC atlas of health care variation, Māori are more likely to be diagnosed with bowel cancer following emergency presentation, and more likely to die within two years of diagnosis. This means there’s a good case that Māori are more underdiagnosed than New Zealand Europeans.   On the other hand, a lot of the problem with underdiagnosis is not being tested. If people end up just doing one test when they become eligible, and then not bothering later, the optimal age for a single test is more like 60 than 50.   And, as a general principle,  if you want to spend public money to improve health, you typically will do better by spending it on people who are less healthy and have worse access to health care.

In any case, while the headline Bowel cancer screening eligibility age to be lowered for everyone is technically true (since the lower-age screening pilot has already been stopped), it seems to miss the point a little.

March 2, 2025

Adverse reactions?

NZ$ Herald has a piece today about increases in methamphetamine consumption (as measured by wastewater)

The story is about cheap meth imports increasing the supply, with a speculative aside into a decrease in consumption in Ōpōtiki and whether it might be attributable to major gang arrests.

The sudden spike in 2024 is surprising. Normally I would guess that sudden level changes in a time series were due to different definitions of the variable, but it appears to be defined the same way.

It’s obviously tempting to attribute the sudden change to the relaxation of rules on pseudoephedrine sale in 2024, and some people on social media seemed happy to do so.  There are problems, though.

First, the suddenness is still strange. You’d expect the gangs to take a while to ramp up production and sale after years out of the business — and if they were ready on day one, the spike would have been in June rather than July.

Second, that’s a big spike.  There’s about gram and a half of pseudoephedrine in a pack of decongestant tablets, which will make under a gram of meth, so a 20kg jump in meth production is a lot of Sudafed: tens of  thousands of packets per week of a drug sold only by pharmacist prescription. Someone should have noticed.

The Drug Foundation says it’s due to international supply, which seems plausible — we’re seeing  300-500kg seized most quarters recently, which is 15-40kg/week, so unless we’re catching the majority there will be enough getting through to explain wastewater levels.

The Herald also quotes price data from the Drug Trends Survey, which says prices are down. That’s a bit less supportive than it looks. First, prices were only down in roughly a straight line over several years. Second, the say they think demand has saturated, which doesn’t fit the spike. And finally, the last edition of the survey sampled from February to July 2024, so mostly missed the spike

February 27, 2025

Briefly

  • Petrol price margins are up: RNZ.  These, as we’ve discussed, are based on the difference between the import price and retail price, and include transport and vendor costs (like running petrol stations) as well as profits.  The change from week to week in the margin is still a good indicator that either the efficiency of the system has gone down or the profits have gone up.
  • The Trump administration has cited a statistic that only 6% of federal government workers are full-time in their offices. This is facially implausible when you consider how many federal jobs can’t possibly be done remotely. Pro Publica looked into the number, which came from a self-selected online survey of 6338 people claiming to be federal employees, run by a a small news organisation called Federal News Network in the suburbs of Washington.  Say no to statistics from bogus polls!
  • The UK is running a big (700,000 women) trial of “AI” to assist in reading mammograms. This isn’t ChatGPT, it’s from earlier generations of image-analysis software that actually works.  The hope is that using software plus one radiologist is at least as good as the current standard of two radiologists, allowing more screening to be done without needing more scarce radiologists. The media coverage is nearly all positive and based on the government’s publicity release, eg, this from the BBC. There’s not a lot of information available about how they will measure success or exactly which “AI” platforms they will use. I couldn’t find a trial registration, though I did find one for a much smaller trial 15-20 years ago on the same question.  One negative piece of media coverage from the New Statesman, for balance.
  • A US trial of an oral Covid vaccine, hoping to provide both better protection and easier delivery, has been stopped by the US government just before it was due to start. At the moment this is being described as a ‘pause’ rather than permanent stoppage.
February 23, 2025

Official data bad news

  • USA: Unfortunately, the Economy Runs On the Data Trump Is Trying to Delete (article, podcast discussion)
  • New Zealand: Len Cook: Trust must be recovered after a second Census failure (The Post)
February 19, 2025

Low-flying rocks

As you have probably heard, a modest-sized asteroid will pass really quite close to the earth in seven years. Perhaps very close. Maybe even closer than that. If this happens, it won’t be civilisation-destroying but could be locally devastating. The main StatsChat relevant issue is that the probability of the asteroid hitting the earth keeps going up: 1.4%, 2.2%, 3.1%.  Why is it getting consistently higher? Does that mean we can expect it will keep going up?

Most likely, the probability will keep going up for a while, then suddenly plunge to zero — though it might keep going up and up to 100%.  The sudden plunge to zero and the increase before that point happen for the same reason.    Because of our limited measurements so far, we know only approximately where the asteroid will be in seven years’ time.  You can think of a little moving cloud of possible asteroid positions in space. At the moment, the cloud of possible positions intersects where the Earth will be, but the Earth is a pretty small target (Space is big. Really big.)

As we get more precise information (for example, from the Webb Space Telescope) the cloud of possible positions gets smaller.  If the cloud still intersects the Earth’s position, the smaller cloud of possibilities means the probability of impact goes up.  If it doesn’t still intersect the Earth’s position, the probability of impact drops to zero.

If the randomness in predictions is approximately correct in some consistent way, the predicted average value of the estimate should stay the same over time (the technical term is ‘martingale’). The chance that the estimate has gone to zero will go up over time, so the estimate in scenarios where it doesn’t go to zero must also go up over time.

Update: it’s down to 0.36%
Update: and now down to 0.0022%. Asteroid goneburger.

February 18, 2025

Surprises in data

When you get access to some data, a first step is to see if you understand it: do the variables measure what you expect, are there surprising values, and so on.  Often, you will be surprised by some of the results. Almost always this is because the data mean something a bit different from what you expected. Sometimes there are errors. Occasionally there is outright fraud.

Elon Musk and DOG-E have been looking at US Social Security data. They created a table of Social Security-eligible people not recorded as dead and noticed that (a) some of them were surprisingly old, and (b) the total added up to more than the US population.

That’s a good first step, as I said. The next step is to think about possible explanations (as Dan Davies says: “if you don’t make predictions, you won’t know when to be surprised”). The first two I thought of were people leaving the US after working long enough to be eligible for Social Security (like, for example, me) and missing death records for old people (the vital statistics records weren’t as good in the 19th century as they are now).

After that, the proper procedure is to ask someone or look for some documentation, rather than just to go with your first guess.  It’s quite likely that someone else has already observed the existence of records with unreasonable ages and looked for an explanation.

In this case, one would find (eg, by following economist Justin Wolfers) a 2023 report “Numberholders Age 100 or Older Who Did Not Have Death Information on the Numident” (PDF), a report by the Office of the Inspector General, which said that the very elderly ‘vampires collecting Social Security’ were neither vampires nor collecting Social Security, but were real people whose deaths hadn’t been recorded.   This was presumably a follow-up to a 2015 story where identity fraud was involved — but again, the government wasn’t losing money, because it wasn’t paying money out to dead people.

The excess population at younger years isn’t explained by this report, but again, the next step is to see what is already known by the people who spend their whole careers working with the data, rather than to decide  the explanation is the first thing that comes to mind.

February 17, 2025

Briefly