Posts filed under Surveys (188)

The Herald tells us

Most women are more scared of public speaking than they are of death, it has been revealed.

Researchers who polled 2,000 women found many are far more at ease with meeting their maker than they are of standing in a room talking to an audience hanging on their every word

On the other hand experience in  teaching suggests that a fairly large fraction of women would, given the choice, prefer public speaking to failing a university course.  

Since this is a survey commissioned by a London tourist attraction, and they aren’t providing any information about the survey methods, it’s hard to tell why the results are the way they are. All we can really tell is that it’s the sort of research where asking if the results are true is missing the point.

In 2006, statistics celebrity Hans Rosling asked students at the Karolinska Insitute about international child mortality. In each of the following pairs of countries (presented in alphabetical order within pairs), which one has higher child mortality?

• Sri Lanka or Turkey?
• Poland or South Korea?
• Malaysia or Russia?
• Pakistan or Vietnam?
• South Africa or Thailand

None of these are close — they differ by at least a factor of two — but the students did significantly worse than chance, averaging less than two correct answers out of five.

Gapminder.org has a new ‘Ignorance Project’ aiming to find out what important facts about global health and welfare are widely misunderstood.  They don’t just have a naive ‘information deficiency’ view of this ignorance:

When we encounter ignorance, we want to find a cure. Sometimes the facts just have to be delivered. But in many cases, the facts are little known as they don’t fit with other misunderstandings, they are counterintuitive, such as the most of the outdated concepts about the world population. In these cases we need to invent a new simple way to explain it. Those new explanations are the essence of Gapminder’s new free teaching material that make it fun and easy to teach and to learn a fact-based worldview.

It may not work, but it’s worth a try

(more…)

Via Keith Humphreys, being arrested is a very common experience for young people in America: using the National Longitudinal Survey of Youth, Richard Braeme and colleagues found

By age 18, the in-sample cumulative arrest prevalence rate lies between 15.9% and 26.8%; at age 23, it lies between 25.3% and 41.4%. These bounds make no assumptions at all about missing cases. If we assume that the missing cases are at least as likely to have been arrested as the observed cases, the in-sample age-23 prevalence rate must lie between 30.2% and 41.4%. The greatest growth in the cumulative prevalence of arrest occurs during late adolescence and the period of early or emerging adulthood

Anecdotally, many of the New Zealanders I talk to think that a) all American beer is appallingly bad, and that b) this is all that Americans drink. In fact, the US has been leading the micro- and craft- brewing revolution for some years now, and a new survey shows that American beer drinking tastes are changing. Budweiser, the so-called King of Beers, a product of US brewing giant Anheuser Busch, appears to have been deposed by Colorado based Blue Moon Brewing Company. I am sure someone will tell me that far more Budweiser/Millers/Coors is produced than beer from Blue Moon, but hey maybe American’s are just using it to pre-cook bratwursts before grilling like I used to do.

I was a little concerned that this study might be self-selected, or industry motivated, but the information provided gives some reassurance: “Data on behalf Blowfish for Hangovers by a third party, private research firm based on a study of 5,249 Americans who drink alcohol and are over the age of 21. Margin of error for this study is 1.35% at a 95% confidence interval. Additional data on alcoholic beverage sales collected directly by the Alcoholic Epidemiolic Data System (AEDS) from States or provided by beverage industry sources.”

• Mashblock displays the publicly-available Census 2006 data right down to the individual meshblock level 
• The ‘reputation’ component of university rankings seems to favour institutions in cities that people have heard of
• Useful discussion of the Global Innovation Index in the Herald, featuring Shaun Hendy (who now works in the same building as us). I don’t know if the brain drain explanation is true, but it’s the right sort of way to use the data.
• Big Data graphics: cascades of retweeting related to NY Times articles, and click-throughs to the original article

Good work by journalist Steve Deane in today’s New Zealand Herald:

A study published by the Lion Foundation which extols the benefits of funding community projects with gambling money is course work produced by a group of Massey commerce students.

… I wonder if the students knew that their coursework, which for various reasons explained in the story can’t be used to draw such conclusions, knew their work was going to be hijacked? Either the Lion Foundation doesn’t know much about statistical rigour, or is grasping at straws and hoping no-one will ask questions.

The 2013 Global Innovation Index is out, with writeups in Scientific American and the NZ internets, but not this year in the NZ press. Stuff, instead, tells us “Low worker engagement holds NZ back”, quoting Gallup’s ’employee engagement’ figure of 23% for NZ, without much attempt to compare to other countries.

The two international rankings are very different: of the 16 countries above us in the Global Innovation Index, 13 have significantly lower employee engagement ratings, one (Denmark) is about the same, and one (USA) is higher (one, Hong Kong, is missing because Gallup lumps it in with the rest of the PRC).  It’s also important to consider what is behind these ratings. If you search on  “Gallup employee engagement”, you get results mostly focused on Gallup’s consulting services — getting you to worry about employee engagement is one of the ways they make money.  The Global Innovation Index, on the other hand, came from a business school and was initially sponsored by the Confederation of Indian Industry  and has now expanded with wider sponsorship and academic involvement: it’s not biased in any way that’s obviously relevant to New Zealand.

With any complicated scoring system, different countries will do well on different components of the score.  If you believe, with the authors of Why Nations Fail,  that quality of institutions is the most important factor, you might focus on the “Institutions” component of the innovation index, where New Zealand is in third place. If you’re AMP econonomist Bevan Graham you might think the ‘business sophistication’ component is more important and note that NZ falls to 28th.

If you want NZ innovation to improve, the reverse approach might be more helpful: look at where NZ ranks poorly, and see if these are things we want to change (innovation isn’t everything) and how we might change them.

An improved version of study that Stuff and StatsChat reported on more than a year ago has now appeared in print. The study found that people who have non-standard beliefs about the moon landings or Princess Diana’s death are also likely to have non-standard beliefs about climate change or health effects of tobacco. It improves on the previous research by using a reasonably representative online survey rather than a sample of visitors to climate debate blogs.

Mother Jones magazine in the US summarised some of the results in this graph of correlations

That’s a horrible graph partly because, contrary to what the footnote says, correlations are not in fact restricted to be between 0 and 1, but between -1 and 1: and in fact the three correlations shown were negative in the research and have been turned around for more convenient display.

The title is misleading: only one of the six `conspiracist ideation’ questions was about 9/11, and it wasn’t a yes/no question, and it wasn’t really about it being an inside job (ie, performed by the government), but about the government allowing it to happen. In the same way, the other three variables aren’t simple yes/no questions, but scores based multiple questions, each on a 5-point scale.

A more-technical point is that correlations, while appropriate in the paper as part of their statistical model, aren’t really a good way to describe the strength of association.  It’s easier to understand the square of the correlation, which gives the proportion of variability in one variable explained by the other.  That is, the conspiracy-theory score explains about 25% of the variation in the vaccine score,  just over 1% of the variation in the GM Foods score, and just under 1% of the variation in the climate change score.

(via @zentree)

The NZ Herald 

Privacy concerns are leading to “virtual identity suicide” with large numbers of Facebook users deleting their accounts, according to new scientific research.

A study investigating the phenomenon identified privacy as the biggest reason people are turning against the social network giant.

The new scientific research (not linked, journal not named)

The primary source for our convenience sample of Facebook quitters was the Website of the online initiative Quit Facebook Day. On this Website, Facebook users had the possibility to announce their intention to delete their account on May 31, 2010, which was declared as the Quit Facebook Day.

And what was the point of Quit Facebook Day?

In our view, Facebook doesn’t do a good job in either department. Facebook gives you choices about how to manage your data, but they aren’t fair choices, and while the onus is on the individual to manage these choices, Facebook makes it damn difficult for the average user to understand or manage this. We also don’t think Facebook has much respect for you or your data, especially in the context of the future.

So, how surprising is it that Quit Facebook Day quitters are more concerned about privacy than people who keep using Facebook?

The Herald had a story on Tuesday about a UN survey of men in nine areas in Asia/Oceania asking about rape and violence against women.  The story is pretty good, and actually has links to the articles in the medical journal Lancet.

Because of the wide publicity and the large scale of the survey I think it’s worth nailing down some of the details to make it harder to dismiss.  (more…)