Posts from March 2019 (15)

March 29, 2019

Ihaka Lectures – videos for your viewing pleasure

 

We’re three weeks into the month-long Ihaka Lecture Series, and it has been well received – thank you to those who have turned up in person and online.

Our final speaker, Robert Tibshirani, right, is up on Weds April 3 at the University of Auckland (details here). Robert is Professor of Statistics and Biomedical Data Science at Stanford University.

He is best known for proposing the ‘lasso’, a sparse regression estimator, and describing its relationship to the idea of boosting in supervised classification. He will talk about modern sparse supervised learning approaches that extend the lasso.

 

In the meantime, you might like to check out the films of the last three speakers. First up on March 13 was by Bernhard Pfahringer, left, who is Professor of Computer Science at the University of Waikato.

He is a member of the Weka project, New Zealand’s other famous open-source data science contribution, and here talks about the design and development of Weka and more recent projects.

 

 

 

Next was supposed to be JJ Allaire, the founder and CEO of RStudio, and the author of R interfaces to Tensorflow and Keras. However, ill-health prevented him coming, and our very own Professor Thomas Lumley stepped in.

Thomas talked entertainingly about deep learning, in particular how deep convolutional nets are structured and how they can be remarkably effective, but can also fail, as he puts it, “in remarkably alien ways”.

 

Following was Dr Kristian Lum, Lead Statistician at the Human Rights Data Analysis Group. Her research has concretely demonstrated the potential for machine learning-based predictive policing models to reinforce and, in some cases, amplify historical racial biases in law enforcement.

She talked about algorithmic fairness, and about ways in which policy, rather than data science, influences the development of these models and their choice over non-algorithmic approaches.

 

 

March 27, 2019

The dangers in a world built on data about men

Women all know about the toilet queue in the intermission at concerts – same-sized bathrooms for men and women does not equal efficiency. Women who have ever stood and waited in a long line for the loo while the men come and go with speed – and I think I can say that this is about, roughly, give or take, 100% of us – roll our eyes and laugh about this as we wait. But the anecdote reveals an uncomfortable truth, says Caroline Criado Perez in her book Invisible Women: Exposing Data Bias in a World Designed for Men. Design and services that takes the average male or the needs of the average male as the norm – as is the case with car-crash test dummies and stab-proof vests, among other things – are potentially deadly. The Guardian has excerpted a section of her book and it’s a sobering read. Recommended.

And while we are on the subject of a world designed for data about men, NASA has cancelled the first all-women spacewalk due to a spacesuit size issue.

March 26, 2019

Super Rugby Predictions for Round 7

Team Ratings for Round 7

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Crusaders 15.92 17.67 -1.70
Hurricanes 8.98 9.43 -0.40
Lions 5.10 8.28 -3.20
Chiefs 4.75 8.56 -3.80
Highlanders 3.09 4.01 -0.90
Waratahs 2.22 2.00 0.20
Sharks 0.68 0.45 0.20
Stormers 0.64 -0.39 1.00
Brumbies -1.29 0.00 -1.30
Bulls -1.31 -3.79 2.50
Jaguares -1.45 -0.26 -1.20
Blues -2.73 -3.42 0.70
Rebels -4.78 -7.26 2.50
Reds -5.27 -8.19 2.90
Sunwolves -13.56 -16.08 2.50

 

Performance So Far

So far there have been 40 matches played, 26 of which were correctly predicted, a success rate of 65%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Blues vs. Highlanders Mar 22 33 – 26 -3.60 FALSE
2 Hurricanes vs. Stormers Mar 23 34 – 28 13.20 TRUE
3 Waratahs vs. Crusaders Mar 23 20 – 12 -12.10 FALSE
4 Sunwolves vs. Lions Mar 23 24 – 37 -14.90 TRUE
5 Bulls vs. Chiefs Mar 23 20 – 56 2.60 FALSE
6 Sharks vs. Rebels Mar 23 28 – 14 8.80 TRUE
7 Reds vs. Brumbies Mar 24 36 – 14 -3.50 FALSE

 

Predictions for Round 7

Here are the predictions for Round 7. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Hurricanes vs. Crusaders Mar 29 Crusaders -3.40
2 Waratahs vs. Sunwolves Mar 29 Waratahs 19.80
3 Blues vs. Stormers Mar 30 Blues 0.60
4 Reds vs. Rebels Mar 30 Reds 3.00
5 Sharks vs. Bulls Mar 30 Sharks 5.50
6 Jaguares vs. Chiefs Mar 30 Chiefs -2.20

 

Rugby Premiership Predictions for Round 18

Team Ratings for Round 18

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Exeter Chiefs 10.47 11.13 -0.70
Saracens 10.12 11.19 -1.10
Gloucester Rugby 4.57 1.23 3.30
Northampton Saints 4.28 3.42 0.90
Harlequins 2.98 2.05 0.90
Bath Rugby 2.40 3.11 -0.70
Wasps 2.33 8.30 -6.00
Sale Sharks 1.48 -0.81 2.30
Leicester Tigers 0.74 6.26 -5.50
Worcester Warriors -2.13 -5.18 3.00
Newcastle Falcons -2.72 -3.51 0.80
Bristol -2.94 -5.60 2.70

 

Performance So Far

So far there have been 102 matches played, 70 of which were correctly predicted, a success rate of 68.6%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Bristol vs. Worcester Warriors Mar 23 25 – 27 5.50 FALSE
2 Exeter Chiefs vs. Bath Rugby Mar 23 29 – 10 12.40 TRUE
3 Gloucester Rugby vs. Wasps Mar 23 27 – 14 6.60 TRUE
4 Leicester Tigers vs. Northampton Saints Mar 23 15 – 29 3.50 FALSE
5 Newcastle Falcons vs. Sale Sharks Mar 23 22 – 17 0.50 TRUE
6 Saracens vs. Harlequins Mar 23 27 – 20 13.90 TRUE

 

Predictions for Round 18

Here are the predictions for Round 18. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Bath Rugby vs. Bristol Apr 06 Bath Rugby 10.80
2 Leicester Tigers vs. Exeter Chiefs Apr 06 Exeter Chiefs -4.20
3 Northampton Saints vs. Gloucester Rugby Apr 06 Northampton Saints 5.20
4 Sale Sharks vs. Harlequins Apr 06 Sale Sharks 4.00
5 Saracens vs. Newcastle Falcons Apr 06 Saracens 18.30
6 Wasps vs. Worcester Warriors Apr 06 Wasps 10.00

 

Pro14 Predictions for Round 19

Team Ratings for Round 19

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Leinster 11.20 9.80 1.40
Munster 9.61 8.08 1.50
Glasgow Warriors 8.92 8.55 0.40
Connacht 3.65 0.01 3.60
Scarlets 2.96 6.39 -3.40
Cardiff Blues 1.35 0.24 1.10
Ulster 1.24 2.07 -0.80
Edinburgh 0.53 -0.64 1.20
Ospreys -0.92 -0.86 -0.10
Treviso -1.12 -5.19 4.10
Cheetahs -2.04 -0.83 -1.20
Dragons -9.77 -8.59 -1.20
Southern Kings -10.49 -7.91 -2.60
Zebre -14.58 -10.57 -4.00

 

Performance So Far

So far there have been 126 matches played, 100 of which were correctly predicted, a success rate of 79.4%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Cardiff Blues vs. Scarlets Mar 23 41 – 17 1.20 TRUE
2 Connacht vs. Treviso Mar 23 29 – 14 8.20 TRUE
3 Edinburgh vs. Leinster Mar 23 28 – 11 -8.00 FALSE
4 Glasgow Warriors vs. Cheetahs Mar 23 35 – 17 15.00 TRUE
5 Munster vs. Zebre Mar 23 31 – 12 29.60 TRUE
6 Ospreys vs. Dragons Mar 23 29 – 20 14.20 TRUE
7 Ulster vs. Southern Kings Mar 23 33 – 19 16.70 TRUE

 

Predictions for Round 19

Here are the predictions for Round 19. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Cheetahs vs. Ospreys Apr 06 Cheetahs 3.40
2 Glasgow Warriors vs. Ulster Apr 06 Glasgow Warriors 12.20
3 Leinster vs. Treviso Apr 06 Leinster 16.80
4 Munster vs. Cardiff Blues Apr 06 Munster 12.80
5 Scarlets vs. Edinburgh Apr 06 Scarlets 6.90
6 Southern Kings vs. Dragons Apr 06 Southern Kings 3.80
7 Zebre vs. Connacht Apr 06 Connacht -13.70

 

NRL Predictions for Round 3

Team Ratings for Round 3

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Roosters 7.27 8.72 -1.40
Storm 7.11 6.03 1.10
Rabbitohs 6.07 3.89 2.20
Broncos 3.38 2.63 0.80
Sharks 3.07 3.90 -0.80
Raiders 2.30 1.81 0.50
Cowboys -0.23 0.15 -0.40
Warriors -0.34 -0.27 -0.10
Panthers -0.49 0.93 -1.40
Dragons -1.50 0.06 -1.60
Wests Tigers -2.69 -5.57 2.90
Eels -3.14 -6.17 3.00
Bulldogs -4.42 -0.61 -3.80
Titans -4.92 -3.36 -1.60
Sea Eagles -6.18 -5.61 -0.60
Knights -7.28 -8.51 1.20

 

Performance So Far

So far there have been 16 matches played, 11 of which were correctly predicted, a success rate of 68.8%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Dragons vs. Rabbitohs Mar 21 18 – 34 -2.70 TRUE
2 Raiders vs. Storm Mar 22 10 – 22 -0.20 TRUE
3 Broncos vs. Cowboys Mar 22 29 – 10 4.60 TRUE
4 Sharks vs. Titans Mar 23 20 – 6 10.50 TRUE
5 Knights vs. Panthers Mar 23 14 – 16 -4.10 TRUE
6 Sea Eagles vs. Roosters Mar 23 18 – 26 -10.80 TRUE
7 Bulldogs vs. Eels Mar 24 16 – 36 5.30 FALSE
8 Wests Tigers vs. Warriors Mar 24 34 – 6 -2.10 FALSE

 

Predictions for Round 3

Here are the predictions for Round 3. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Broncos vs. Dragons Mar 28 Broncos 7.90
2 Raiders vs. Knights Mar 29 Raiders 12.60
3 Eels vs. Roosters Mar 29 Roosters -7.40
4 Sea Eagles vs. Warriors Mar 30 Warriors -1.30
5 Cowboys vs. Sharks Mar 30 Sharks -0.30
6 Panthers vs. Storm Mar 30 Storm -4.60
7 Wests Tigers vs. Bulldogs Mar 31 Wests Tigers 4.70
8 Rabbitohs vs. Titans Mar 31 Rabbitohs 14.00

 

March 23, 2019

The breakthough narrative

Clinical science stories are the opposite of most current events coverage: the good news is dramatic and has an army of publicists; the bad is slow and boring.

In September 2016 there was a flurry of news articles about a new candidate treatment for Alzheimer’s

In the Herald (from the Telegraph)

(from the Washington Post)

  • A glimmer of hope for an Alzheimer’s drug. An initial trial of an antibody therapy that targets Alzheimer’s disease has shown promising results and could signal a long-awaited breakthrough in treating the devastating brain disorder that affects millions.

Stuff (from the Telegraph)

TVNZ

Radio NZ

Now, in 2019, two large clinical trials were just stopped because the treatment didn’t work.  This sort of thing happens a lot; drug development is hard, especially when we don’t actually understand the disease very well.

The coverage of Alzheimer’s treatment candidates has two big problems, though. First, promising initial results are almost always oversold. Second, the failures usually aren’t covered, except perhaps in the business pages.

March 19, 2019

Super Rugby Predictions for Round 6

Team Ratings for Round 6

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Crusaders 17.13 17.67 -0.50
Hurricanes 9.41 9.43 -0.00
Lions 5.21 8.28 -3.10
Highlanders 3.73 4.01 -0.30
Chiefs 2.44 8.56 -6.10
Bulls 1.01 -3.79 4.80
Waratahs 1.01 2.00 -1.00
Sharks 0.37 0.45 -0.10
Brumbies 0.25 0.00 0.20
Stormers 0.21 -0.39 0.60
Jaguares -1.45 -0.26 -1.20
Blues -3.37 -3.42 0.10
Rebels -4.47 -7.26 2.80
Reds -6.80 -8.19 1.40
Sunwolves -13.67 -16.08 2.40

 

Performance So Far

So far there have been 33 matches played, 23 of which were correctly predicted, a success rate of 69.7%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Chiefs vs. Hurricanes Mar 15 23 – 23 -4.00 FALSE
2 Brumbies vs. Waratahs Mar 15 19 – 13 2.30 TRUE
3 Stormers vs. Jaguares Mar 15 35 – 8 2.70 TRUE
4 Sunwolves vs. Reds Mar 16 31 – 34 -2.90 TRUE
5 Lions vs. Rebels Mar 16 36 – 33 15.10 TRUE

 

Predictions for Round 6

Here are the predictions for Round 6. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Blues vs. Highlanders Mar 22 Highlanders -3.60
2 Hurricanes vs. Stormers Mar 23 Hurricanes 13.20
3 Waratahs vs. Crusaders Mar 23 Crusaders -12.10
4 Sunwolves vs. Lions Mar 23 Lions -14.90
5 Bulls vs. Chiefs Mar 23 Bulls 2.60
6 Sharks vs. Rebels Mar 23 Sharks 8.80
7 Reds vs. Brumbies Mar 24 Brumbies -3.50

 

NRL Predictions for Round 2

Team Ratings for Round 2

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Roosters 7.47 8.72 -1.20
Storm 6.28 6.03 0.20
Rabbitohs 5.13 3.89 1.20
Raiders 3.13 1.81 1.30
Sharks 2.83 3.90 -1.10
Broncos 2.37 2.63 -0.30
Warriors 1.77 -0.27 2.00
Cowboys 0.77 0.15 0.60
Panthers -0.34 0.93 -1.30
Dragons -0.57 0.06 -0.60
Bulldogs -2.65 -0.61 -2.00
Titans -4.68 -3.36 -1.30
Wests Tigers -4.80 -5.57 0.80
Eels -4.90 -6.17 1.30
Sea Eagles -6.38 -5.61 -0.80
Knights -7.43 -8.51 1.10

 

Performance So Far

So far there have been 8 matches played, 5 of which were correctly predicted, a success rate of 62.5%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Storm vs. Broncos Mar 14 22 – 12 6.40 TRUE
2 Knights vs. Sharks Mar 15 14 – 8 -9.40 FALSE
3 Roosters vs. Rabbitohs Mar 15 16 – 26 7.80 FALSE
4 Warriors vs. Bulldogs Mar 16 40 – 6 4.80 TRUE
5 Wests Tigers vs. Sea Eagles Mar 16 20 – 6 3.00 TRUE
6 Cowboys vs. Dragons Mar 16 24 – 12 3.10 TRUE
7 Panthers vs. Eels Mar 17 12 – 20 10.10 FALSE
8 Titans vs. Raiders Mar 17 0 – 21 -2.20 TRUE

 

Predictions for Round 2

Here are the predictions for Round 2. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Dragons vs. Rabbitohs Mar 21 Rabbitohs -2.70
2 Raiders vs. Storm Mar 22 Storm -0.20
3 Broncos vs. Cowboys Mar 22 Broncos 4.60
4 Sharks vs. Titans Mar 23 Sharks 10.50
5 Knights vs. Panthers Mar 23 Panthers -4.10
6 Sea Eagles vs. Roosters Mar 23 Roosters -10.80
7 Bulldogs vs. Eels Mar 24 Bulldogs 5.30
8 Wests Tigers vs. Warriors Mar 24 Warriors -2.10

 

March 12, 2019

Super Rugby Predictions for Round 5

Team Ratings for Round 5

The basic method is described on my Department home page.
Here are the team ratings prior to this week’s games, along with the ratings at the start of the season.

Current Rating Rating at Season Start Difference
Crusaders 17.13 17.67 -0.50
Hurricanes 9.65 9.43 0.20
Lions 5.94 8.28 -2.30
Highlanders 3.73 4.01 -0.30
Chiefs 2.20 8.56 -6.40
Waratahs 1.24 2.00 -0.80
Bulls 1.01 -3.79 4.80
Sharks 0.37 0.45 -0.10
Brumbies 0.02 0.00 0.00
Jaguares 0.01 -0.26 0.30
Stormers -1.25 -0.39 -0.90
Blues -3.37 -3.42 0.10
Rebels -5.20 -7.26 2.10
Reds -6.81 -8.19 1.40
Sunwolves -13.67 -16.08 2.40

 

Performance So Far

So far there have been 28 matches played, 19 of which were correctly predicted, a success rate of 67.9%.
Here are the predictions for last week’s games.

Game Date Score Prediction Correct
1 Hurricanes vs. Highlanders Mar 08 25 – 22 10.30 TRUE
2 Rebels vs. Brumbies Mar 08 29 – 26 -2.40 FALSE
3 Crusaders vs. Chiefs Mar 09 57 – 28 17.00 TRUE
4 Blues vs. Sunwolves Mar 09 28 – 20 15.20 TRUE
5 Waratahs vs. Reds Mar 09 28 – 17 11.60 TRUE
6 Lions vs. Jaguares Mar 09 47 – 39 10.20 TRUE
7 Bulls vs. Sharks Mar 09 37 – 14 1.60 TRUE

 

Predictions for Round 5

Here are the predictions for Round 5. The prediction is my estimated expected points difference with a positive margin being a win to the home team, and a negative margin a win to the away team.

Game Date Winner Prediction
1 Chiefs vs. Hurricanes Mar 15 Hurricanes -4.00
2 Brumbies vs. Waratahs Mar 15 Brumbies 2.30
3 Stormers vs. Jaguares Mar 15 Stormers 2.70
4 Sunwolves vs. Reds Mar 16 Reds -2.90
5 Highlanders vs. Crusaders Mar 16 Crusaders -9.90
6 Lions vs. Rebels Mar 16 Lions 15.10