Sense about Statistics

Sense about Science guide to statistics

Quantification in an argument is seen as a big plus. If someone quotes some statistics, their argument suddenly seems so much more convincing. Yet, statistics is a funny thing. It can be hyped and sensationalised. The same data can be analysed differently to reach conclusions that support your argument. Most people do it mistakenly but there are many cunning minds out there who do it deliberately. People need to protect themselves from this misrepresentation of numbers.

Surprisingly, it is not hard to do. The latest Sense about Science initiative on making sense of statistics gives you quick run through on how can we question these numbers and abstract the true meaning out of them. It is a good example of how being mildly skeptical is generally a good thing.

Some interesting examples that I will quote from the guide are:

  1. Literary Digest carried out a survey before the 1936 US Presidential Election. It mailed out millions of ballot papers and got two million back; a huge sample, most of which backed the Republican candidate Alf Landon.But the addresses to which they had been sent came from a directory of car owners and from the telephone directory: a biased sample, since in 1936 only the better-off owned cars or had telephones. Franklin D Roosevelt, the Democrat, won the election in a landslide.
  2. When it was claimed that in the ten most deprived areas in the UK 54% of teenage girls were likely to fall pregnant before the age of 18, it didn’t take long for people to realise this could not be true – it would mean over half of teenage girls from these areas being pregnant. The real figure was 5.4%.
  3. If you had a room with ten teachers all earning between £20,000 – £30,000, with a If you had a room with ten teachers all earning between £20,000 – £30,000, with a mean salary of £24,900 and a median (mid-point) salary of £25,000 and then someone who earns a million pounds walked into the room, the mean would increase to £114,000 but the median would hardly change. By using the median or mode (most common value) this distortion can be reduced, providing a more representative average salary.

I hope people make use of this guide to help themselves and the society better understand numbers which form a such a significant part of our lives today.

Asteroids likely source of Earth’s water

Bad Science examples from the media: Indian Express, April 29, 2010

Ice asteroids likely source of Earth’s water: Study

Astronomers have for the first time detected ice and organic compounds on an asteroid, a pair of landmark studies.

The discovery bolsters the theory that comets and asteroids crashing into Earth nearly four billion years ago seeded the planet with water and carbon-based molecules, both essential ingredients for life.

Working separately, two teams of scientists using NASA’s Infrared Telescope Facility in Hawaii found that the 24 Themis, which orbits the Sun between Mars and Jupiter, is literally covered in a thin coating of frost.

It had long been suspected that the massive space rocks that bombarded our planet after the formation of the solar system contained frozen water, but the two studies, published in Nature, provide the first hard evidence.

Still, a mystery remained: How could frozen water persist over billions of years on an asteroid hot enough to vapourise surface ice?

Only if that layer of frost were continually replenished by the slow release of water vapour released from ice in the asteroid’s interior, the researchers reasoned.

In other words, 24 Themis some 200 kilometres (125 miles) in diameter almost certainly contains far more water locked in its minerals than anyone suspected.

===========

This article has many flaws. At the very outset, the headline itself is misleading. Unfortunately the piece has fallen to the common temptation of sensationalising the news with an unholy bargain of the truth. Unlike what the headline implies, the asteroid Themis 24 is very much a solid mass covered with a thin layer of ice and not wholly made out of ice. If you want a sensational title, isn’t it good enough to just say “Asteroids likely source of water on Earth”?

Secondly, the article has been sadly stripped of so many important data points that it fails to make the point. For example, when asking the question “How could frozen water persist over billions of years on an asteroid hot enough to vapourise surface ice?” the writer gives no background to the reader about why is it hot enough to vaporise the surface ice. If the piece of rock is in between Mars and Jupiter then a common man would assume that the surface temperature compared to the Earth (which is much closer to the sun) would be lower. Thus, if Earth can have surface ice, then why can’t an asteroid? Although this logic is flawed in itself, it raises many more questions in a reader’s mind such as, is it because the asteroid has no atmosphere? or is it because it travels at a greater speed than earth? and so on. Also, the mystery question is wrongly posed as it should be ‘millions’ (what authors claim by their modelling) instead of ‘billions‘.

Thirdly, there is no mention of the timeline in any of the Nature articles and points to the classic error of ‘making up information’ for the sake of it. I suppose that the writer has come to a conclusion (if at all he has given this article any thought) that first sign of life was seen 3.5 billion years ago thus obviously, water would have come to Earth sometime before that. Thus, the use of “nearly four billion years ago.”

Fourthly, “Only if that layer of frost were continually replenished by the slow release of water vapour released from ice in the asteroid’s interior, the researchers reasoned.” This sentence will only confuse the readers ever more. Why does the ice in the interior of the asteroid sublime only to deposit back as frost on the surface? The more probable reason, as mentioned by the researchers, is ‘impact gardening’ which is the phenomenon of small bodies hitting the surface of the asteroid and churning up the subsurface ice. The impact might also be able to trigger the sublimation of subsurface ice, the authors believe. There is no mention of that in this article!

Finally, “24 Themis — some 200 kilometres (125 miles) in diameter — almost certainly contains far more water locked in its minerals than anyone suspected” is absolutely wrong. Humberto et. al clearly mention that “Although many asteroids show absorptions in this region, they are well matched by hydrated minerals. The spectral features of 24 Themis are significantly different from those in other asteroids and we show that it is accurately matched by small ice particles.” The point the authors make is exactly opposite. There isn’t hydrated minerals or ‘high concentration hydrated minerals’ that the authors observe but water in it’s free form as small ice particles.

As science writers we have the responsibility to communicate science correctly and such obvious mistakes will only create more doubts and lead the readers astray.

ResearchBlogging.org Rivkin, A., & Emery, J. (2010) Detection of ice and organics on an asteroidal surface. Nature, 464(7293), 1322-1323. DOI: 10.1038/nature09028 & Campins, H., Hargrove, K., Pinilla-Alonso, N., Howell, E., Kelley, M., Licandro, J., Mothé-Diniz, T., Fernández, Y., & Ziffer, J. (2010) Water ice and organics on the surface of the asteroid 24 Themis. Nature, 464(7293), 1320-1321. DOI: 10.1038/nature09029