Surprise!

| No Comments | No TrackBacks

I've recently been reading Stephen Law's new book - Believing Bullshit (do check out the Amazon link if only for the comedy review Stephen mentions on his blog).

I'm only about a quarter of the way in, and finding it enjoyable, but I thought I'd pick up on one bit of the text I'm not completely sure I agree with. It's about what makes a scientific theory that is well supported by evidence.

Law says that a theory needs to be:

  1. clear and precise
  2. surprising and
  3. true
Now he also says that scientists and philosophers may disagree on the details with this, so I've not exactly got a complaint about what he says, but I think that it's not necessary for a theory to be surprising.

Now, I'm all in favour of clear and precise theories - if you make a waffly prediction it's hard to check how well the evidence fits your prediction. I've mentioned before how important it is from a Bayesian point of view, and even if you don't want to analyse your data that way I think people can see the benefit of a theory that makes precise predictions. A precise prediction is essentially easier to test, and testing things is pretty much what science is about.

I'm also all in favour of true theories. That's not terribly surprising.

What is surprising to me, is that Law says that a theory should be surprising in order for us to find strong confirmation for it. Law gives the example of the idea that fairies cause trees to grow more quickly in the summer months. This theory makes an unsurprising prediction, because we expect trees to grow more quickly in the summer months anyway. It's then argued that because we expect this to happen anyway, it's not a good theory.

This has problems. Suppose we actually had some complex idea for some phenomenon - a good example might be epicycles to describe the orbits of planets. Now, Copernicus comes along and has a simpler idea, a clearly better idea, but it's not a surprising idea because it predicts exactly the same apparent motions of the planets across the sky as we already had. An awful lot of theories have unsurprising predictions, but fortunately they frequently also have surprising ones - and these provide us with the best way to come up with an experiment to figure out whether they or another theory is best. However, given two theories that make the same predictions, labelling the first theory better because it made the surprising prediction and the later theory worse because the first one came up first and so now its predictions are unsurprising - well that's just not a good way to distinguish between the theories.

Instead, given theories that have the same predictions there's an old rule of thumb for deciding between them - Occam's Razor. The fairy theory isn't bad because it makes the same predictions as another theory - it's bad because it adds in fairies when we don't need them. A theory can be good while still being unsurprising, as long as it gives a better explanation.

That all said, the book's great. Maybe I'll review it properly when I've got to the end, and post occasional comments on the way to the end as well, but for now I think it's well worth picking up if critical thinking's your thing.

No TrackBacks

TrackBack URL: http://eddedmondson.me.uk/cgi-bin/mt/mt-tb.cgi/34

Leave a comment

Flattery


"neat blog"
"Don't ever stop"
  - Rita

"you are totally ill informed"
"u r probably ignorant on most things"
"yr blog cant be worth reading"
  - @angelneptustar

"The really nice thing about your blog is it always stretches my brain and makes me feel I am still learning & on the up :)"
  - Alice

"More frightfully interesting stuff... Any self-respecting geek should be reading this."
  - Lenny

"I'm not always sure I totally get what you're on about, but I like reading your blogs anyway - mainly because I know it's stuff that needs to be said."
  - Hanny

Pages

Categories

About this Entry

This page contains a single entry by Edd published on June 15, 2011 1:58 PM.

Bad physics demonstrations was the previous entry in this blog.

On academic publishing is the next entry in this blog.

Find recent content on the main index or look in the archives to find all content.

About the author

Edd works somewhere between astronomy and computing and has a general interest in science, skepticism and other related topics.

Opinions expressed in this blog are my own and not those of my employer.