
In the tradition of Stephen Colbert's concept of truthiness, Proofiness explores the intersection of chicanery and mathematics. The author explores regression, false correlation, Potemkin numbers, and a variety of other sketchy techniques used to make people think that the data reflect patterns that don't exist in actuality. How to Lie With Statistics would strike me as a readalike.
It is also a common tread in books by Tufte : https://en.wikipedia.org/wiki/Edward_Tufte
I like "Visual Explanations: Images and Quantities, Evidence and Narrative" : https://www.amazon.com/Visual-Explanations-Quantities-Eviden...
The best approach is multi-variate analysis. Which is to say for each correlation you find, identify another correlation that would be true (and is measurable) if the cause was what you hypothesize is the cause. Its a great way to write a paper too.
You start with "look at this correlation", we hypothesize that cause is "Q" and now we go look at the following correlations to prove or disprove our hypothesis, ... analysis and graphs ..., as you can see our hypothesis is thoroughly {proven | disproved} by these correlations.
If the data isn't available to do additional analysis then you are stuck trying to collect that data somehow. You can end up with inconclusive results in that case.
"What I'm concerned about is that the average scientific layman reader -- the person who assumes they are just as up-to-date on scientific matters as possible -- has no freaking idea where the real science leaves off and where the bullshit begins."
Which I completely agree with. There is the scientific method which strives to discover truth though rigor and their is the use of 'science' in rhetoric which attempts to lend truthiness to speculation or wishful thinking.
The blog post would have benefited greatly from taking this version of it, pulling out all of the actual things the author wanted to say, and then laying those out in a more cohesive fashion.
For those interested in the abuse of numbers in rhetoric I can reccomend the book 'Proofiness' [1] which talks about ways people abuse mathematics as a rhetorical tool. Science is one of those things that also helps lay people feel better about believing in something.
I agree with the original author's disappointment as to how it is being abused. But I also note that the author gets confused between how journalists report science vs what the science actually said. It is always a good idea to track down the original paper or study and read it to see what the journalist left out or simply missed.
[1] https://www.amazon.com/Proofiness-Youre-Being-Fooled-Numbers...
[1] http://www.amazon.com/Proofiness-Youre-Being-Fooled-Numbers/...
[1] In "Proofiness: The Dark Arts of Mathematical Deception", Charles Seife claims that NASA asked GE to calculate the chances of success in the Moon Landing and came out with 5%. http://www.amazon.com/Proofiness-Dark-Arts-Mathematical-Dece...