Cosma Shalizi

Here's Chomsky on the same issue: http://www.cscs.umich.edu/~crshalizi/chomsky-on-postmodernism.html

A quote:

"It's entirely possible that I'm simply missing something, or that I just lack the intellectual capacity to understand the profundities that have been unearthed in the past 20 years or so by Paris intellectuals and their followers. I'm perfectly open-minded about it, and have been for years, when similar charges have been made -- but without any answer to my questions. Again, they are simple and should be easy to answer, if there is an answer: if I'm missing something, then show me what it is, in terms I can understand. Of course, if it's all beyond my comprehension, which is possible, then I'm just a lost cause, and will be compelled to keep to things I do seem to be able to understand, and keep to association with the kinds of people who also seem to be interested in them and seem to understand them (which I'm perfectly happy to do, having no interest, now or ever, in the sectors of the intellectual culture that engage in these things, but apparently little else).

Since no one has succeeded in showing me what I'm missing, we're left with the second option: I'm just incapable of understanding. I'm certainly willing to grant that it may be true, though I'm afraid I'll have to remain suspicious, for what seem good reasons. There are lots of things I don't understand -- say, the latest debates over whether neutrinos have mass or the way that Fermat's last theorem…

Reverse-engineering from the article, the original statistical result was probably something like, "Variations among managers in technical skill account for very little of the variations among managers in performance reviews."

One way to get that result would be for technical skill to be unimportant. Another way would be for the variations in technical skill within the sample to be much smaller than other relevant variations. Given that (según the article) the managers were selected for technical skill, but not for the other qualities, it seems almost certain that this was the case.

This might sound like a bug that could be avoided by better statistical analysis techniques, but it's really not. You really want to know what causes the actual variations in performance in your sample, not what could conceivably cause variations in performance. Surely there are hundreds of things that would cause even bigger variations than what's in your actual sample — you could have managers who kill all their employees, or managers who are interned incommunicado in Guantanamo, or managers who obsessively turn every project into an investigation of fluoride contamination of their precious bodily fluids, or managers who are actually undercover headhunters from a competitor trying to steal away all of your best talent.

Cosma Shalizi has an excellent post about the pitfalls of multivariate statistical analysis at http://www.cscs.umich.edu/~crshalizi/weblog/520.html; although he's talking…

I don't know Wolfram either, but I have read reviews of A New Kind of Science by experts who are competent to judge, and they all say that the book is full of old ideas that Wolfram claims sole credit for. The only really impressive bit in it was a proof that was done by one of his research assistants. Wolfram sued the guy to keep him from publishing until the book came out. He's also sued other academics who have so much as dared to sniff around what he considers his territory. So, yeah, he's clumsily arrogant in ways that are especially odious to his academic peers, and he doesn't have the sort of ground breaking accomplishments that might incline people to overlook such things.

Is that a reason to hate the guy? No, I agree with you, don't be hatin'. It's unbecoming, and a waste of time. (Hecker's website is down, so I can't say if that's what he was doing.) If you really are defining yourself by who you hate, you are a pathetic individual who should be mocked yourself (but not hated). Wolfram is a brilliant, brilliant guy, and his company has written some pretty cool and impressive software, after all. What hast thou accomplished, O mocker?

But I don't believe in giving arrogant people the benefit of the doubt just because we don't have a couple hundred years of perspective on their ideas either. The number of people who warrant that kind of treatment can be counted on the fingers of one hand, and they were almost always overlooked because they were out of the…

This is a wonderful comment. However, what psychologists know as g is the result of over-interpretation of a descriptive method known as factor analysis (which is very similar to principal components analysis).

http://cscs.umich.edu/~crshalizi/reviews/flynn-beyond/
Major thanks to Cosmo Shalizi who opened my eyes to these issues.

Also, the SAT grew from IQ tests, so it really isn't surprising that the two measures are correlated, given that the questions for SAT were probably kept on the test because they correlated with IQ tests.

That being said, the work of Kahneman (And the new paper which I should probably read instead of commenting on HN) is pretty rock solid as far as it goes. It is worth noting that there is a converse position in this field, that of Gerd Gigerenzer who argues that these heuristics exist because they are useful, and only go wrong in artificial situations.
www.cogsci.msu.edu/DSS/2007-2008/Todd/environments_that_make_us_smart.pdf

Personally, I incline far more towards the views of Gigerenzer than those of Kahneman, especially given that Gierenzer and colleagues attempt to model the mind given their theories computationally, which is something that psychology could do with more of.

Full disclosure: I'm a psychologist who's very frustrated with the lack of statistical sophistication and interpretation in my field.

This is probably not what you're looking for, but while trying to figure out if you could still download a free copy of Drake's out-of-print Fundamentals of Applied Probability Theory...

[HINT: The answer is yes: http://ocw.mit.edu/OcwWeb/Electrical-Engineering-and-Computer-Science/6-041Spring-2005/RelatedResources/index.htm]

...I found this potentially interesting page full of references:

http://www.cscs.umich.edu/~crshalizi/notebooks/probability.html

I post it here so that I can find it again later, but I fear that this is not the answer to your question. These appear to be more probability theory than nuts-and-bolts statistical analysis [1], and they may require more math background than I have (and I managed to handwave my way to a solid state physics Ph.D.)

Try browsing around the MIT OpenCourseWare site. One of the great things about online courses, even if you don't take the courses, is that they often publish syllabuses that contain a lot of good textbook references.

[EDIT: Ooh, look, if you follow links from the page I mentioned earlier you get here!

http://www.cscs.umich.edu/~crshalizi/notebooks/teaching-statistics.html
]

---

[1] Not that I can reliably tell the difference. I know just enough about probability and statistics to know that I should probably study them some more. ;)

The quick answer is "no, it doesn't, nothing does":

http://cscs.umich.edu/~crshalizi/weblog/491.html

The better answer emerges if you think about the example a little more closely. The big power law brands driven by customer appreciation are in media -- people love Lady Gaga (say), so she sells gazillions. Nobody loves yellowtail or sutter home. Many people love Screaming Eagle or Chateau Lafite. However, wine is an agricultural product; you cannot produce more bottles of a great wine than you can grow in some very particular fields in a year. The way scary hit-driven industries work is that you sell things way above marginal cost to everyone who wants them; in wine, since there's actually scarcity, very few people who love a brand can get as much as they want of it, so the prices at the top are insane (recent vintage screaming eagle is indicated at $2-3k per bottle), but the brands are smaller.

I'd guess the way to think of it is like the music industry before recording devices or electricity -- sure there are stars, but because supplies are limited nobody can by a megastar.