Dean's World

Defending the liberal tradition in history, science, and philosophy.

Thursday, August 31, 2006

From the Mailbag: The Hockey Stick & Peer Review Corruption

Quoted:

A few weeks back my husband and I watched the committee hearing and questioning, i.e. "hectoring" of those who were agin it, those who wrote the report you have copied in your blog. It was very interesting. I'm pretty intelligent and I don't have a PhD but my husband does, and he knows how to catch those who are lying with statistics. A lot of that went on in the hockey stick model. We both know that money in the form of grants is kept pretty close to small cliques of those who agree with each other, and they are the ones who "peer review" each others papers. They are the editors and reviewers of the journals to which those papers are submitted. This is a huge scam. Money and power are the name of the game in science as in everything else that goes on in this world. I am old enough to be really, really cynical about this.

...Ruth Hoese

As I have noted to some of my friends who are scientists and who respect the peer review process: it's fine to respect peer review, which has many important strengths that should never be forgotten or ignored. But in the last 20 or so years we have reached a point where "peer review" doesn't just mean that your peers review your research before you publish it, which is a good idea. "Peer review" has also come to mean that your peers also control the government grants that are awarded to you, or denied to you. And worse, the "peers," in too many areas of science, are so specialized that often it means that even though it's supposed to be anonymous, in truth everybody important knows everybody else, and tends to recognize each other's work implicitely.

The biggest reforms I can think of to help alleviate the situation, assuming we want government to keep funding research (which I certainly do) would be to implement some of the changes in the Wegman report: require the grant committees to always be multi-disciplinary, and not just the people involved in the narrow area of research the grant is for. Require independent mathematicians, statisticians, or epidemiologists to review the applications whenever possible. I'd add one other requirement: currently the peers and their comments are kept "anonymous" in their comments on any grant application, but to keep transparency I would suggest that after something like 2 years all of the peer reviewers are published with their names in full associated with their comments, so that there is some actual accountability.

My friend Peter Duesberg wrote on this very issue in his 2003 paper, and I think it very valid here:

The peer review system derives its power from the little known practice of governments to deputize their authority to distribute funds for research to committees of “experts”. These experts are academic researchers distinguished by outstanding contributions to the current establishment. They alone review the merits of research applications from their peers, and they have the right to elect each other to review committees. Outwardly, this “peer review system” appears to the unsuspecting government and taxpayer as the equivalent of a jury system – free of all conflicts of interest. But, in view of the many professional and commercial investments in and benefits from their expertise, and even of the rewards from their universities and institutions for the corresponding overheads and partnerships – all legal in the US since president Reagan – ”peer reviewers” do not fund applications that challenge their own interests (Duesberg 1996b; Lang 1998; Zuger 2001). Since “peer review” is protected by anonymity, does not allow the applicant personal representation or an independent representative, nor a say or even a veto in the selection of the “jury”, and does not allow an appeal, its powers to defend the orthodoxy are unlimited. The corporate equivalent of academia’s ”peer review system” would be to give General Motors and Ford the authority to review and veto all innovations by less established carmakers competing for the consumer.

Even the professional journals and the science writers of the public media comply with the interests of government-funded majorities because they depend on their monthly “scientific breakthroughs”, the lucrative advertisements from their companies, and the opinion of their subscribers. For example, an early precursor of this article was written in response to an open invitation from a pharmacology-journal over 3 years ago. But, after considerable pressure on the journal from anonymous “AIDS experts”, the editor requested a reduced article, which was neither accepted nor rejected. Instead, the editor simply dropped all further correspondence. Subsequently, the editor of a prestigious German-based science journal invited another precursor of this article 2 years ago, which received two favourable reviews in short order. But before the manuscript could be revised, the editor informed us that the publisher was concerned about losing subscribers if our paper were published and ceased all further correspondence. It is this passive resistance that can grind down even the most determined truth seeker.

However, the mere potential to resolve the agony of AIDS by alternative hypotheses, such as ours, should be sufficient reason to replace the medieval “peer review system” by a modern jury system without conflicts of interest and with rights for representation and appeals of the applicant. If the current, unproductive AIDS establishment objects, because AIDS-science is too complex to be understood by non-HIV-AIDS scientists, funding should be withheld until the AIDS establishment finds ways to explain the complexity and merits of its expertise to other scientists.

Peter may be wrong about AIDS, but no one can doubt that this National Academy of Sciences member has in his lifetime turned in some incredible research, and a number of the world's foremost cancer researchers now think that he is onto a theory of carcinogensis that may be the most important breakthrough in the last 100 years (and that is not hyperbole). Yet he cannot get funded for any research except through private grants--which, while some libertarian-oriented thinkers may think is proper, is just stupid, because most research these days is in fact government-funded. And if we're going to keep funding research through government funds, we should at least have a greater transparency and more independence in this granting process, should we not? What we're doing now makes no sense at all.

Oh, and by the way: the above was quoted from this 2003 PDF of Peter's last paper on AIDS, which contains all the appropriate references, and which he says will almost certainly be his final one as he is now centered on cancer research. But why is it that Peter never had a single grant application for anything turned down, until he questioned the orthodoxy on AIDS, and then had dozens of grant applications turned down, every single one shot down, even those that had nothing whatever to do with AIDS? Even today some of the world's top cancer researchers believe Peter is brilliant and has much to contribute. Two nobel laureate biologists, including one of the fathers of molecular biology, think his work is of great merit. Lynn Margulis, one of the most important evolutionary biologists alive, thinks his work has merit. The members of the Indian Academy of Sciences felt Peter's 2003 paper worth publishing. But he can't get a grant to save his life. I've been tempted to try to raise funds for his lab at Berkeley myself.

The system has become very dysfunctional, and there is nothing whatever wrong with the laymen who pay the taxes to fund all this asking hard questions and demanding greater reforms and greater transparency and accountability.

Devastating Indictment of the Entire Field of Anthropogenic Global Warming Research

I wish I'd noticed this sooner: a PDF copy of a The Wegman committee's report on the 'Hockey Stick' analysis on recent global climate change.

This entire report needs to be read in full, but here is an important section, with some highlights in bold by myself:

"The Chairman of the Committee on Energy and Commerce as well as the Chairman of the Subcommittee on Oversight and Investigations have been interested in an independent verification of the critiques of Mann et al. (1998, 1999) [MBH98, MBH99] by McIntyre and McKitrick (2003, 2005a, 2005b) [MM03, MM05a, MM05b] as well as the related implications in the assessment. The conclusions from MBH98, MBH99 were featured in the Intergovernmental Panel on Climate Change report entitled Climate Change 20013: The Scientific Basis. This report concerns the rise in global temperatures, specifically during the 1990s. The MBH98 and MBH99 papers are focused on paleoclimate temperature reconstruction and conclusions therein focus on what appear to be a rapid rise in global temperature during the 1990s when compared with temperatures of the previous millennium. These conclusions generated a highly polarized debate over the policy implications of MBH98, MBH99 for the nature of global climate change, and whether or not anthropogenic actions are the source. This committee, composed of Edward J. Wegman (George Mason University), David W. Scott (Rice University), and Yasmin H. Said (The Johns Hopkins University), has reviewed the work of both articles, as well as a network of journal articles that are related either by authors or subject matter, and has come to several conclusions and recommendations. This Ad Hoc Committee has worked pro bono, has received no compensation, and has no financial interest in the outcome of the report."

"In general, we found MBH98 and MBH99 to be somewhat obscure and incomplete and the criticisms of MM03/05a/05b to be valid and compelling. We also comment that they were attempting to draw attention to the discrepancies in MBH98 and MBH99, and not to do paleoclimatic temperature reconstruction. Normally, one would try to select a calibration dataset that is representative of the entire dataset. The 1902-1995 data is not fully appropriate for calibration and leads to a misuse in principal component analysis. However, the reasons for setting 1902-1995 as the calibration point presented in the narrative of MBH98 sounds reasonable, and the error may be easily overlooked by someone not trained in statistical methodology. We note that there is no evidence that Dr. Mann or any of the other authors in paleoclimatology studies have had significant interactions with mainstream statisticians. In our further exploration of the social network of authorships in temperature reconstruction, we found that at least 43 authors have direct ties to Dr. Mann by virtue of coauthored papers with him. Our findings from this analysis suggest that authors in the area of paleoclimate studies are closely connected and thus ‘independent studies’ may not be as independent as they might appear on the surface. This committee does not believe that web logs are an appropriate forum for the scientific debate on this issue.

It is important to note the isolation of the paleoclimate community; even though they rely heavily on statistical methods they do not seem to be interacting with the statistical community. Additionally, we judge that the sharing of research materials, data and results was haphazardly and grudgingly done. In this case we judge that there was too much reliance on peer review, which was not necessarily independent. Moreover, the work has been sufficiently politicized that this community can hardly reassess their public positions without losing credibility. Overall, our committee believes that Mann’s assessments that the decade of the 1990s was the hottest decade of the millennium and that 1998 was the hottest year of the millennium cannot be supported by his analysis.

Recommendation 1. Especially when massive amounts of public monies and human lives are at stake, academic work should have a more intense level of scrutiny and review. It is especially the case that authors of policy-related documents like the IPCC report, Climate Change 2001: The Scientific Basis, should not be the same people as those that constructed the academic papers.

Recommendation 2. We believe that federally funded research agencies should develop a more comprehensive and concise policy on disclosure. All of us writing this report have been federally funded. Our experience with funding agencies has been that they do not in general articulate clear guidelines to the investigators as to what must be disclosed.

Federally funded work including code should be made available to other researchers upon reasonable request, especially if the intellectual property has no commercial value. Some consideration should be granted to data collectors to have exclusive use of their data for one or two years, prior to publication. But data collected under federal support should be made publicly available. (As federal agencies such as NASA do routinely.)

Recommendation 3. With clinical trials for drugs and devices to be approved for human use by the FDA, review and consultation with statisticians is expected. Indeed, it is standard practice to include statisticians in the application-for-approval process. We judge this to be a good policy when public health and also when substantial amounts of monies are involved, for example, when there are major policy decisions to be made based on statistical assessments. In such cases, evaluation by statisticians should be standard practice. This evaluation phase should be a mandatory part of all grant applications and funded accordingly.

Recommendation 4. Emphasis should be placed on the Federal funding of research related to fundamental understanding of the mechanisms of climate change. Funding should focus on interdisciplinary teams and avoid narrowly focused discipline research.

(Again, emphasis is mine in all cases.)

There's a good deal more there, much of it very worth reading. They did far, far more than look at a couple of papers, which I see that some in the paleoclimatology community have tried to sugggest. No, they actually looked at those papers and at dozens of related papers, and found almost all of them wanting. They further did an extensive mathematical analysis of the social networks involved in those many papers.

Certainly, they slam Mann and his colleagues for misrepresenting data, sloppy math, and worse. Which is a big deal all by itself, since Mann is one of the most frequently cited researchers in the entire field. Another damning quote:

While the works do have supplementary websites, they rely heavily on the reader’s ability to piece together the work and methodology from raw data. This is especially unsettling when the findings of these works are said to have global impact, yet only a small population could truly understand them.
Here's another:
Making conclusive statements without specific findings with regard to atmospheric forcings suggests a lack of scientific rigor and possibly an agenda.
The report goes on and on. Using rigorous statistical analysis they show substantial reason to question items central to the IPCC report, as well as the Mann & associates papers, and literally dozens of papers that Mann cites. It further analyzes the social network of climatology researchers and concludes, amongst other things, that:
The social network analysis of authors' relations suggests that the 'independent reconstructions' are not as independent as one might guess.

At bare minimum, damning accusations have been levelled at Dr. Mann, and by extension, just about everyone associated with him--who turn out to be dozens of important people who've co-authored papers with him, or conducted peer review on his work.

This, again, from research that was a core part of the IPCC report telling everyone in the world--important politicians and the general public--that catastrophic global warming was real and probably human-caused and required extensive and very expensive public policy changes to address. All of it put together by the same tiny little social network of equally self-interested researchers, with two or three cliques pretty much at the center of everything (with "clique" being mathematically and precisely defined by the Wegman group, no less!)

I have to say that I found the response "RealClimate" guys (probably the most prominent bloggers representing the orthodox climate change position in the blogosphere) to be--well, disappointing, to put it charitably. I searched their entire web site for "Wegman," and found only this frivolous response. It's got to be the most thin-gruel defense against a damning indictment that I've ever read. They even fail to point to the actual Wegman group report, choosing instead to focus on Dr. Wegman's much more limited personal testimony to Congress.

Frankly, here's what it looks like to me: "Hey, what's that behind you?!" [zoom away while backs are turned.]

I was literally aghast at the Wegman group's report. It makes it clear that only a tiny handful of researchers are at the center of most research and most public policy recommendations on climate change, and that practically no one outside this tight little clique-ridden community is in charge of reviewing their work. They all simply review each other's work--and now literally dozens of papers in the field, along with general practices and procedures in the field, have been independently reviewed and found deeply flawed.

Worst of all, although the Wegman report does not say this openly, anyone who knows how taxpayer funding of science recognizes this (and it is all over the Wegman report by inference): Practically all the taxpayer funding for this climate research, much of it clearly shoddy, is controlled by this same Good Ol' Boy Network with practically no independent review, who simply "peer review" each other in a not particularly anonymous way while they dole out each other's grants and approve each other's papers.

Which is all, by the way, pretty much exactly how Dr. Richard Lindzen has described it. (More on Lindzen here.)

Worse, when I've seen the "RealClimate" blog guys try to answer these charges, they throw around words like "conspiracy" and try to laugh it off--changing the subject to "conspiracies" instead of acknowledging the real words: "Clique," and "Good Old Boy Network in the guise of peer review." Other useful terms instead of "conspiracy" might be "professional ego and reputation" and "conflict of interest among the closed group of people who 'anonymously' (wink, wink) control each other's funding and access to publication."

I happen to agree with the Wegman report that weblogs are not the place to hash out climate change research on the scientific merits. But you know what? On the issue of public policy? On the issue of how my tax dollars are spent? On the issue of demanding greater transparency and accountability? On asking for a thorough independent investigation of allegations of scientific bullying and isolation of dissenters in the so-called "peer-review process" that awards those government grants? Oh, I think those are all entirely fair discussions to have on weblogs, and among all members of the public.

I'd like to see which scientists in the Climate Change research community are willing to step forward and talk bluntly about those issues--and do more than assure us that "hey the system's not perfect but it works I assure you" or "no conspiracies here, haha, move along now."

These people not only take in millions of taxpayer dollars, but they're treated like high priests who are allowed to ask for some of the most massive and sweeping public policy changes on the globe. There is not a damned thing wrong with asking them to answer hard questions for the taxpayers and the general public. And not just about the research, but about ethics and standards and ethical practice and independent review and isolation of dissenting ideas that might be professionally inconvenient for some researchers.

I'd like to see a thorough response to the actual Wegman report, and not vague armwaving generalizations, "oh, that's boring, nothing to it, can we do something more interesting now?" No, boys and girls. If you don't want the dirty, dirty politics in your science, stop taking the dirty, dirty taxpayer money, and stop making public policy recommendations. Otherwise, it's time for a lot more questions to be answered.

I am now more convinced than ever that Richard Lindzen and others like him need to be listened to.

Sunday, August 20, 2006

How Many Planets In The Solar System?

"Nine," you're thinking. Right?

Try 12. Or 53. Or a few hundred.

The International Astronomical Union has never officially defined what is and is not a planet. But they've put together a proposal recently that is moderately complex but may wind up with many, many more objects orbiting our star being called "planets." And they're holding the vote in just a few days in Prague. Details here.

Friday, August 11, 2006

E=mc^2

I'm not a physics expert, but I've always been fascinated by Einstein's most famous equation. And I get it: Energy equals mass times the velocity of light squared.

Now here's the thing: whenever I look at the equation, and the explanations for it, it has usually struck me that it can be simplified thusly:

E=m

Which is a revolutionary insight unto itself. It really is.

I have yet to hear a parsimonious explanation as to what the c^2 signifies. I understand that it somehow has to do with how time slows down as you approach c. But I don't quite get it. I know what it represents. I just do not understand its significance. What is the purpose of multiplying by the speed of light squared?

Can any of you enlighten me? And yes, before you ask, I've read Hawking's book cover to cover more than once. I may have missed it, but I don't recall it being there. So can you enlighten me?

(Yes I realize this may make me look dumb. Go ahead, make me look dumb. Just make me understand it.)

Friday, August 4, 2006

Continuing Problems for Boys in Education

At least one education researcher says that to call the situation with boys in American education a "crisis" is hyped. In looking through her report's data, not much of what she points to convinces me that there's no serious problem here. I think Kathleen Parker has a pretty fair analysis.

Tuesday, August 1, 2006

Genetics and Mathematics Question

Here's something I am fond of pointing out to people--of any background--about genetics. And it's simple math: we are all related to each other. This is an inescabable reality. Like, no matter how Jewish you are, you've got some goyim in your background. If you're black, you've got some crackers in your background. If you're lilly-white, there are some darkies in your mix somewhere. Even if you're as Asian as Asian gets, with pure yellow skin and almond-shaped black eyes, there are some pasty-white blue eyes somewhere in your background. If you've got both skin and eyes the color of mahogony and straight black hair, you've got some curly-haired redheads in your background somewhere. You probably just don't know about it.

On a very simplistic level, it's just all about math. And it looks like this:

We all have two parents--a mom and a dad. Just biologically speaking.

Okay, now just taking the most simplistic math about it, we all have two parents, four grandparents, 8 great-grandparents, and so on. So if you just go by that, and pass out 33 generations, it looks like this:

2
4
8
16
32
64
128
256
512
1,024
2,048
4,096
8,192
16,384
32,768
65,536
131,072
262,144
524,288
1,048,576
2,097,152
4,194,304
8,388,608
16,777,216
33,554,432
67,108,864
134,217,728
268,435,456
536,870,912
1,073,741,824
2,147,483,648
4,294,967,296
8,589,934,592

The current world population is around 6,000,000,000. In other words, if you just go back 33 generations you've got more ancestors than there are people alive on Planet Earth right now.

Now the truth is, this is oversimplified math. Although it ought to tell you how stupid it is to claim that anybody is "racially pure" in any sense. It's ridiculous. Go back 64 or 128 generations, and the whole idea of "racial purity" is a joke. As well it should be.

I am just curious though--genuinely curious, this is not a leading question--has anyone studied the mathematical question of what intermarriage of ancestores looks like, and come up with an equation to describe it? This is a question I have of simple mathematical values. Yes of course we all have 2 parents, 4 grandparents, 8 great-grandparents, 16 great-great-grandparents, and so on. Has anyone ever tried to determine what the average coefficient of intermarriage is within that subset?

This is not a "leading question." I'm just honestly curious, has anyone ever tried to calculate that? Because I'd bet it's a fairly simple number. Although I'd bet it would be somebody's PhD thesis. I'm just curious to know if anybody's done it.