How to evaluate science? The impact factor vs. cited half life

Guest post by Ferdinando Boero

Check out the discipline of ‘Biochemistry and Molecular Biology’ in the Journal of Citation Reports (JCR) and rank the 286 journals based on the impact factor (IF). The IFs of the top ten journals range from 32 to 10. Now sort them by cited half life (CHL), a measure of how long a paper continues to be cited: 27 journals (9% of the total) have a CHL >10, a reference point of ‘infinity’ for JCR, which is positive indeed. Looking at these 27 journals, and omitting reviews, their IFs range from 8 to 0, and most are <5. Now take Zoology. The IFs for these top 10 journals range from 4 to 2, in a list of 145 journals. In this comparison, the chemical approach to biology reigns victorious. Now rank zoology journals by CHL: 57 (39%) of them score >10, with IFs of those journals ranging from 4 to 0. In this scenario, zoology beats molecular biology 57 to 27 or, even better, 39% against 9%. The upshot is that, if you publish a paper in zoology, it will live much longer than a paper in biochemistry and molecular biology – with the majority of the golden papers in the latter discipline rapidly decaying into oblivion.

Is it better to have a high IF and a low CHL or vice versa? Of course, it would be better to have both scores high, but usually this does not happen. Indeed, the journals with high CHL in biochemistry and molecular biology have low IF). One might object: is it right or even relevant to ask what is better? My answer is no, but this is currently how the relevance of science and its funding, not to mention career opportunities, are determined. As a consequence, zoology is disappearing (especially the subdiscipline of taxonomy; see E.O. Wilson’s essay in October’s 25th anniversary issue of The Scientist), whereas molecular approaches are paramount. Why? If you publish in zoological journals, your scientific impact as measured by the IF is low, whereas if you pursue a molecular approach, your impact is high, at least for the moment.

Why not mediate the metrics based on a combined IF and CHL? Unfortunately, zoologists do not even know what CHL is. So instead of playing the CHL card and holding their ground, zoologists are determined to join the game of molecular biologists, with molecular taxonomy now triumphing over traditional approaches.

Scientists are evaluated throughout the world based on the IF of the tribunes where they publish their work. The higher the IF and the H (Hirsch) index, the better the scientist – or so the common wisdom goes. The CHL is ignored. I propose the Boero index: multiply the IF by the CHL. With ‘infinity’ as one of the multipliers, the results can be absurd: a glorious 57 infinities in zoology with a mere 27 in biochemistry and molecular biology. This absurdity merely highlights the need to be more objective while ranking scientific disciplines and the researchers who practice them. Taxonomy is dying because of the low IF of taxonomic journals. Is this right, especially now, in the era of dramatically diminishing biodiversity?


Nando Boero
Ferdinando Boero is Professor of Zoology at the Department of Biological and Environmental Sciences and Technologies of the University of Salento, Lecce, Italy. He is an F1000 Faculty Member in the Ecology Faculty.

previous post

New sections: Aging and Viral hepatitis

next post

What’s light got to do with it?

3 thoughts on “How to evaluate science? The impact factor vs. cited half life”

  1. While I appreciate the author’s complaints about IF-weighted funding or promotion, using CHL as the alternative is definitely not the answer. What is needed, and this maybe is asking too much of administrators and politicians, is a clear understanding of how Ifs can be used and compared and the importance of journal ranking within a discipline. Of course a neuroscientist who publishes in journals with an IF of 3.5 is having much less impact than a zoologist or plant scientist who publishes at the same IF. But in the end, nothing substitutes for actually looking at what a scientist is publishing and how it has influenced other scientists. But that necessitates actually reading the papers.

  2. ferdinando boero says:

    I can only agree: reading papers and monographs is the only serious thing to do to evaluate the performances of a researchers. In my experience, however, I see that people are weighted with numerical measures that are related to the IF of their tribunes and to the citations they have (H index). This does not select scientists, this selects disciplines! Young scientists do not dare attempting a career in taxonomy because they are sure that they will not have a chance.

  3. ferdinando boero says:

    For those who are interested in why taxonomy is in bad shape in the era of biodiversity, I suggest reading a semi-serious paper that I wrote for an obscure journal with no IF: The study of species in the era of biodiversity: a tale of stupidity.
    You can download it here, for free:
    http://www.mdpi.com/1424-2818/2/1/115/

Legacy comments are closed.

User comments must be in English, comprehensible and relevant to the post under discussion. We reserve the right to remove any comments that we consider to be inappropriate, offensive or otherwise in breach of the User Comment Terms and Conditions. Commenters must not use a comment for personal attacks.

Click here to post comment and indicate that you accept the Commenting Terms and Conditions.