[Home]   [Full version]  

New method ranks quality of scientific journals by field

Feb 27 ,General Science


Worldwide, the number of scientists is increasing as is the number of scientific journals and published papers, the latter two thanks in large part to the rise of electronic publishing. Scientists and other researchers are finding it more difficult than ever to zero in on the published literature that is most valuable to them.

Now, much like Google locates electronic information likely to be relevant and of quality to the user, a team of researchers from Northwestern University has developed a mathematical method to rank scientific journals according to quality, an approach that will help scientists locate high-impact research papers to read and to cite in their own papers. The rankings also should be useful to university administrators and funding agencies who must evaluate the quality of a researcher’s work.

The team analyzed the citation data of nearly 23 million papers that appeared in 2,267 journals representing 200 academic fields and that spanned the years from 1955 to 2006; their analysis produced 200 separate tables of journal rankings by field. The results, including all the rankings, will be published online Feb. 27 in PLoS ONE, an international, peer-reviewed, open-access, online journal published by the Public Library of Science.

“Trying to find good information in the literature can be a problem for scientists,” said Luís A. Nunes Amaral, associate professor of chemical and biological engineering in Northwestern’s McCormick School of Engineering and Applied Science, who led the study. “Because we have quantified which journals are better, now we can definitively say that the journal in which one publishes provides reliable information about the paper’s quality. It is important to grasp a paper’s quality right away.”

Amaral, Michael J. Stringer, lead author of the paper and a graduate student in Amaral’s research group, and Marta Sales-Pardo, co-author and a postdoctoral fellow, developed methods to look at the enormous amount of published papers and to make sense of them. For each of the 2,267 journals, they charted the citations each paper received across a certain span of years and then developed a model of that data, which allowed the researchers to compare journals.

The researchers’ model produced bell curves for the distribution of “quality” of the papers published in each journal. For each field, all the bell curves for the journals then were compared, which resulted in the journal rankings. The field of ecology, for example, had 36 journals, with Ecology ranked highest and Natural History ranked lowest.

“The higher a journal is ranked, the higher the probability of finding a high-impact paper published in that journal,” said Amaral.

Amaral and his team found that the time scale for a published paper’s complete accumulation of citations -- a gauge for determining the full impact of the paper -- can range from less than one year to 26 years, depending on the journal. Using their new method, the Northwestern researchers can estimate the total number of citations a paper in a specific journal will get in the future and thus determine -- right now -- the paper’s likely impact in its field. This is the kind of information university administrators and funding agencies should find helpful when they are evaluating faculty members for tenure and researchers for grant awards.

“This study is just one example of how large datasets are allowing us to gain insight about systems that we could only speculate about before,” said Stringer. “Understanding how we use information and how it spreads is an important and interesting question. The most surprising thing to me about our study is that the data seem to suggest that the citation patterns in journals are actually simpler than we would have expected.”

The PLoS ONE paper is titled “Effectiveness of Journal Ranking Schemes as a Tool for Locating Information.” Upon publication, the paper will be available at http://www.plosone.org/doi/pone.0001683 .

Source: Northwestern University

Related stories:

Garlic chemical tablet treats diabetes I and II orally
(PhysOrg.com) -- A drug based on a chemical found in garlic can treat diabetes types I and II when taken as a tablet, a study in the new Royal Society of Chemistry journal Metallomics says.
Methamphetamine abuse linked to underage sex, smoking and drinking
Teens who have never done drugs, but engage in other risky behaviours such as drinking, smoking and being sexually active, are more likely to use crystal meth, medical researchers at the University of Alberta have concluded. Among teens already doing other drugs, those with unstable family environments are most likely to do crystal meth, found the research team led by Dr. Terry Klassen, a professor in the Department of Pediatrics in the Faculty of Medicine & Dentistry.
New laser method reproduces art masterworks to protein patterns
Canadian researchers have created a new protein patterning technique that's enabled them to reproduce complex cellular environments and a miniature version of a masterpiece painting. According to a new study published in the journal Lab on a Chip, scientists from Université de Montréal, the Maisonneuve-Rosemont Hospital Research Centre, McGill University and the Montreal Neurological Institute have developed a laser technology that can mimic the protein patterns that surround cells in vivo and that could lead to great advances in neuroscience.
Battling bacteria in the blood: Researchers tackle deadly infections
It's a leading cause of death, but no one knows for sure how and why it happens. It's a major source of health care costs, adding days or weeks to the hospital stays and lost work time of millions of people. But no one fully understands how best to fight it.
OHSU finds association between Epstein-Barr virus, inflammatory diseases of the mouth
Researchers at Oregon Health & Science University's School of Dentistry have found that a significant percentage of dental patients with the inflammatory diseases irreversible pulpitis and apical periodontitis also have the Epstein-Barr virus. The Epstein-Barr virus is an important human pathogen found in more than 90 percent of the world population. It is associated with many diseases, including infectious mononucleosis, malignant lymphomas, and naspharyngeal carcinoma.
New findings on the role of inflammation in prevention of coronary heart disease
This year, about 450,000 Americans will die of coronary heart disease – the leading cause of death for both men and women. Although we have made great strides in preventing and treating heart disease, we continue to explore the complex mechanisms involved in cardiovascular disease, and we are eager to refine risk assessment tools and preventive strategies to reduce the incidence of heart attack and stroke.
Researchers: Strengthen restrictions on off-label promotion by pharmaceutical companies
Researchers are asking for tougher penalties and fines for pharmaceutical companies that market drugs for "off label" promotion, according to a study published in the October 28 issue of the open access journal PLoS Medicine.
Psychological study reveals that red enhances men's attraction to women
(PhysOrg.com) -- A groundbreaking study by two University of Rochester psychologists to be published online Oct. 28 by the Journal of Personality and Social Psychology adds color—literally and figuratively—to the age-old question of what attracts men to women.

News discussion:

General Science news

[Home]   [Full version]