In handling fraudulent stem-cell research articles, journal editors went above and beyond existing procedures to try and verify the findings, but in today's competitive publishing environment, more stringent, less trusting safeguards are now essential, an independent committee has concluded.
Although editors at the journal
Science "made a serious effort substantially greater than that for most papers" to scrutinize research submitted by Woo Suk Hwang, the committee found, "the cachet of publishing in
Science can be an incentive not to follow the rules."
The journal's current procedures, based on an assumption of trust in the basic integrity of the vast majority of researchers, must be revised to acknowledge the risk of misleading, distorted, or fraudulent findings, the committee concluded.
The six-person committee including leading stem-cell researchers, three members of
Science's Senior Editorial Board, and an editor from
Nature evaluated the handling of two research articles by Hwang and colleagues:
-- "Evidence of a Pluripotent Human Embryonic Stem Cell Line Derived from a Cloned Blastocyst" (12 February 2004,
Science Express; 12 March 2004,
Science); and
-- "Patient-Specific Embryonic Stem Cells Derived from Human SCNT Blastocysts" (19 May 2005,
Science Express; 17 June 2005,
Science).
After examining the original submissions, reviews, revisions, comments, editors' notes, and additional information related to both fraudulent papers, the committee proposed the development of a procedure for identifying "high-risk" papers. Research in the high-risk category might include, for example, counter-intuitive findings, and research likely to generate intense media or political interest. High-risk submissions should then be subjected to an additional level of scrutiny, such as more comprehensive access to primary data, the committee said.
Even so, the committee emphasized: "No realistic set of procedures can be completely immune to deliberate fraud."
Science Editor-in-Chief Donald Kennedy commended the committee's evaluation. "We are committed to accepting the major findings of the report, and to making our new procedures clear to authors, reviewers, and readers as they are developed," Kennedy said in an editorial response scheduled to appear in the 1 December issue of
Science. "In responding to the recommendations, we are now moving to develop criteria for the 'risk assessment' template described in the Report which should allow us to apply especially stringent attention as needed." In the future, he explained, "Authors may be asked to disclose information about their individual roles in the work and, on occasion, to supply original data, images, or materials when questions are raised."
Kennedy noted further that implementing more stringent safeguards will significantly change the traditionally collegial nature of scholarly publishing, as editors are required to make more demands of potential authors.
"Clearly, we're moving into a new world in which public trust in the scientific enterprise has been a very serious casualty," Kennedy said in an interview. "There are many more incentives today for over-claiming results, or even for falsifying results, and scientific publishers therefore must develop more stringent new risk-assessment procedures for further scrutinizing high-risk papers. We are in complete agreement with the committee on this point, and we will take steps to comply promptly with the committee's recommendations."
In summary, the committee recommended the following changes in journal procedures:
-- Develop a procedure for identifying "high-risk papers," based on criteria such as counter-intuitive findings, potential media interest, political concerns, and other factors, then exercise special scrutiny.
-- Establish a method to clarify the contributions and roles of all authors and co-authors.
-- Publish more primary data within supporting material, to ensure that all relevant information is available to reviewers and readers.
-- Collaborate with other high-profile journals such as
Nature to establish common standards.
Given the large volume of papers handled by
Science editors the journal received roughly 12,000 submissions in 2005, and accepted about eight percent of those papers following peer review committee members concluded that it would be "essentially impossible" to heighten the level of scrutiny for each paper. But, a template for pinpointing risky submissions might help deter the submission of flawed or intentionally deceptive work, they said.
The committee also proposed audits to ensure proper handling of selected papers, as well as others chosen at random. The journal further was urged to reevaluate policies concerning the treatment of digital images and biological samples, as well as "penalties for authors who knowingly submit distorted or faulty work."
"In the immediate future, examples [of high-risk papers] will likely come from the areas of climate change, human health, and particular issues in commercial biomedicine and nanotechnology," the committee wrote. "Progress in science depends on breakthroughs and in taking risks, both in research and in publishing. Nevertheless, it is essential to develop a process by which papers that have the likelihood of attracting attention are examined particularly closely for errors, misrepresentation, deception, outright fraud. This examination should include especially high standards of providing primary data, a clear understanding of all of the authors' and coauthors' contributions to the paper and a careful examination of data presented in the papers."
Hwang's 2004 paper purported to describe, for the development of versatile "pluripotent" human embryonic stem cells, potentially capable of becoming any cell in the body, from a cloned human blastocyst. The 2005 paper purported to describe the isolation of the first human embryonic stem cell lines specifically tailored to match the nuclear DNA of patients, both male and female of various ages, suffering from disease or spinal cord injury.
On 12 January 2006,
Science published an editorial retraction of both papers. The full retraction can be found online at
http://www.sciencemag.org/cgi/content/abstract/1124926v1.
The committee assigned to assess
Science's handling of the papers was chaired by John I. Brauman, J.G. Jackson C.J. Wood Professor of Chemistry at Stanford University, who is chair of the Senior Editorial Board for
Science. Other committee members included John Gearhart; Douglas Melton; Linda Miller; Linda Partridge; and George Whitesides.
Source: American Association for the Advancement of Science
Related stories:
Editors' leadership role impacts on quality of biomedical research journals
The factors allowing a journal to achieve high quality are not fully understood, but good editorial practices such as accurate and author-helpful peer review and in-house editing are thought to be important. Now, a new study provides quantitative evidence that another aspect of good editorial practice editors' expectations that articles adhere to international standards for quality reporting is strongly related to journal quality. The research is published July 2 in the online, open-access journal
PLoS ONE.
Physicist John Wheeler, Einstein collaborator, dead at 96
US physicist John Wheeler, one of Albert Einstein's last collaborators who helped build the atomic bomb and gave black holes their name, died at the weekend, his family said. He was 96.
Clever irrigation could save dying river red gums
Dying river red gums along the River Murray in South Australia could be saved with clever irrigation technology, according to University of Adelaide researcher Anne Jensen.
Lighting up the powerful global smoking lobby
Global public health efforts to reduce smoking are at odds with the interests of the tobacco industry. According to a case study published in the online open access journal
Globalization and Health, competing tobacco companies co-operate via a global network of national and regional manufacturing associations to undermine public health measures to counter smoking.
Universities' alternative to Google launched
An internet search engine rivalling the multimillion pound Google is to be launched at the end of January by The University of Manchester's national data centre Mimas.
Fish farms drive wild salmon populations toward extinction
A study appearing in the December 14 issue of the journal
Science shows, for the first time, that parasitic sea lice infestations caused by salmon farms are driving nearby populations of wild salmon toward extinction. The results show that the affected pink salmon populations have been rapidly declining for four years. The scientists expect a 99% collapse in another four years, or two salmon generations, if the infestations continue.
Lost in the middle: author order matters, new paper says
Rare is the scientific paper today written by a single author. With research being conducted by teams of scientists, most studies now boast a half-dozen or so authors. According to a new study led by a scientist at the Oklahoma Medical Research Foundation, credit for those papers is far from evenly distributed, and the order in which the authors names are listed makes a big difference.
Rice expert calls for coordination in nanotechnology research
Nanotechnology holds great promise for the future of cancer therapy and water treatment, but concerns about the safety of nanoproducts may limit these important technological developments, Vicki Colvin said today in comments to the U.S. House Committee on Science and Technology.