Skip to main content

Rethinking Reproducibility

Officials at the National Institutes of Health are contemplating changes to grant applications that would require researchers to validate some experimental procedures and results, "such as the foundational work that leads to costly clinical trials," Nature News reports this week.

These measures are intended to combat the reproducibility problem that plagues many NIH-funded experiments and to help ensure that the agency's tight research budget is spent on "verifiable science," the article states.

Among other things, officials are considering "modifying peer review to bring greater scrutiny to the work a grant application is based on — perhaps just for applications that are likely to lead to clinical trials" as well as requiring that "independent labs validate the results of important preclinical studies as a condition of receiving grant funding," Nature reports.

"There is certainly sufficient information now that the NIH feels it’s appropriate to look at this at a central-agency level," Lawrence Tabak, the agency’s principal deputy director, tells Nature. He and other senior NIH officials are currently "assessing input gathered from the directors of the agency’s 27 institutes and centers" prior to meeting with NIH director Francis Collins, "who will decide what steps to take," Nature adds.

Reactions to the possibility of a validation requirement are mixed. "It’s a disaster," Peter Sorger, a systems biologist at Harvard Medical School, tells Nature arguing that "frontier science often relies on ideas, tools, and protocols that do not exist in run-of-the-mill labs, let alone in companies that have been contracted to perform verification."

Others, such as, Elizabeth Iorns, chief executive of Science Exchange, a company in Palo Alto, California, say that requiring validation "either through random audits or selecting the highest-profile papers" would be a good idea. In fact, her company has launched a program with a German reagent vendor to independently validate research antibodies.

The Scan

Rise of B.1.617.2 in the UK

According to the Guardian, UK officials expect the B.1.617.2 variant to soon be the dominant version of SARS-CoV-2 there.

Anne Schuchat to Retire

Anne Schuchat is retiring after more than 30 years at the US Centers for Disease Control and Prevention, Politico reports.

US to Share More Vaccines

CNN reports that the US will share 20 million doses of the Moderna, Pfizer, and Johnson & Johnson SARS-CoV-2 vaccines with other countries.

PNAS Papers on Gene Therapy Platform, Aspergillus Metabolome, Undernutrition Model Microbiome

In PNAS this week: approach to deliver protein-based treatments to cells, pan-secondary metabolome of Aspergillus, and more.