Skip to main content
Premium Trial:

Request an Annual Quote

Attention-Grabbing But Not Reproducible

Research findings that turn out to not be replicable are more likely to be cited than reproducible work, possibly because findings are splashier, the Guardian reports.

Concerns about reproducibility have been around for years. Researchers at Amgen announced they were unable to reproduce the findings of 47 of the 53 landmark cancer papers they tried to replicate, and published data on three attempts in 2016. The year before, the Open Science Collaboration reported that it could only reproduce about half the 100 major psychology studies it attempted to replicate.

In a new analysis appearing in Science Advances, a University of California, San Diego-led team examined the effort by the Open Science Collaboration as well as two other replication efforts in the social sciences to look whether those failed replication attempts had any influence on papers' citations. They found that papers whose results could not be reproduced were more likely to be cited — garnering about 153 more citations in the study period than others — and that most of the subsequent citations did not mention the failed replication.

"We presume that science is self-correcting," the University of Virginia's Brian Nosek, who runs the Open Science Collaboration, tells the Guardian, adding that "if more replicable findings are less likely to be cited, it could suggest that science isn’t just failing to self-correct; it might be going in the wrong direction."

The Scan

ChatGPT Does As Well As Humans Answering Genetics Questions, Study Finds

Researchers in the European Journal of Human Genetics had ChatGPT answer genetics-related questions, finding it was about 68 percent accurate, but sometimes gave different answers to the same question.

Sequencing Analysis Examines Gene Regulatory Networks of Honeybee Soldier, Forager Brains

Researchers in Nature Ecology & Evolution find gene regulatory network differences between soldiers and foragers, suggesting bees can take on either role.

Analysis of Ashkenazi Jewish Cohort Uncovers New Genetic Loci Linked to Alzheimer's Disease

The study in Alzheimer's & Dementia highlighted known genes, but also novel ones with biological ties to Alzheimer's disease.

Tara Pacific Expedition Project Team Finds High Diversity Within Coral Reef Microbiome

In papers appearing in Nature Communications and elsewhere, the team reports on findings from the two-year excursion examining coral reefs.