Skip to main content
Premium Trial:

Request an Annual Quote

ChatGPT Does As Well As Humans Answering Genetics Questions, Study Finds

ChatGPT did as well as human respondents on multiple-choice questions related to genetics, though sometimes it gave different answers to the same question when asked it more than once, a new study in the European Journal of Human Genetics reports. A pair of researchers from the National Human Genome Research Institute asked ChatGPT, a large-language model, 85 questions that had previously been posed via the social media platforms Twitter and Mastodon. All questions, they note, were posed in 2021 or later, as ChatGPT was trained using earlier data. Overall, ChatGPT was 68.2 percent accurate, while human respondents were 66.6 percent accurate, and both groups performed better on questions that were focused on memorization rather than critical thinking. But the researchers also found that when the same questions were posed to ChatGPT again, for 16.5 percent, it gave a different answer the second time around. The researchers write that they "were impressed with ChatGPT’s performance" but caution that it will give incorrect and inconsistent answers while supplying plausible-sounding explanations. "In medical or other high-stakes settings, this is concerning," they add.

The Scan

Positive Framing of Genetic Studies Can Spark Mistrust Among Underrepresented Groups

Researchers in Human Genetics and Genomics Advances report that how researchers describe genomic studies may alienate potential participants.

Small Study of Gene Editing to Treat Sickle Cell Disease

In a Novartis-sponsored study in the New England Journal of Medicine, researchers found that a CRISPR-Cas9-based treatment targeting promoters of genes encoding fetal hemoglobin could reduce disease symptoms.

Gut Microbiome Changes Appear in Infants Before They Develop Eczema, Study Finds

Researchers report in mSystems that infants experienced an enrichment in Clostridium sensu stricto 1 and Finegoldia and a depletion of Bacteroides before developing eczema.

Acute Myeloid Leukemia Treatment Specificity Enhanced With Stem Cell Editing

A study in Nature suggests epitope editing in donor stem cells prior to bone marrow transplants can stave off toxicity when targeting acute myeloid leukemia with immunotherapy.