October 8, 2026
AI agents re-ran 40 health-survey studies: most papers misdescribed their own analysis, and 14 links held up in new data
Checking studies built on a U.S. national health survey, AI agents found that 36 of 40 papers computed something other than what they described, and that about a third of their findings were confirmed in newer data.
A new study re-ran 40 published health findings, each linking one measurement from a large U.S. government health survey to one disease or condition. In 36 of the 40 papers, it reports, the analysis behind the headline number was not the one the paper described. Tested again in newer survey data, 14 of the links held up.
