Every study, searchable

Many papers relate one National Health and Nutrition Examination Survey (NHANES) variable to one condition without correcting for multiple testing (Suchak et al. (2025)). We sampled 40 associations, reproduced each on its paper's cycles, and under a registered plan re-ran it on 2021–2023. There, 14 replicated as computed, and 10 with the survey design where papers ignored it. Most tests lacked power, but were every association true, 19 would replicate; counts this low are rare (0.047, or 0.011 with the design), so many effects are smaller than published or absent. In 36 papers the computation reproducing the estimate differs in some respect from the one described; as described, 6 fall outside the published interval.

• Published.Published: Of 40 associations sampled at random from those eligible among 341 papers that each relate one NHANES variable to one health condition (eligible meaning, among other rules, that its full text was open and that NHANES August 2021 to August 2023 could build its exposure, outcome, and population), 14 (35%; exact 95% confidence interval 21% to 52%, which treats the associations as independent) replicated in that cycle, meaning their estimate there has the published sign and a Benjamini-Hochberg-corrected p below 0.05, with each analysis computed as its paper's was. Of the 40, 15 were analyzed unweighted, ignoring the survey design, as their papers were; with those 15 fitted with the survey weights and design, as the plan also registered, 10 of the 40 replicated (25%; exact 95% confidence interval 13% to 41%).
• Published.Published: At an unadjusted two-sided alpha of 0.05, which bounds the power of the corrected replication decision from above, 13 of the 40 replication tests had at least 80% power to detect the published effect, taken as true, in the 2021 to 2023 cycle, and 10 of those replicated (77%; exact 95% confidence interval 46% to 95%); at the Bonferroni level of 0.05 over 40, which bounds it from below, 8 had that power, and 5 of them replicated. With the variance of the analyses re-run unweighted taken from the survey design, 13 tests had that power at the unadjusted level, 12 of them among the 13 above, and 9 of them replicated.
• Published.Published: On the analysis scale (log odds ratio or regression coefficient), the 2021 to 2023 effects are a median 0.77 times the published ones over all 40 associations (distribution-free 95% confidence interval 0.32 to 1.05) and 0.91 times (0.32 to 1.16) over the 13 informative ones; the intervals treat the associations as independent. The median is 0.53 over the 15 analyses re-run unweighted and 0.79 over the others; with the registered weighted fits in place of the unweighted ones, it is 0.85 (0.35 to 1.08).

12 more claims

Evidence that small fMRI studies overstate effects comes mostly from reported peaks, which are inflated by selection whatever the sample size. We asked the question with a whole-brain measure that has no peak selection. For each published (DOI-linked), group-level, unthresholded task-fMRI T or Z map on NeuroVault (Gorgolewski et al. 2015), we estimated the root-mean-square standardized effect over a fixed grey-matter mask from the mean squared statistic. We then regressed its log on log N with map-type, smoothing, upload-year and paradigm fixed effects plus a random intercept per collection. Everything was preregistered (prereg:f7ecdaf6…) on a frozen map list. After QC and de-duplication, 1245 maps from 200 collections were analysed. The slope was β = -0.101387 (CI -0.272087 to 0.069313), so the locked decision is inconclusive. There is no significant small-study inflation, and steep slopes are excluded. The data cannot rule out a modest slope at the preregistered boundary.

• Published, Reproduced.Published, Reproduced: Across 1,245 QC-passing, de-duplicated, published (DOI-linked) group-level unthresholded task-fMRI T/Z maps from 200 NeuroVault collections (N 10–1,369), the preregistered mixed model of log whole-brain rms standardized effect (grey-matter mask) on log N gives beta = -0.101387 (95% CI -0.272087 to 0.069313): no statistically significant small-study inflation of whole-brain effect sizes; slopes steeper than about -0.27 are excluded, but the preregistered refutation bound (-0.10) is not, so the locked decision is inconclusive.

Does maintaining normal tissue mechanics prevent cancer initiation? A focused evidence map separates the endpoints of 4 selected papers and reanalyzes an available tumor-count table. The selected contrasts occupy 4 classes, with 0 papers testing incident cancer after a mechanical intervention in humans. The table concerns already malignant cells: blocking-antibody pretreatment gives risk ratios of 0.4667 and 0.5 against its controls. These endpoints answer different questions; neither a smaller transplantation risk nor a human biomarker change establishes primary prevention. This is a bounded, exploratory source audit, not a systematic review or a new biological experiment.

• Published, Reproduced, Reviewed.Published, Reproduced, Reviewed: In a purposively selected four-paper evidence map, the coded contrasts occupy four distinct endpoint classes, only one paper starts its reprogramming program with normal primary cells, and none measures incident cancer after a mechanical intervention in humans, with all counts restricted to this selected set rather than the literature.
• Published, Reproduced, Reviewed.Published, Reproduced, Reviewed: Reanalysis of Weaver et al. (1997) Table II gives 7/16 tumor-bearing mice after blocking-antibody pretreatment of already malignant cells versus 15/16 untreated and 14/16 control-antibody mice, risk ratios 0.4667 and 0.5000, with two-sided Fisher p-values 0.005923 and 0.023333 (Holm-adjusted 0.011846 and 0.023333), while conservative simultaneous 95% risk-ratio intervals are 0.1612 to 1.1614 and 0.1625 to 1.3304 under independent-binomial sampling.

How many longitudinal observations support a species-resolved microbial compensation analysis in the public inflammatory-bowel-disease multi-omics dataset? A reproducible eligibility audit finds 277 candidate intervals after specimen matching and sequencing-depth filtering. Four broad enzyme annotations yield [6,6,4,0] eligible contributor-decline intervals, in the stated annotation order; only [1,1,0,0] also contain paired numeric calprotectin metadata. These counts describe the specified measurement design, not whether biological compensation succeeds or fails.

• Published, Reproduced, Reviewed.Published, Reproduced, Reviewed: Among 277 consecutive retained Crohn’s specimen intervals under the specified read-filtered, species-relative-abundance-decline and paired-transcript eligibility rules, EC 2.8.3.8, 2.7.2.7, 2.8.3.9 and 2.3.1.19 yield respectively 6, 6, 4 and 0 eligible intervals, of which respectively 1, 1, 0 and 0 also have agreeing numeric calprotectin metadata at both visits.

Can other microbes maintain butyrate-related transcription when a leading contributor declines? A preregistered audit of public IBDMDB profiles finds that the available pathway-level species assignments are too sparse for a reliable answer. Among 375 retained paired Crohn's samples from 52 participants, the primary pathway has positive community RNA in 205 samples but named-species RNA in only 25. The specified longitudinal analysis retains 6 sustained-decline episodes from 5 people. Every retained episode has zero reported RNA from the named alternatives throughout its observation window. These zeros do not distinguish undetected or unassigned transcription from biological failure of compensation.

• Published, Reproduced, Reviewed.Published, Reproduced, Reviewed: In the audited public IBDMDB HUMAnN3 pathway tables, 375 retained paired Crohn's samples from 52 participants contain named-species PWY-5676 RNA in only 25 of 205 samples with positive community pathway RNA, and the preregistered sustained-contributor-decline analysis yields six episodes from five participants with zero reported alternative-species RNA at all three visits, preventing this operational analysis from distinguishing biological compensation failure from unresolved transcription.