Every study, searchable

How much false-positive error can arise when a nominally exact test treats clustered subsamples as independent? An exact finite benchmark enumerates null distributions for 75 balanced designs. In the selected beta-binomial design, the cell-level Fisher test rejects with probability 0.21567065919813758, compared with 0.0436374106894531 for a test using the known clustered null. With a single observation per donor, the Fisher rejection probability is 0.021484375. These are exact probabilities conditional on the specified toy model. They demonstrate calibration failure from ignoring dependence, without evaluating real biological pipelines or ranking practical alternatives.

• Published, Reproduced, Reviewed.Published, Reproduced, Reviewed: For the specified null of five independent donors per arm and twenty conditionally independent Bernoulli observations per donor with latent Beta(5,5) success probabilities (within-donor correlation 1/11), the cell-level two-sided probability-ordering Fisher test at nominal alpha=0.05 rejects with exact-model probability 0.215670659198, versus 0.043637410689 for the known-clustered-null absolute-difference-tail oracle. The finite 75-design grid has 31 cell-level Fisher probabilities above nominal, while all 75 oracle probabilities and all 15 independent-observation controls are at or below nominal. These are conditional toy-model calibration results, not evaluations of real biological analysis methods.

Can unknown overlap between adverse-event terms change the direction of published composite-event estimates? We reconstructed the frozen registry comparisons and calculated every possible range of distinct affected participants consistent with the selected term counts. For adult serious suicidal behaviour, the resulting Mantel–Haenszel risk-ratio bounds are 1.712 to 2.1962; for adult serious suicidality, 1.2154 to 1.8476. The corresponding pediatric bounds are 1.0045 to 1.4773 and 1.8144 to 2.8091. All remain above the null. Unknown overlap therefore changes the magnitude but cannot reverse these fixed-data point estimates under the source's cohort and outcome definitions. These are identification bounds, not confidence intervals or estimates of causal treatment effects.

• Published, Reproduced.Published, Reproduced: In the frozen antidepressant registry dataset, conditional on source cohort selection, denominators, term coding, and absent-term imputation, sharp Mantel-Haenszel risk-ratio bounds relative to selected within-group event-count marginals are 1.7120261533 to 2.1961879882 for adult serious suicidal behaviour, 1.2154409158 to 1.8475901940 for adult serious suicidality, 1.0045047792 to 1.4773331886 for pediatric serious behaviour, and 1.8144436696 to 2.8090979871 for pediatric serious suicidality. Thus unknown participant overlap alone cannot reverse the direction of these fixed-data point estimates; these are not confidence intervals or causal treatment effects.