Split-Sample Strategies for Avoiding False Discoveries

Split-Sample Strategies for Avoiding False Discoveries

Neyman Seminar
Oct 11, 2017, 04:00 PM - 05:00 PM | 1011 Evans Hall | Happening As Scheduled
Michael Anderson, University of California, Berkeley
Preanalysis plans (PAPs) have become an important tool for limiting false discoveries in field experiments. We evaluate the properties of an alternate approach which splits the data into two samples: An exploratory sample and a confirmation sample. When hypotheses are homogeneous, we describe an improved split-sample approach that achieves 90% of the rejections of the optimal PAP without...