This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Benjamini, Y. Articles by Hochberg, Y. Search for Related Content Social Bookmarking                   What's this?

On the Adaptive Control of the False Discovery Rate in Multiple Testing With Independent Statistics

Tel Aviv University

Yosef Hochberg

Tel Aviv University

A new approach to problems of multiple significance testing was presented in Benjamini and Hochberg (1995), which calls for controlling the expected ratio of the number of erroneous rejections to the number of rejections–the False Discovery Rate (FDR). The procedure given there was shown to control the FDR for independent test statistics. When some of the hypotheses are in fact false, that procedure is too conservative. We present here an adaptive procedure, where the number of true null hypotheses is estimated first as in Hochberg and Benjamini (1990), and this estimate is used in the procedure of Benjamini and Hochberg (1995). The result is still a simple stepwise procedure, to which we also give a graphical companion. The new procedure is used in several examples drawn from educational and behavioral studies, addressing problems in multi-center studies, subset analysis and meta-analysis. The examples vary in the number of hypotheses tested, and the implication of the new procedure on the conclusions. In a large simulation study of independent test statistics the adaptive procedure is shown to control the FDR and have substantially better power than the previously suggested FDR controlling method, which by itself is more powerful than the traditional family wise error-rate controlling methods. In cases where most of the tested hypotheses are far from being true there is hardly any penalty due to the simultaneous testing of many hypotheses.

Key Words: bonferroni type procedures • meta-analysis • multi-center • multiple comparison procedures • p-values • stepwise procedures • subset analysis

Journal of Educational and Behavioral Statistics, Vol. 25, No. 1, 60-83 (2000)
DOI: 10.3102/10769986025001060


CiteULike    Connotea    Del.icio.us    Digg    Reddit    Technorati    What's this?

This article has been cited by other articles:

				G. J. Reid, P. H. Seidelin, W. J. Kop, M. J. Irvine, B. H. Strauss, R. P. Nolan, H. K. Lau, and E. L. Yeo Mental Stress-Induced Platelet Activation Among Patients With Coronary Artery Disease Psychosom Med, May 1, 2009; 71(4): 438 - 445. [Abstract] [Full Text] [PDF]