This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Olejnik, S. Articles by Huberty, C. J. Search for Related Content Social Bookmarking                         What's this?

Multiple Testing and Statistical Power With Modified Bonferroni Procedures

University of Georgia

Jianmin Li

TRW

Suchada Supattathum

King Mongleut Institute of Technology

Carl J. Huberty

University of Georgia

The difference in statistical power between the original Bonferroni and five modified Bonferroni procedures that control the overall Type I error rate is examined in the context of a correlation matrix where multiple null hypotheses, H₀: _ij = 0 for all i j, are tested. Using 50 real correlation matrices reported in educational and psychological journals, a difference in the number of hypotheses rejected of less than 4% was observed among the procedures. When simulated data were used, very small differences were found among the six procedures in detecting at least one true relationship, but in detecting all true relationships the power of the modified Bonferroni procedures exceeded that of the original Bonferroni procedure by at least .18 and by as much as .55 when all null hypotheses were false. The power difference decreased as the number of true relationships decreased. Power differences obtained for the average power were of a much smaller magnitude but still favored the modified Bonferroni procedures. For the five modified Bonferroni procedures, power differences less than .05 were typically observed; the Holm procedure had the lowest power, and the Rom procedure had the highest.

Key Words: Bonferroni • familywise error rate • multiple testing

Journal of Educational and Behavioral Statistics, Vol. 22, No. 4, 389-406 (1997)
DOI: 10.3102/10769986022004389


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				V. J. Boucher Acoustic Correlates of Fatigue in Laryngeal Muscles: Findings for a Criterion-Based Prevention of Acquired Voice Pathologies J Speech Lang Hear Res, October 1, 2008; 51(5): 1161 - 1170. [Abstract] [Full Text] [PDF]