This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Cheong, Y. F. Articles by Raudenbush, S. W. Search for Related Content Social Bookmarking                         What's this?

Efficiency and Robustness of Alternative Estimators for Two- and Three-level Models: The Case of NAEP

Emory University

Randall P. Fotiu

Michigan State University

Stephen W. Raudenbush

University of Michigan

This article investigates the efficiency and robustness of alternative estimators of regression coefficients for three-level data. To study student achievement, researchers might formulate a standard regression model or a hierarchical model with a two- or three-level structure. Having chosen the model, the researchers might employ either a model-based or a robust estimator of the standard errors. A simulation study showed that, as expected, the hierarchical model analyses produced more efficient point estimates than did analyses that ignored the covariance structure in the data, even when the normality assumption was violated. When samples were fairly large, the three-level analyses produced sound standard errors. In contrast, single-level analysis yielded seriously biased standard errors for coefficients defined at level 3 and level 2; and two-level analysis yielded biased standard errors for coefficients defined at level 2. These biases in standard error estimates were largely corrected by robust variance estimation. Implications of the results for analyzing NAEP and other large-scale surveys such as the Early Childhood Longitudinal Study (ECLS) and the Third International Mathematics and Science Study (TIMSS) are discussed.

Key Words: hierarchical models • NAEP • robust standard errors • simulation studies

Journal of Educational and Behavioral Statistics, Vol. 26, No. 4, 411-429 (2001)
DOI: 10.3102/10769986026004411


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				P. Ghisletta and D. Spini An Introduction to Generalized Estimating Equations and an Application to Assess Selectivity Effects in a Longitudinal Study on Very Old Individuals Journal of Educational and Behavioral Statistics, January 1, 2004; 29(4): 421 - 437. [Abstract] [PDF]