This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by Raudenbush, S. W. Articles by Willms, J. Search for Related Content Social Bookmarking                         What's this?

The Estimation of School Effects

Michigan State University

JDouglas Willms

University of New Brunswick

The increasing public demand to hold schools accountable for their effects on student outcomes lends urgency to the task of clarifying statistical issues pertaining to studies of school effects. This article considers the specification and estimation of school effects, the variability of effects across schools, and the proportion of variation in student outcomes attributable to differences in school context and practice. We present a statistical model that defines two different types of school effect: one appropriate for parents choosing schools for their children, the second for agencies evaluating school practice. Studies of both types of effect are viewed as quasi-experiments posing formidable obstacles to valid causal inference. A multilevel decomposition of variance within and between schools has important and perhaps counterintuitive implications for school evaluation. The potential for unbiased estimation depends on the type of effect under consideration because the two types of school effect have markedly different data requirements. Commonly used estimators of each effect are shown to be biased and, in some cases, inconsistent. Analyses of survey data from Scotland illustrate the recommended techniques. We conclude with a brief discussion of the role of school evaluation in a broader agenda of research in support of school improvement.

Key Words: multilevel data • hierarchical linear models • school effects • school evaluation • causal inference

Journal of Educational and Behavioral Statistics, Vol. 20, No. 4, 307-335 (1995)
DOI: 10.3102/10769986020004307


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				L. Brannstrom Making Their Mark: The Effects of Neighbourhood and Upper Secondary School on Educational Achievement Eur. Sociol. Rev., September 1, 2008; 24(4): 463 - 478. [Abstract] [Full Text] [PDF]

				G. J. Palardy and R. W. Rumberger Teacher Effectiveness in First Grade: The Importance of Background Qualifications, Attitudes, and Instructional Practices for Student Learning Educational Evaluation and Policy Analysis, June 1, 2008; 30(2): 111 - 140. [Abstract] [Full Text] [PDF]

				O. Paccagnella Centering or Not Centering in Multilevel Models? The Role of the Group Mean and the Assessment of Group Effects Eval Rev, February 1, 2006; 30(1): 66 - 85. [Abstract] [PDF]

				D. Ballou, W. Sanders, and P. Wright Controlling for Student Background in Value-Added Assessment of Teachers Journal of Educational and Behavioral Statistics, January 1, 2004; 29(1): 37 - 65. [Abstract] [PDF]

				D. F. McCaffrey, J. R. Lockwood, D. Koretz, T. A. Louis, and L. Hamilton Models for Value-Added Modeling of Teacher Effects Journal of Educational and Behavioral Statistics, January 1, 2004; 29(1): 67 - 101. [Abstract] [PDF]

				S. W. Raudenbush What Are Value-Added Models Estimating and What Does This Imply for Statistical Practice? Journal of Educational and Behavioral Statistics, January 1, 2004; 29(1): 121 - 129. [PDF]

				H. S. Bloom Using "Short" Interrupted Time-Series Analysis To Measure The Impacts Of Whole-School Reforms: With Applications to a Study of Accelerated Schools Eval Rev, February 1, 2003; 27(1): 3 - 49. [Abstract] [PDF]

				X. Ma and J. D. Willms Dropping Out of Advanced Mathematics: How Much Do Students and Schools Contribute to the Problem? Educational Evaluation and Policy Analysis, January 1, 1999; 21(4): 365 - 383. [Abstract] [PDF]

				R. M. Kasim and S. W. Raudenbush Application of Gibbs Sampling to Nested Variance Components Models With Heterogeneous Within-Group Variance Journal of Educational and Behavioral Statistics, January 1, 1998; 23(2): 93 - 116. [Abstract] [PDF]

				R. B. Burns and D. A. Mason Class Formation and Composition in Elementary Schools American Educational Research Journal, January 1, 1998; 35(4): 739 - 772. [Abstract] [PDF]

				S. W. Raudenbush, R. P. Fotiu, and Y. F. Cheong Inequality of Access to Educational Resources: A National Report Card for Eighth-Grade Math Educational Evaluation and Policy Analysis, January 1, 1998; 20(4): 253 - 267. [Abstract] [PDF]

				H. Wenglinsky Finance Equalization and Within-School Equity: The Relationship Between Education Spending and the Social Distribution of Achievement Educational Evaluation and Policy Analysis, January 1, 1998; 20(4): 269 - 283. [Abstract] [PDF]

				V. E. Lee, R. G. Croninger, and J. B. Smith Course-Taking, Equity, and Mathematics Learning: Testing the Constrained Curriculum Hypothesis in U.S. Secondary Schools Educational Evaluation and Policy Analysis, January 1, 1997; 19(2): 99 - 121. [Abstract] [PDF]

				D. A. Mason and R. B. Burns "Simply No Worse and Simply No Better" May Simply Be Wrong: A Critique of Veenman's Conclusion About Multigrade Classes Review of Educational Research, January 1, 1996; 66(3): 307 - 322. [Abstract] [PDF]