This Article Full Text (OnlineFirst PDF) Alert me when this article is cited Alert me if a correction is posted Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via Scopus Google Scholar Articles by Hedges, L. V. Social Bookmarking                         What's this?

Adjusting a Significance Test for Clustering in Designs With Two Levels of Nesting

^* To whom correspondence should be addressed. E-mail: l-hedges{at}northwestern.edu.

	Abstract

A common mistake in analysis of cluster randomized experiments is to ignore the effect of clustering and analyze the data as if each treatment group were a simple random sample. This typically leads to an overstatement of the precision of results and anticonservative conclusions about precision and statistical significance of treatment effects. This article gives a simple adjustment to the t statistic that would be computed if clustering were (incorrectly) ignored in an experiment with two levels of nesting (e.g., classrooms and schools) where treatment assignment is made at the highest (e.g., school) level. The adjustment is a multiplicative factor depending on the number of clusters and subclusters, the cluster and subcluster sample sizes, and the cluster and subcluster intraclass correlations _S and _C. The adjusted t statistic has Student's t distribution with reduced degrees of freedom. The adjusted statistic reduces to the t statistic computed by ignoring clustering when _S = _C = 0. It reduces to the t statistic computed using cluster means when _S = 1. If _S and _C are between 0 and 1, the adjusted t statistic lies between these two and the degrees of freedom are in between those corresponding to these two extremes.

First published on August 5, 2009
Journal of Educational and Behavioral Statistics 2009, doi:10.3102/1076998609337251


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?