This Article Full Text (PDF) References Alert me when this article is cited Alert me if a correction is posted Citation Map Services Email this article to a friend Similar articles in this journal Alert me to new issues of the journal Add to Saved Citations Download to citation manager Request Permissions Request Reprints Add to My Marked Citations Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Citing Articles via Scopus Google Scholar Articles by van Krimpen-Stoop, E. M.L.A. Articles by Meijer, R. R. Search for Related Content Social Bookmarking                         What's this?

CUSUM-Based Person-Fit Statistics for Adaptive Testing

University of Twente

Item scores that do not fit an assumed item response theory model may cause the latent trait value to be inaccurately estimated. Several person-fit statistics for detecting nonfitting score patterns for paper-and-pencil tests have been proposed. In the context of computerized adaptive tests (CAT), the use of person-fit analysis has hardly been explored. Because it has been shown that the distribution of existing person-fit statistics is not applicable in a CAT, in this study new person-fit statistics are proposed and critical values for these statistics are derived from existing statistical theory. Statistics are proposed that are sensitive to runs of correct or incorrect item scores and are based on all items administered in a CAT or based on subsets of items, using observed and expected item scores and using cumulative sum (CUSUM) procedures. The theoretical and empirical distributions of the statistics are compared and detection rates are investigated. Results showed that the nominal and empirical Type I error rates were comparable for CUSUM procedures when the number of items in each subset and the number of measurement points were not too small. Detection rates of CUSUM procedures were superior to other fit statis­tics. Applications of the statistics are discussed.

Key Words: appropriateness measurement • computer adaptive testing • cumulative sum • item response theory • person fit

Journal of Educational and Behavioral Statistics, Vol. 26, No. 2, 199-217 (2001)
DOI: 10.3102/10769986026002199


CiteULike    Complore    Connotea    Del.icio.us    Digg    Reddit    Technorati    Twitter    What's this?

This article has been cited by other articles:

				R. D. Armstrong and M. Shi A Parametric Cumulative Sum Statistic for Person Fit Applied Psychological Measurement, July 1, 2009; 33(5): 391 - 410. [Abstract] [PDF]