Abstract
A statistical test for detecting answer copying on multiple-choice items is presented. The test is based on the exact null distribution of the number of random matches between two test takers under the assumption that the response process follows a known response model. The null distribution can easily be generalized to the family of distributions of the number of random matches under the alternative hypothesis of answer copying. It is shown how this information can be used to calculate such features as the maximum, minimum, and expected values of the power function of the test. For the case of the nominal response model, the test is an alternative to the one based on statistic ω. The differences between the two tests are discussed and illustrated using empirical results.
References
| Angoff, WH The development of statistical indices for detecting cheatersJournal of the American Statistical Association1974694449 Google Scholar | Crossref | |
| Bock, RD Estimating item parameters and latent ability when responses are scored in two or more nominal categoriesPsychometrika197246443459 Google Scholar | Crossref | |
| Bock, RD van der Linden, WJ, Hambleton, RK The nominal categories modelHandbook of modern item response theory1997New YorkSpringer3349 Google Scholar | Crossref | |
| Frary, RB, Tideman, TN, Watts, TM Indices of cheating on multiple-choice testsJournal of Educational Statistics19776152165 Google Scholar | |
| Holland, PW Assessing unusual agreement between the incorrect answers of two examinees using the K-index: Statistical theory and empirical support1996Princeton, NJEducational Testing Service(Research Report RR 96-7) Google Scholar | |
| Lehmann, EL Testing statistical hypotheses19862nd edNew YorkSpringer Google Scholar | Crossref | |
| Lehmann, EL Elements of large-sample theory1999New YorkSpringer Google Scholar | Crossref | |
| Lewis, C, Thayer, DT The power of the K-index (or PMIR) to detect copying1998Princeton, NJEducational Testing Service(Research Report RR-98-49) Google Scholar | |
| Lord, FM Applications of item response theory to practical testing problems1980Hillsdale, NJErlbaum Google Scholar | |
| Lord, FM, Wingersky, MS Comparison of IRT true-score and equipercentile observed-score “equatings.”Applied Psychological Measurement19848452461 Google Scholar | SAGE Journals | |
| Sotaridona, LS, Meijer, RR Statistical properties of the K-index for detecting answer copyingJournal of Educational Measurement200239115132 Google Scholar | Crossref | |
| Sotaridona, LS, van der Linden, WJ, Meijer, RR Detecting answer copying using statistic kappaApplied Psychological Measurement200630412431 Google Scholar | SAGE Journals | |
| Thissen, D MULTILOG user's guide (Version 6)1991ChicagoScientific Software, Inc Google Scholar | |
| van der Linden, WJ Order properties in observed-score distributionssubmitted Google Scholar | |
| van der Linden, WJ, Hambleton, RK Handbook of modern item response theory1997NYSpringer-Verlag Google Scholar | Crossref | |
| van der Linden, WJ, Sotaridona, LS A statistical test for detecting answer copying on multiple-choice testsJournal of Educational Measurement200441361377 Google Scholar | Crossref | |
| Wollack, JA A nominal response model approach to detect answer copyingApplied Psychological Measurement199721307320 Google Scholar | SAGE Journals | |
| Wollack, JA, Cohen, AS Detection of answer copying with unknown item and trait parametersApplied Psychological Measurement199822144152 Google Scholar | SAGE Journals |
