![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
An ability-based guessing model is formulated and applied to several data sets regarding educational tests in language and in mathematics. The formulation of the model is such that the probability of a correct guess does not only depend on the item but also on the ability of the individual, weighted with a general discrimination parameter. By so doing, the possibility that the individual uses his or her ability to some extent for differentiating among responses while guessing is also considered. Some important properties of the model are described and compared with analogous properties of related models. After simulation studies, the model is applied to different data sets of the Chilean Sistema de Medición de la Calidad ń (SIMCE) tests of mathematics and language. The conclusion of this analysis seems relevant—namely, that the examinees use their ability to guess in the language test but not in the mathematics test.
|
Bechger, T. M. , Maris, G. , & Verstralen, H. H. M. (2005). The Nedelsky model for multiple choice items. In A. van der Ark , M. Croon , & K. Sijtsma (Eds.), New developments in categorical data analysis for the social and behavioral sciences. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Bock, R. D. (1972). Estimating item parameters and latent ability when responses are scored in two or more latent categories. Psychometrika, 37, 29-51. Google Scholar | Crossref | ISI | |
|
Birnbaum, A. (1968). Some latent trait models and their use in inferring an examinee’s ability. In F. M. Lord & M. R. Novick (Eds.), Statistical theories of mental test scores. London: Addison Wesley. Google Scholar | |
|
Cressie, N. , & Holland, P. W. (1983). Characterizing the manifest probabilities of latent trait models. Psychometrika, 48, 129-141. Google Scholar | Crossref | ISI | |
|
DeMars, C. (2001). Group differences based on IRT scores: Does the model matter? Educational and Psychological Measurement, 61, 60-70. Google Scholar | SAGE Journals | ISI | |
|
Divgi, D. R. (1986). Applications of unidimensional item response theory models to multidimensional data. Applied Psychological Measurement, 7, 189-199. Google Scholar | |
|
Embretson, S. E. , & Reise, S. P. (2000). Item response theory for psychologists. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Hambleton, R. K. , Swaminathan, H. , & Rogers, H. J. (1991). Fundamentals of item response theory. Newbury Park, CA: Sage. Google Scholar | |
|
Hutchinson, T. P. (1991). Ability, partial information and guessing: Statistical modelling applied to multiple-choice tests. Rundle Mall, South Australia: Rumsby Scientific Publishing. Google Scholar | |
|
Lord, F. M. (1983). Maximum likelihood estimation of item response parameters when some responses are omitted. Psychometrika, 48, 477-482. Google Scholar | Crossref | ISI | |
|
Maris, E. (1995). Psychometric latent response models. Psychometrika, 60, 523-547. Google Scholar | Crossref | ISI | |
|
Maris, G. (2002). Concerning the identification of the 3PL model (Measurement and Research Department Reports 2003-3). Arnhem, The Netherlands: CITO National Institute for Educational Measurement. Google Scholar | |
|
McDonald, R. P. (1989). Future directions for item response theory. International Journal of Educational Research, 13, 205-220. Google Scholar | Crossref | |
|
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Nedelsky, L. (1954). Absolute grading standards for objective tests. Educational and Psychological Measurement, 16, 159-176. Google Scholar | |
| Pelton, T.W.(2002). The accuracy of unidimensional measurement models in the presence of deviations for the underlying assumptions. Unpublished doctoral dissertation, Brigham Young University, Department of Instructional Psychology and Technology. Google Scholar | |
|
Samejima, F. (1973). A comment on Birbaum’s three parameter logistic model in the latent trait theory. Psychometrika, 38, 221-233. Google Scholar | Crossref | ISI | |
|
SAS Institute . (1999). SAS online doc (Version 8) [Software manual on CD-ROM]. Cary, NC: Author. Google Scholar | |
|
Thissen, D. , & Steinberg, L. (1984). A response model for multiple choice items. Psychometrika, 49, 501-519. Google Scholar | Crossref | ISI | |
|
Thissen, D. ,&Wainer, H. (Eds.).(2001). Item response models for items scored in two categories. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
van der Linden, W. J. , & Hambleton, R. K. (1997). Handbook of modern item response theory. New York: Springer Verlag. Google Scholar | Crossref | |
|
Weitzman, R. A. (1996). The Rasch model plus guessing. Educational and Psychological Measurement, 56, 779-790. Google Scholar | SAGE Journals | ISI | |
|
Yen, W. M. , Burket, G. R. , & Sykes, R. C. (1991). Nonunique solutions to the likelihood equation for the three parameter logistic model. Psychometrika, 56, 39-54. Google Scholar | Crossref | ISI |
