![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Polytomous attributes, particularly those defined as part of the test development process, can provide additional diagnostic information. The present research proposes the polytomous generalized deterministic inputs, noisy, “and” gate (pG-DINA) model to accommodate such attributes. The pG-DINA model allows input from substantive experts to specify attribute levels and is a general model that subsumes various reduced models. In addition to model formulation, the authors evaluate the viability of the proposed model by examining how well the model parameters can be estimated under various conditions, and compare its classification accuracy against that of the conventional G-DINA model with a modified classification rule. A real-data example is used to illustrate the application of the model in practice.
References
|
Akaike, H. (1974). A new look at the statistical identification model. IEEE Transactions on Automated Control, 19, 716-723. Google Scholar | Crossref | ISI | |
|
Chen, J., de la Torre, J., Zhang, Z. (in press). Relative and absolute fit evaluation in cognitive diagnosis modeling. Journal of Educational Measurement. Google Scholar | ISI | |
|
Deely, J. J., Lindley, D. V. (1981). Bayes Empirical Bayes. Journal of the American Statistical Association, 76, 833-841. Google Scholar | Crossref | ISI | |
|
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76, 179-199. Google Scholar | Crossref | ISI | |
|
de la Torre, J., Chen, J. (2011, April). Estimating different reduced cognitive diagnosis models using a general framework. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA. Google Scholar | |
|
de la Torre, J., Chiu, C.-Y. (2010, May). A general method of empirical Q-matrix validation using the G-DINA model discrimination index. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, CO. Google Scholar | |
|
de la Torre, J., Douglas, J. (2004). A higher-order latent trait model for cognitive diagnosis. Psychometrika, 69, 333-353. Google Scholar | Crossref | ISI | |
|
de la Torre, J., Lam, D., Rhoads, K., Tjoe, H. (2010, May). Measuring grade 8 proportional reasoning: The process of attribute identification and task development and validation. Paper presented at the annual meeting of the American Educational Research Association, Denver, CO. Google Scholar | |
|
DiBello, L., Roussos, L., Stout, W. (2007). Cognitive diagnosis Part I. In Rao, C. R., Sinharay, S. (Eds.), Handbook of statistics (Vol. 26): Psychometrics (pp. 979-1030). Amsterdam, Netherlands: Elsevier. Google Scholar | |
|
Doornik, J. A. (2003). Object-Oriented Matrix Programming using Ox (Version 3.1) [Computer software]. London, England: Timberlake Consultants Press. Google Scholar | |
|
Haberman, S. J., von Davier, M., Lee, Y.-H. (2008). Comparison of multidimensional item response models: Multivariate normal ability distributions versus multivariate polytomous ability distributions (ETS Research Report no. RR-05–16). Princeton, NJ: Educational Testing Service. Google Scholar | |
|
Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 333-352. Google Scholar | Crossref | ISI | |
|
Hartz, S. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality (Unpublished doctoral dissertation). University of Illinois at Urbana–Champaign. Google Scholar | |
|
Henson, R. A., Templin, J., Willse, J. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191-210. Google Scholar | Crossref | ISI | |
|
Junker, B. W., Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with non-parametric item response theory. Applied Psychological Measurement, 25, 258-272. Google Scholar | SAGE Journals | ISI | |
|
Karelitz, T. M. (2004). Ordered category attribute coding framework for cognitive assessments (Unpublished doctoral dissertation). University of Illinois at Urbana–Champaign. Google Scholar | |
|
Maris, E. (1999). Estimating multiple classification latent class models. Psychometrika, 64, 187-212. Google Scholar | Crossref | ISI | |
|
National Assessment Governing Board . (2008). Mathematics framework for the 2009 national assessment of educational progress. Washington, DC: Author. Google Scholar | |
|
National Council of Teachers of Mathematics . (2000). Principles and standards for school mathematics. Reston, VA: Author. Google Scholar | |
|
Schwarzer, G. (1976). Estimating the dimension of a model. Annals of Statistics, 6, 461-464. Google Scholar | Crossref | ISI | |
|
Tatsuoka, K. K. (1983). Rule space: An approach for dealing with misconceptions based on item response theory. Journal of Educational Measurement, 20, 345-354. Google Scholar | Crossref | ISI | |
|
Templin, J. (2004). Generalized linear proficiency models for cognitive diagnosis (Unpublished doctoral dissertation). University of Illinois at Urbana–Champaign. Google Scholar | |
|
Templin, J., Bradshaw, L. (in press). Measuring the reliability of diagnostic classification model examinee estimates. Journal of Classification. Google Scholar | ISI | |
|
Templin, J., Henson, R. A. (2006). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287-305. Google Scholar | Crossref | Medline | ISI | |
|
von Davier, M. (2005). A general diagnostic model applied to language testing data (ETS Research Report no. RR-05-16). Princeton, NJ: Educational Testing Service. Google Scholar | Crossref |
