![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
A Bayesian model formulation of the deterministic inputs, noisy “and” gate (DINA) model is presented. Gibbs sampling is employed to simulate from the joint posterior distribution of item guessing and slipping parameters, subject attribute parameters, and latent class probabilities. The procedure extends concepts in Béguin and Glas, Culpepper, and Sahu for estimating the guessing and slipping parameters in the three- and four-parameter normal-ogive models. The ability of the model to recover parameters is demonstrated in a simulation study. The technique is applied to a mental rotation test. The algorithm and vignettes are freely available to researchers as the “dina” R package.
References
|
Béguin, A. A., Glas, C. A. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541–561. Google Scholar | Crossref | |
|
Brooks, S. P., Gelman, A. (1998). General methods for monitoring convergence of iterative simulations. Journal of Computational and Graphical Statistics, 7, 434–455. Google Scholar | |
|
Chen, Y., Liu, J., Xu, G., Ying, Z. (2015). Statistical analysis of Q-matrix based diagnostic classification models. Journal of the American Statistical Association, 110, 850–866. Google Scholar | Crossref | Medline | |
|
Chiu, C. (2013). Statistical refinement of the Q-matrix in cognitive diagnosis. Applied Psychological Measurement, 37, 598–618. Google Scholar | SAGE Journals | |
|
Cowles, M. K. (1996). Accelerating Monte Carlo Markov chain convergence for cumulative-link generalized linear models. Statistics and Computing, 6, 101–111. Google Scholar | Crossref | |
|
Culpepper, S. A. (in press). Revisiting the 4-parameter item response model: Bayesian estimation and application. Psychometrika. Google Scholar | |
|
DeCarlo, L. T. (2012). Recognizing uncertainty in the Q-matrix via a Bayesian extension of the DINA model. Applied Psychological Measurement, 36, 447–468. Google Scholar | SAGE Journals | |
|
de la Torre, J. (2008). An empirically based method of Q-matrix validation for the DINA model: Development and applications. Journal of Educational Measurement, 45, 343–362. Google Scholar | Crossref | |
|
de la Torre, J. (2009a). DINA model and parameter estimation: A didactic. Journal of Educational and Behavioral Statistics, 34, 115–130. Google Scholar | SAGE Journals | |
|
de la Torre, J. (2009b). Estimation code for the G-DINA model. Paper presented at the meeting of the American Educational Research Association, San Diego, CA. Google Scholar | |
|
de la Torre, J. (2011). The generalized DINA model framework. Psychometrika, 76, 179–199. Google Scholar | Crossref | |
|
de la Torre, J., Douglas, J. A. (2004). Higher-order latent trait models for cognitive diagnosis. Psychometrika, 69, 333–353. Google Scholar | Crossref | |
|
de la Torre, J., Douglas, J. A. (2008). Model evaluation and multiple strategies in cognitive diagnosis: An analysis of fraction subtraction data. Psychometrika, 73, 595–624. Google Scholar | Crossref | |
|
Doignon, J.-P., Falmagne, J.-C. (1999). Knowledge spaces. Berlin, Heidelberg: Springer. Google Scholar | Crossref | |
|
Eddelbuettel, D. (2013). Seamless R and C++ integration with Rcpp. New York, NY: Springer. Google Scholar | Crossref | |
|
Eddelbuettel, D., François, R., Allaire, J., Chambers, J., Bates, D., Ushey, K. (2011). Rcpp: Seamless R and C++ integration. Journal of Statistical Software, 40, 1–18. Google Scholar | Crossref | |
|
Guay, R. (1976). Purdue spatial visualization test. West Lafayette, IN: Purdue University. Google Scholar | |
|
Haertel, E. H. (1989). Using restricted latent class models to map the skill structure of achievement items. Journal of Educational Measurement, 26, 301–321. Google Scholar | Crossref | |
|
Hartz, S. (2002). A Bayesian framework for the unified model for assessing cognitive abilities: Blending theory with practicality (Unpublished doctoral dissertation). University of Illinois at Urbana-Champaign, Champaign. Google Scholar | |
|
Henson, R. A., Templin, J. L., Willse, J. T. (2009). Defining a family of cognitive diagnosis models using log-linear models with latent variables. Psychometrika, 74, 191–210. Google Scholar | Crossref | |
|
Huebner, A., Wang, C. (2011). A note on comparing examinee classification methods for cognitive diagnosis models. Educational and Psychological Measurement, 71, 407–419. Google Scholar | SAGE Journals | |
|
Junker, B. W., Sijtsma, K. (2001). Cognitive assessment models with few assumptions, and connections with nonparametric item response theory. Applied Psychological Measurement, 25, 258–272. Google Scholar | SAGE Journals | |
|
Li, F. (2008). A modified higher-order DINA model for detecting differential item functioning and differential attribute functioning (Unpublished doctoral dissertation). University of Georgia, Athens. Google Scholar | |
|
Liu, J., Xu, G., Ying, Z. (2012). Data-driven learning of Q-matrix. Applied Psychological Measurement, 36, 548–564. Google Scholar | SAGE Journals | |
|
Liu, J., Xu, G., Ying, Z. (2013). Theory of the self-learning Q-matrix. Bernoulli, 19, 1790. Google Scholar | Crossref | Medline | |
|
Macready, G. B., Dayton, C. M. (1977). The use of probabilistic models in the assessment of mastery. Journal of Educational and Behavioral Statistics, 2, 99–120. Google Scholar | SAGE Journals | |
|
Maeda, Y., Yoon, S. (2013). A meta-analysis on gender differences in mental rotation ability measured by the Purdue Spatial Visualization Tests: Visualization of rotations (PSVT:R). Educational Psychology Review, 25, 69–94. Google Scholar | Crossref | |
|
Maeda, Y., Yoon, S. Y., Kim-Kang, G., Imbrie, P. (2013). Psychometric properties of the revised PSVT:R for measuring first year engineering students’ spatial ability. International Journal of Engineering Education, 29, 763–776. Google Scholar | |
|
Maris, E. (1999). Estimating multiple classification latent class models. Psychometrika, 64, 187–212. Google Scholar | Crossref | |
|
Pham-Gia, T., Turkkan, N. (1998). Distribution of the linear combination of two general beta variables and applications. Communications in Statistics-Theory and Methods, 27, 1851–1869. Google Scholar | Crossref | |
|
Plummer, M., Best, N., Cowles, K., Vines, K. (2006). CODA: Convergence diagnosis and output analysis for MCMC. R News, 6, 7–11. Retrieved from http://CRAN.R-project.org/doc/Rnews/ Google Scholar | |
|
Robert, C., Casella, G. (2009). Introducing Monte Carlo methods with R. New York, NY: Springer. Google Scholar | |
|
Roussos, L. A., DiBello, L. V., Stout, W., Hartz, S. M., Henson, R. A., Templin, J. L. (2007). The fusion model skills diagnosis system. In Leighton, J. P., Gierl, M. J. (Eds.), Cognitive diagnostic assessment for education: Theory and applications (pp. 275–318). Cambridge, England: Cambridge University Press. Google Scholar | Crossref | |
|
Roussos, L. A., Templin, J. L., Henson, R. A. (2007). Skills diagnosis using IRT-based latent class models. Journal of Educational Measurement, 44, 293–311. Google Scholar | Crossref | |
|
Rupp, A. A. (2009). Software for calibrating diagnostic classification models: An overview of the current state-of-the-art. Symposium conducted at the meeting of the American Educational Research Association, San Diego, CA. Google Scholar | |
|
Rupp, A. A., Templin, J. L. (2008). The effects of Q-matrix misspecification on parameter estimates and classification accuracy in the DINA model. Educational and Psychological Measurement, 68, 78–96. Google Scholar | SAGE Journals | |
|
Rupp, A. A., Templin, J. L., Henson, R. A. (2010). Diagnostic measurement: Theory, methods, and applications. New York, NY: Guilford Press. Google Scholar | |
|
Sahu, S. K. (2002). Bayesian estimation and model choice in item response models. Journal of Statistical Computation and Simulation, 72, 217–232. Google Scholar | Crossref | |
|
Templin, J. L. (2004). Generalized linear mixed proficiency models (Unpublished doctoral dissertation). University of Illinois at Urbana-Champaign, Champaign. Google Scholar | |
|
Templin, J. L., Henson, R. A. (2006a). A Bayesian method for incorporating uncertainty into Q-matrix estimation in skills assessment. Symposium conducted at the meeting of the American Educational Research Association, San Diego, CA. Google Scholar | |
|
Templin, J. L., Henson, R. A. (2006b). Measurement of psychological disorders using cognitive diagnosis models. Psychological Methods, 11, 287. Google Scholar | Crossref | Medline | |
|
Uttal, D. H., Meadow, N. G., Tipton, E., Hand, L. L., Alden, A. R., Warren, C., Newcombe, N. S. (2013). The malleability of spatial skills: A meta-analysis of training studies. Psychological Bulletin, 139, 352. Google Scholar | Crossref | Medline | |
|
von Davier, M. (2008). A general diagnostic model applied to language testing data. British Journal of Mathematical and Statistical Psychology, 61, 287–307. Google Scholar | Crossref | Medline | |
|
von Davier, M. (2014). The DINA model as a constrained general diagnostic model: Two variants of a model equivalency. British Journal of Mathematical and Statistical Psychology, 67, 49–71. Google Scholar | Crossref | Medline | |
|
Yoon, S. Y. (2011). Psychometric properties of the revised Purdue Spatial Visualization Tests: Visualization of rotations (the revised PSVT-R) (Unpublished doctoral dissertation). Purdue University, West Lafayette. Google Scholar |
