Computerized Adaptive Testing: Overview and Introduction
Abstract
Use of computerized adaptive testing (CAT) has increased substantially since it was first formulated in the 1970s. This paper provides an overview of CAT and introduces the contributions to this Special Issue. The elements of CAT discussed here include item selection procedures, estimation of the latent trait, item exposure, measurement precision, and item bank development. Some topics for future research are also presented.
Get full access to this article
View all access and purchase options for this article.
References
College Board (1993). User’s notebook. New York: Author.
Davey, T., Godwin, J., & Mittelholz, D. (1997). Developing and scoring an innovative computerized writing assessment. Journal of Educational Measurement, 34, 21–41.
Davey, T., & Nering, M. L. (1998, September). Controlling item exposure and maintaining item security. Paper presented at the ETS-sponsored colloquium entitled Computer-based testing: Building the foundations for future assessments, Philadelphia PA.
Dodd, B. G., De Ayala, R. J., & Koch, W. R. (1995). Computerized adaptive testing with polytomous items. Applied Psychological Measurement, 19, 5–22.
Dodd, B. G., & Fitzpatrick, S. J. (1998, September). Alternatives for scoring computerized adaptive tests. Paper presented at the ETS-sponsored colloquium entitled Computer-based testing: Building the foundations for future assessments, Philadelphia PA.
Drasgow, F., & Olson-Buchanan, J. B. (Eds.). (1999). Innovations in computerized assessment. Hillsdale NJ: Erlbaum.
Educational Testing Service (1996). Graduate Record Examinations 1996-1997: Information and registration bulletin. Princeton NJ: Author.
Glas, C. A. W., & Veerkamp, W. J. J. (in press). Item calibration and parameter drift. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
Hambleton, R. K., & Swaminathan, H. (1985). Item response theory: Principles and applications. Boston: Kluwer-Nijhoff.
Lord, F. M. (1971). A theoretical study of two-stage testing. Psychometrika, 36, 227–242.
Lord, F. M. (1977). Abroad-range tailored test of verbal ability. Applied Psychological Measurement, 1, 95–100.
Lord, F. M. (1983). Unbiased estimators of ability parameters, of their variance, and their parallel forms reliability. Psychometrika, 48, 233–245.
McLeod, L. D., & Lewis, C. (1999). Detecting item memorization in the CAT environment. Applied Psychological Measurement, 23, 147–160.
Meijer, R. R., Sijtsma, K., & Molenaar, I. W. (1995). Reliability estimation for single dichotomous items based on Mokken’s IRT model. Applied Psychological Measurement, 19, 323–335.
Mokken, R. J. (1997). Nonparametric models for dichotomous responses. In W. J. van der Linden & R. K. Hambleton (Eds.), Handbook of modern item response theory(pp. 351–367). New York: Springer.
Moreno, K. E., & Segall, O. D. (1997). Reliability and construct validity of CAT-ASVAB. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation(pp. 169–179). Washington DC: American Psychological Association.
Nering, M. L. (1997). The distribution of indexes of person misfit within the computerized adaptive environment. Applied Psychological Measurement, 21, 115–127.
Owen, R. J. (1975). A Bayesian sequential procedure for quantal response in the context of adaptive mental testing. Journal of the American Statistical Association, 70, 351–356.
Parshall, C. G., Davey, T., & Pashley, P. (in press). Innovative item types for computerized testing. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
Sands, W. A., Waters, B. K., & McBride, J. R. (Eds.) (1997). Computerized adaptive testing: From inquiry to operation. Washington DC: American Psychological Association.
Schnipke, D. L., & Green, B. F. (1995). A comparison of item selection routines in linear and adaptive tests. Journal of Educational Measurement, 32, 227–242.
Segall, D. O. (1996). Multidimensional adaptive testing. Psychometrika, 61, 331–354.
Segall, D. O., & Moreno, K. E. (1997). Current and future challenges. In W. A. Sands, B. K. Waters, & J. R. McBride (Eds.). Computerized adaptive testing: From inquiry to operation (pp. 257–269). Washington DC: American Psychological Association.
Sijtsma, K., & Molenaar, I. W. (1987). Reliability of test scores in nonparametric item response theory. Psychometrika, 52, 79–97.
Stocking, M. L., & Swanson, L. (1993). A method for severely constrained item selection in adaptive testing. Applied Psychological Measurement, 17, 277–292.
Swanson, L., & Stocking, M. L. (1993). A model and heuristic for solving very large item selection problems. Applied Psychological Measurement, 22, 271–280.
Stocking, M. L., Ward, W. C., & Potenza, M. T. (1998). Simulating the use of disclosed items in computerized adaptive testing. Journal of Educational Measurement, 17, 151–166.
Sympson, J. B., & Hetter, R. D. (1985). Controlling item exposure rates in computerized adaptive test-ing. Proceedings of the 27th annual meeting of the Military Testing Association, 973–977.
Thissen, D. (1990). Reliability and measurement precision. In H. Wainer, N. J. Dorans, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg,& D. Thissen (Eds.), Computerized adaptive testing: A primer(pp. 161–186). Hillsdale NJ: Erlbaum.
Thissen, D., & Mislevy, R. J. (1990). Testing algorithms. In H. Wainer, N. J. Dorans, R. Flaugher, B. F. Green, R. J. Mislevy, L. Steinberg,& D. Thissen (Eds.), Computerized adaptive testing: A primer(pp. 103–134). Hillsdale NJ: Erlbaum.
van der Linden, W. J. (1998a). Bayesian item selection criteria for adaptive testing. Psychometrika, 63, 201–216.
van der Linden, W. J. (1998b). Optimal assembly of psychological and educational tests. Applied Psychological Measurement, 22, 195–211.
van der Linden, W. J., & Glas, C. A. W. (Eds.). (in press). Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
van Krimpen-Stoop, E. M. L. A., & Meijer, R. R. (in press). Detecting person-misfit in adaptive testing using statistical process control techniques. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
Veerkamp, W. J. J. (1997). Statistical methods for computerized adaptive testing. Unpublished doctoral dissertation, University of Twente, Enschede, The Netherlands.
Veerkamp, W. J. J., & Berger, M. P. F. (1997). Some new item selection criteria for adaptive testing. Journal of Educational and Behavioral Statistics, 22, 203–226.
Veldkamp, B. P., & van der Linden, W. J. (in press). Item pool design for CAT. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
Verschoor, A., & Straetmans, G. (in press). Math CAT: A flexible testing system for adult mathematics education. In W. J. van der Linden & C. A. W. Glas (Eds.), Computer adaptive testing: Theory and practice. Boston: Kluwer Academic.
Wainer, H., Dorans, N. J., Flaugher, R., Green, B. F., Mislevy, R. J., Steinberg, L., & Thissen, D. (Eds.) (1990). Computerized adaptive testing: A primer. Hillsdale NJ: Erlbaum.
Warm, T. A. (1989). Weighted likelihood estimation of ability in item response theory. Psychometrika, 54, 427–450.
Weiss, D. J. (1982). Improving measurement quality and efficiency with adaptive testing. Applied Psychological Measurement, 4, 273–285.
Weiss, D. J. (Ed.). (1983). New horizons in testing: Latent trait test theory and computerized adaptive testing. New York: Academic Press.
Zwick, R. (1997). The effect of adaptive administration on the variability of the Mantel-Haenszel measure of differential item functioning. Educational and Psychological Measurement, 57, 412–421.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published: September 1999
Issue published: September 1999
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Applied Psychological Measurement.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 996
*Article usage tracking started in December 2016
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 96 view articles Opens in new tab
Crossref: 97
- Iterative Item Selection of Neighborhood Clusters: A Nonparametric and...
- Differential Performance of Computerized Adaptive Testing in Students ...
- Sadism in the context of intergroup aggression
- Building trust with the ethical affordances of education technologies:...
- Culturally Responsive Assessment: Provisional Principles
- A novel computerized adaptive testing framework with decoupled learnin...
- iSTART: Adaptive Comprehension Strategy Training and Stealth Literacy ...
- The effect of individual-level adaptive stimulus selection on the grou...
- Construction of a computerized adaptive test (CAT-CCNB) for efficient ...
- Datenerhebung
- Prior Distribution and Entropy in Computer Adaptive Testing Ability Es...
- The Dosing of Mobile-Based Just-in-Time Adaptive Self-Management Promp...
- A narrative review of adaptive testing and its application to medical ...
- Verbal Lie Detection: Its Past, Present and Future
- Simulating computerized adaptive testing in special education based on...
- A psychometric view of technology-based assessments
- Improving the utility of the European Health Literacy Survey Questionn...
- Estimating Skeletal Maturity by Segmented Linear Modeling of Key AP Kn...
- A Comprehensive Review and Comparison of CUSUM and Change-Point-Analys...
- Developing Patient-Centered Outcomes Metrics for Abdominal Surgery
- Knowledge State Networks for Skill Assessment in Atomic Learning
- Computerized Adaptive Testing for Sleep Disorders
- Multi-objective optimization of item selection in computerized adaptiv...
- Concept and Design Developments in School Improvement Research: Genera...
- Predicting Literacy Skills via Stealth Assessment in a Simple Vocabula...
- Artificial Intelligence in Computerized Adaptive Testing
- Development of a computerized adaptive test to assess entrepreneurial ...
- Comparing Scores From Full Length, Short Form, and Adaptive Tests of t...
- Online Calibration of Polytomous Items Under the Graded Response Model
- A new approach to assessing shyness of college students using ...
- A Blocked-CAT Procedure for CD-CAT
- Intelligence in the Workplace
- Calibration of an item bank in 474 orthopedic patients using Rasch ana...
- Applying Computer Adaptive Testing Methods to Suicide Risk Screening i...
- Can TIMSS Mathematics Assessments be Implemented as a Computerized Ada...
- Application of the Patient‐Reported Outcomes Measurement Information S...
- Addressing model uncertainty in item response theory person scores thr...
- Development and Validation of an Item Bank for Depression Screening in...
- Item-saving assessment of self-care performance in children with devel...
- A Smart Screening Device for Patients with Mental Health Problems in P...
- Development and Validation of a Computer Adaptive EFL Test
- Intelligence in the Workplace
- Item Response Theory Modeling of the Philadelphia Naming Test
- New Item Selection Methods for Cognitive Diagnosis Computerized Adapti...
- The Predictive Validity of a Computer-Adaptive Assessment of Kindergar...
- Development and Evaluation of a Computer Adaptive Test to Assess Anxie...
- The calibrated, unidimensional anxiety item bank for cardiovascular pa...
- Validating and Improving the Reliability of the EORTC QLQ-C30 Using a ...
- Defining, Measuring, and Scaling Affective Constructs
- New Item Selection Criteria of Computerized Adaptive Testing with Expo...
- The effects of individualized, online vocabulary instruction on pictur...
- On the Relationships Between Jeffreys Modal and Weighted Likelihood Es...
- Measure and Manage: Intangible Assets Metric Standards for Sustainabil...
- Covariate Measurement Error Adjustment for Multilevel Models With Appl...
- Computerized Adaptive Testing
- Consequences of Test Anxiety on Adaptive Versus Fixed Item Testing
- Identifying Cheating on Unproctored Internet Tests: The ...
- A Monte Carlo Simulation Investigating the Validity and Reliability of...
- Detection of aberrant item score patterns in computerized adaptive tes...
- Selection Bias Introduced by Neuropsychological Assessments
- Meaningfulness, Measurement, Value Seeking and the Corporate Objective...
- Reaction Explorer:Towards a Knowledge Map of Organic Chemistry To Supp...
- Conspiracies and Test Compromise: An Evaluation of the Resistance of T...
- I've Fallen and I Can't Get Up: Can High-Ability Students Recover From...
- An evaluation of patient-reported outcomes found computerized adaptive...
- Adaptive Tests for Measuring Anxiety and Depression
- Integration of Agents and Data Mining in Interactive Web Environment f...
- Functioning and validity of A Computerized Adaptive Test to measure an...
- Interactive Environment Based on Internet Technologies for Psychometri...
- Model of data analysis on interactive web environment for psychometric...
- Integration adaptive psychometric tests in interactive web environment
- Item Selection Strategies for Computerized Adaptive Testing with the G...
- A comparability approach to item reduction in Computerized Adaptive Te...
- Computerized Adaptive Testing of Personality Traits
- Transitioning from Fixed-Length Questionnaires to Computer-Adaptive Ve...
- An Algorithm for Automatic Difficulty Level Estimation of Multimedia M...
- Development and evaluation of a computer adaptive test for ‘Anxiety’ (...
- Mode effects in the center for epidemiologic studies depression (CES-D...
- The use of personality measures in personnel selection: What does curr...
- Development of a Computer-adaptive Test for Depression (D-CAT)
- Development of the Learning Potential Computerised Adaptive Test (Lpca...
- Increasing the Homogeneity of CAT's Item‐Exposure Rates by Minimizing ...
- A Randomized Experiment to Compare Conventional, Computerized, and Com...
- Entwicklungsschritte für einen computeradaptiven Test zur Erfassung vo...
- Roles for software technologies in advancing research and theory in ed...
- BAYESIAN NETWORKS IN EDUCATIONAL TESTING
- History of Research Methods in Industrial and Organizational Psycholog...
- An Optimal Design Approach to Criterion-Referenced Computerized Testin...
- Technology Trends in Staffing and Assessment: A Practice Note
- Book Review: Practical Considerations in Computer-Based Testing Cynthi...
- Outlier Detection in High‐Stakes Certification Testing
- Prospects and Limitations of Psychological Testing on the Internet
- Book Review: Item Response Theory for Psychologists
- Methodology Review: Evaluating Person Fit
- Détection des biais d’items et de personnes en testing adaptatif
- Computerization and Adaptive Administration of the NEO PI-R
- Conclusion and Discussion
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
