![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
We examined the structure of the new Block Patterns (BP) test from the Shipley Institute of Living Scale–Second Edition in a sample of Jamaican young adults. To date, very little has been published on the properties of this subtest’s items and scores. The BP test is similar in design to the Block Design subtest found in many cognitive ability assessments but uses a matching format that minimizes the need for excess materials and time. We analyzed the BP items using item response theory (IRT) methods. Although designed to measure a single construct, the analyses from this study found that the BP subtest is likely measuring more than a single construct, which confounds the interpretation of the instrument’s scores. Before the subtest is used clinically, more research should be done to purposefully investigate the effects of ancillary variables on its scores.
References
Section:
|
Allen, M. J., Yen, W. M. (1979). Introduction to measurement theory. Monterey, CA: Brooks/Cole. Google Scholar | |
|
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education . (2014). Standards for educational and psychological testing (4th ed.). Washington, DC: Author. Google Scholar | |
|
Arthur, G. (1930). A point scale of performance tests. Oxford, UK: Commonwealth Fund. Google Scholar | Crossref | |
|
Bafumi, J., Gelman, A., Park, D. K., Kaplan, N. (2005). Practical issues in implementing and understanding Bayesian ideal point estimation. Political Analysis, 13, 171-187. doi:10.1093/pan/mpi010 Google Scholar | Crossref | ISI | |
|
Beaujean, A. A., Firmin, M. W., Attai, S., Johnson, C. B., Firmin, R. L., Mena, K. E. (2011). Using personality and cognitive ability to predict academic achievement in a young adult sample. Personality and Individual Differences, 51, 709-714. doi:10.1016/j.paid.2011.06.023 Google Scholar | Crossref | ISI | |
|
Béguin, A., Glas, C. (2001). MCMC estimation and some model-fit analysis of multidimensional IRT models. Psychometrika, 66, 541-561. doi:10.1007/bf02296195 Google Scholar | Crossref | ISI | |
|
Bernstein, I. H., Teng, G. (1989). Factoring items and factoring scales are different: Spurious evidence for multidimensionality due to item categorization. Psychological Bulletin, 105, 467-477. doi:10.1037/0033-2909.105.3.467 Google Scholar | Crossref | ISI | |
|
Boake, C. (2002). From the Binet-Simon to the Wechsler-Bellevue: Tracing the history of intelligence testing. Journal of Clinical and Experimental Neuropsychology, 24, 383-405. doi:10.1076/jcen.24.3.383.981 Google Scholar | Crossref | Medline | ISI | |
|
Borsboom, D. (2005). Measuring the mind: Conceptual issues in contemporary psychometrics. New York, NY: Cambridge. Google Scholar | Crossref | |
|
Bracken, B. A., McCallum, R. S. (1998). The Universal Nonverbal Intelligence Test. Chicago, IL: Riverside. Google Scholar | |
|
Caplan, B., Caffery, D. (1992). Fractionating block design: Development of a test of visuospatial analysis. Neuropsychology, 6, 385-394. doi:10.1037/0894-4105.6.4.385 Google Scholar | Crossref | |
|
Carroll, J. B. (1993). Human cognitive abilities: A survey of factor-analytic studies. New York, NY: Cambridge University Press. Google Scholar | Crossref | |
|
Central Intelligence Agency . (2015). The world factbook. Retrieved from https://www.cia.gov/library/publications/resources/the-world-factbook/ Google Scholar | |
|
Chib, S., Greenberg, E. (1995). Understanding the Metropolis-Hastings algorithm. The American Statistician, 49, 327-335. doi:10.2307/2684568 Google Scholar | Crossref | ISI | |
|
Collis, N. L., Kohnen, S., Kinoshita, S. (2012). The role of visual spatial attention in adult developmental dyslexia. The Quarterly Journal of Experimental Psychology, 66, 1-16. doi:10.1080/17470218.2012.705305 Google Scholar | Crossref | |
|
Colom, R., Contreras, M. J., Shih, P. C., Santacreu, J. (2003). The assessment of spatial ability with a single computerized test. European Journal of Psychological Assessment, 19, 92-100. doi:10.1027//1015-5759.19.2.92 Google Scholar | Crossref | ISI | |
|
Cornell, E. L., Coxe, W. W. (1934). A performance ability scale. New York, NY: World Book. Google Scholar | |
|
Cronbach, L. J. (1946). Response sets and test validity. Educational and Psychological Measurement, 6, 475-494. doi:10.1177/001316444600600405 Google Scholar | SAGE Journals | ISI | |
|
Davenport, C. B., Steggerda, M. (1929). Race crossing in Jamaica. Washington, DC: Carnegie Institution of Washington. Google Scholar | |
|
Davidson, W. M., Carroll, J. B. (1945). Speed and level components in time-limit scores: A factor analysis. Educational and Psychological Measurement, 5, 411-427. doi:10.1177/001316444500500408 Google Scholar | SAGE Journals | ISI | |
|
DeThorne, L. S., Schaefer, B. A. (2004). A guide to child nonverbal IQ measures. American Journal of Speech-Language Pathology, 13, 275-290. doi:10.1044/1058-0360(2004/029) Google Scholar | Crossref | Medline | ISI | |
|
Gelman, A., Rubin, D. B. (1992). Inference from iterative simulation using multiple sequences. Statistical Science, 7, 457-472. doi:10.1214/ss/1177011136 Google Scholar | Crossref | |
|
Geman, S., Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741. doi:10.1109/TPAMI.1984.4767596 Google Scholar | Crossref | Medline | ISI | |
|
Giordani, B., Rourke, D., Berent, S., Sackellares, J. C., Seidenberg, M., Butterbaugh, G., Dreifuss, F. E. (1993). Comparison of WAIS subtest performance of patients with complex partial (temporal lobe) and generalized seizures. Psychological Assessment, 5, 159-163. doi:10.1037/1040-3590.5.2.159 Google Scholar | Crossref | |
|
Grantham-McGregor, S. M., Powell, C. A., Walker, S. P., Himes, J. H. (1991). Nutritional supplementation, psychosocial stimulation, and mental development of stunted children: The Jamaican Study. The Lancet, 338, 1-5. doi:10.1016/0140-6736(91)90001-6 Google Scholar | Crossref | Medline | ISI | |
|
Hambleton, R. K., Swaminathan, H. (1985). Item response theory: Principles and applications. Boston, MA: Kluwer. Google Scholar | Crossref | |
|
Hayton, J. C., Allen, D. G., Scarpello, V. (2004). Factor retention decisions in exploratory factor analysis: A tutorial on parallel analysis. Organizational Research Methods, 7, 191-205. doi:10.1177/1094428104263675 Google Scholar | SAGE Journals | ISI | |
|
HEART Trust/National Training Agency . (2009). Unattached youth in Jamaica. Kingston, Jamaica: HEART/NTA Planning and Project Development. Google Scholar | |
|
Killgore, W. D. S., Glahn, D. C., Casasanto, D. J. (2005). Development and validation of the Design Organization Test (DOT): A rapid screening instrument for assessing visuospatial ability. Journal of Clinical and Experimental Neuropsychology, 27, 449-459. doi:10.1080/13803390490520436 Google Scholar | Crossref | Medline | ISI | |
|
Kohs, S. C. (1920). The block-design tests. Journal of Experimental Psychology, 3, 357-376. doi:10.1037/h0074466 Google Scholar | Crossref | |
|
Kohs, S. C. (1923). Intelligence measurement: A psychological and statistical study based upon the block design tests. New York, NY: Macmillan. Google Scholar | Crossref | |
|
Lee, H. (1995). Markov chain Monte Carlo methods for estimating multidimensional ability in item response analysis (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 9708517) Google Scholar | |
|
Lodge, J. K. (2013). The concurrent validity of the Shipley-2 and the WAIS-IV (Unpublished doctoral dissertation). Wright State University, Dayton, OH Google Scholar | |
|
Lord, F. (1956). A study of speed factors in tests and academic grades. Psychometrika, 21, 31-50. doi:10.1007/bf02289085 Google Scholar | Crossref | ISI | |
|
Lu, Y., Sireci, S. G. (2007). Validity issues in test speededness. Educational Measurement: Issues and Practice, 26, 29-37. doi:10.1111/j.1745-3992.2007.00106.x Google Scholar | Crossref | |
|
Lynn, R., Vanhanen, T. (2012). Intelligence: A unifying construct for the social sciences. London, England: Ulster Institute for Social Research. Google Scholar | |
|
Manley, D. R. (1963). Mental ability in Jamaica. Social & Economic Studies, 12, 51-71. Google Scholar | |
|
MathWorks . (2010). MATLAB (Version 7.11) [Computer software]. Natick, MA: Author. Google Scholar | |
|
McDonald, R. P. (1999). Test theory: A unified treatment. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Miller, J. C., Skillman, G. D. (2008). Relationship of stimulus and examinee variables to performance on analogous visual and tactile block construction tasks. Applied Neuropsychology, 15, 140-149. doi:10.1080/09084280802160901 Google Scholar | Crossref | Medline | |
|
Oshima, T. C. (1994). The effect of speededness on parameter estimation in item response theory. Journal of Educational Measurement, 31, 200-219. doi:10.1111/j.1745-3984.1994.tb00443.x Google Scholar | Crossref | ISI | |
|
Patz, R. J., Junker, B. W. (1999). Applications and extensions of MCMC in IRT: Multiple item types, missing data, and rated responses. Journal of Educational and Behavioral Statistics, 24, 342-366. doi:10.3102/10769986024004342 Google Scholar | SAGE Journals | ISI | |
|
R Development Core Team . (2015). R: A language and environment for statistical computing [Computer software]. Vienna, Austria: R Foundation for Statistical Computing. Google Scholar | |
|
Reckase, M. D. (2009). Multidimensional item response theory. New York, NY: Springer. Google Scholar | Crossref | |
|
Revelle, W. (2015). psych: Procedures for psychological, psychometric, and personality research ( [Computer program]. Evanston, IL: Northwestern University. Google Scholar | |
|
Reynolds, M. R., Hajovsky, D. B., Pace, J. R., Niileksela, C. R. (2016). What does the Shipley-2 measure for children and adolescents? Integrated and conjoint confirmatory factor analysis with the WISC-IV. Assessment, 23, 23-41. doi:10.1177/1073191115572695 Google Scholar | SAGE Journals | ISI | |
|
Rindler, S. E. (1979). Pitfalls in assessing test speededness. Journal of Educational Measurement, 16, 261-270. doi:10.1111/j.1745-3984.1979.tb00107.x Google Scholar | Crossref | ISI | |
|
Rosander, P., Backstrom, M., Stenberg, G. (2011). Personality traits and general intelligence as predictors of academic performance: A structural equation modelling approach. Learning and Individual Differences, 21, 590-596. doi:10.1016/j.lindif.2011.04.004 Google Scholar | Crossref | ISI | |
|
Royer, F. L. (1977). Information processing in the block design task. Intelligence, 1, 32-50. doi:10.1007/BF03039311 Google Scholar | Crossref | |
|
Saxon, T. F., Hull, D. M., Fearon, D. D., Williams, L. O., Tindigarukayo, J. K. (2012). How do Jamaica’s unattached youth view their career prospects and life skills? Comparative Education Review, 56, 421-447. doi:10.1086/664992 Google Scholar | Crossref | ISI | |
|
Sheng, Y. (2008). Markov chain Monte Carlo estimation of normal ogive IRT models in MATLAB. Journal of Statistical Software, 25(8), 1-15. doi: 10.18637/jss.v025.i08 Google Scholar | Crossref | ISI | |
|
Sheng, Y., Headrick, T. C. (2012). A Gibbs sampler for the multidimensional item response model. ISRN Applied Mathematics, 2012, Article 269385. doi:10.5402/2012/269385 Google Scholar | Crossref | |
|
Sheng, Y., Wikle, C. K. (2007). Comparing multiunidimensional and unidimensional item response theory models. Educational and Psychological Measurement, 67, 899-919. doi:10.1177/0013164406296977 Google Scholar | SAGE Journals | ISI | |
|
Shipley, W. C. (1940). A self-administering scale for measuring intellectual impairment and deterioration. Journal of Psychology: Interdisciplinary and Applied, 9, 371-377. doi:10.1080/00223980.1940.9917704 Google Scholar | Crossref | |
|
Shipley, W. C., Gruber, C., Martin, T., Klein, A. M. (2010). Shipley Institute of Living Scale (2nd ed.). Los Angeles, CA: Western Psychological Services. Google Scholar | |
|
Spiegelhalter, D. J., Best, N. G., Carlin, B. P., Van Der Linde, A. (2002). Bayesian measures of model complexity and fit. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 64, 583-639. doi:10.1111/1467-9868.00353 Google Scholar | Crossref | ISI | |
|
Tanzer, N. K., Gittler, G., Ellis, B. B. (1995). Cross-cultural validation of item complexity in a LLTM-calibrated spatial ability test. European Journal of Psychological Assessment, 11, 170-183. doi:10.1027/1015-5759.11.3.170 Google Scholar | Crossref | ISI | |
|
Tsutakawa, R. K. (1984). Estimation of two-parameter logistic item response curves. Journal of Educational and Behavioral Statistics, 9, 263-276. doi:10.3102/10769986009004263 Google Scholar | SAGE Journals | |
|
Tsutakawa, R. K., Johnson, J. (1990). The effect of uncertainty of item parameter estimation on ability estimates. Psychometrika, 55, 371-390. doi:10.1007/bf02295293 Google Scholar | Crossref | ISI | |
|
van de Vijver, F., Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. Revue Européenne de Psychologie Appliquée, 54, 119-135. doi:10.1016/j.erap.2003.12.004 Google Scholar | Crossref | |
|
Velicer, W. F., Eaton, C. A., Fava, J. L. (2000). Construct explication through factor or component analysis: A review and evaluation of alternative procedures for determining the number of factors or components. In Goffin, R. D., Helmes, E. (Eds.), Problems and solutions in human assessment: Honoring Douglas Jackson at seventy (pp. 41-71). Boston, MA: Kluwer. Google Scholar | Crossref | |
|
Vernon, P. E. (1969). Intelligence and cultural environment. London, England: Methuen. Google Scholar | |
|
Wai, J., Lubinski, D., Benbow, C. P. (2009). Spatial ability for STEM domains: Aligning over 50 years of cumulative psychological knowledge solidifies its importance. Journal of Educational Psychology, 101, 817-835. doi:10.1037/a0016127 Google Scholar | Crossref | ISI | |
|
Ward, L. C., Bergman, M. A., Hebert, K. R. (2012). WAIS-IV subtest covariance structure: Conceptual and statistical considerations. Psychological Assessment, 24, 328-340. doi:10.1037/a0025614 Google Scholar | Crossref | Medline | ISI | |
|
Wechsler, D. (1939). The measurement of adult intelligence. Baltimore, MD: Williams & Wilkins. Google Scholar | Crossref | |
|
Wechsler, D. (2003). Wechsler Intelligence Scale for Children (4th ed.). San Antonio, TX: Pearson. Google Scholar | |
|
Wechsler, D. (2008). Wechsler Adult Intelligence Scale (4th ed.). San Antonio, TX: The Psychological Corporation. Google Scholar |
