Abstract
Conventional methods for producing test norms are often plagued with “jumps” or “gaps” (i.e., discontinuities) in norm tables and low confidence for assessing extreme scores. We propose a new approach for producing continuous test norms to address these problems that also has the added advantage of not requiring assumptions about the distribution of the raw data: Norm values are established from raw data by modeling the latter ones as a function of both percentile scores and an explanatory variable (e.g., age). The proposed method appears to minimize bias arising from sampling and measurement error, while handling marked deviations from normality—such as are commonplace in clinical samples. In addition to step-by-step instructions in how to apply this method, we demonstrate its advantages over conventional discrete norming procedures using norming data from two different psychometric tests, employing either age norms (N = 3,555) or grade norms (N = 1,400).
References
|
Achenbach, T. M., Rescorla, L. A. (2001). Manual for the ASEBA school-age forms and profiles. Burlington: University of Vermont, Research Center for Children, Youth, and Families. Google Scholar | |
|
American Psychiatric Association . (2013). Diagnostic and statistical manual of mental disorders (5th ed.). Washington, DC: Author. doi:10.1176/appi.books.9780890425596 Google Scholar | Crossref | |
|
Anastasi, A., Urbina, S. (1997). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Anonymous Authors (in press). Google Scholar | |
|
Blom, G. (1958). Statistical estimates and transformed beta-variables. New York, NY: Wiley. Google Scholar | |
|
Brown, L. D., Cai, T. T., DasGupta, A. (2001). Interval estimation for a binomial proportion. Statistical Science, 16, 101-117. Google Scholar | Crossref | ISI | |
|
Cohen, J., Cohen, P., West, S. G., Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences (3rd ed.). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Cole, T. J. (1988). Fitting smoothed centile curves to reference data. Journal of the Royal Statistical Society: Series A, 151, 385-418. doi:10.2307/2982992 Google Scholar | Crossref | ISI | |
|
Cole, T. J., Green, P. J. (1992). Smoothing reference centile curves: The LMS method and penalized likelihood. Statistics in Medicine, 11, 1305-1319. doi:10.1002/sim.4780111005 Google Scholar | Crossref | Medline | ISI | |
|
Crocker, L., Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart and Winston. Google Scholar | |
|
Dienes, P. (1957). The Taylor series: An introduction to the theory of functions of a complex variable. New York, NY: Dover. Google Scholar | |
|
Eid, M., Gollwitzer, M., Schmitt, M. (2010). Statistik und Forschungsmethoden [Statistics and research methods]. Weinheim, Germany: Beltz. Google Scholar | |
|
Gregory, R. J. (1996). Psychological testing: History, principles, and applications (2nd ed.). Boston, MA: Allyn & Bacon. Google Scholar | |
|
Kaufman, A. S., Kaufman, N. L. (2004). Kaufman assessment battery for children (2nd ed.). San Antonio, TX: Pearson. Google Scholar | |
|
Klauer, K. C. (1991). Exact and best confidence intervals for the ability parameters of the Rasch model. Psychometrika, 56, 535-547. doi:10.1007/BF02294489 Google Scholar | Crossref | ISI | |
|
Kristof, W. (1981). Anwendungen einer Beziehung zwischen t- und F-Verteilungen auf das Prüfen gewisser statistischer Hypothesen über Varianzen und Korrelationen [Application of a relation between t- and F-distributions on testing certain statistical hypotheses about variances and correlations]. In Jahnke, W. (Ed.), Beiträge zur Methodik in der differentiellen, diagnostischen und klinischen Psychologie (pp. 46-57). Königstein/Taunus, Germany: Hain. Google Scholar | |
|
Lenhard, A., Lenhard, W., Suggate, S., Segerer, R. (2015). Peabody Picture Vocabulary Test (PPVT-4). Frankfurt, Germany: Pearson Clinical Assessment. Google Scholar | |
|
Lenhard, W., Lenhard, A., Schneider, W. (in press). ELFE II: Ein Leseverständnistest für Erst- bis Siebtklässler [A reading comprehension test for Grades 1 to 7]. Göttingen, Germany: Hogrefe. Google Scholar | |
|
Lenhard, W., Schneider, W. (2006). ELFE 1-6: Ein Leseverständnistest für Erst- bis Sechstklässler [A reading comprehension test for Grades 1 to 6]. Göttingen, Germany: Hogrefe. Google Scholar | |
|
Olkin, I., Pratt, J. W. (1958). Unbiased estimation of certain correlation coefficients. Annals of Mathematical Statistics, 29, 201-211. Google Scholar | Crossref | |
|
Rigby, R. A., Stasinopoulos, D. M. (2004). Smooth centile curves for skew and kurtotic data modelled using the Box-Cox power exponential distribution. Statistics in Medicine, 23, 3053-3076. doi:10.1002/sim.1861 Google Scholar | Crossref | Medline | ISI | |
|
Rigby, R. A., Stasinopoulos, D. M. (2005). Generalized additive models for location, scale and shape. Applied Statistics, 54, 507-544. doi:10.1111/j.1467-9876.2005.00510.x Google Scholar | Crossref | ISI | |
|
Rigby, R. A., Stasinopoulos, D. M. (2006). Using the Box-Cox t distribution in GAMLSS to model skewness and kurtosis. Statistical Modelling, 6, 209-229. doi:10.1191/1471082X06st122oa Google Scholar | SAGE Journals | ISI | |
|
Sijtsma, K. (2012). Future of psychometrics: Ask what psychometrics can do for psychology. Psychometrika, 77, 4-20. doi:10.1007/s11336-011-9242-4 Google Scholar | Crossref | ISI | |
|
Taylor, R. (1998). Continuous norming: Improved equations for the WAIS-R. British Journal of Clinical Psychology, 37, 451-456. doi:10.1111/j.2044-8260.1998.tb01402.x Google Scholar | Crossref | Medline | ISI | |
|
Van Breukelen, G. J. P., Vlaeyen, J. W. S. (2005). Norming clinical questionnaires with multiple regression: The Pain Cognition List. Psychological Assessment, 17, 336-344. doi:10.1037/1040-3590.17.3.336 Google Scholar | Crossref | Medline | ISI | |
|
Wechsler, D. (2014). Wechsler Intelligence Scale for Children® (5th ed.). San Antonio, TX: Pearson. Google Scholar | |
|
Zachary, R. A., Gorsuch, R. L. (1985). Continuous norming: Implications for the WAIS-R. Journal of Clinical Psychology, 41, 86-94. doi:10.1002/1097-4679(198501)41:13.0.CO;2-W Google Scholar | Crossref | Medline | ISI | |
|
Zhu, J., Chen, H.-Y. (2011). Utility of inferential norming with smaller sample sizes. Journal of Psychoeducational Assessment, 29, 570-580. doi:10.1177/0734282910396323 Google Scholar | SAGE Journals | ISI |
