Abstract
The success of universal screening for effective school mental health programs is dependent on the availability of usable measures as well as empirically based recommendations for use. The current study examined the long-term stability of a strengths-based social-emotional screening tool, the Devereux Student Strengths Assessment-Mini (DESSA-Mini). Elementary teachers rated students (N = 273; kindergarten and first grade at Time 1) 3 times per year over 2 years to identify students for early intervention. Stability coefficients were moderate to large for continuous and categorical data but lower between years, and a transition matrix demonstrated greater movement across categories compared with prior research. A latent profile analysis with all six time-point T-Scores indicated four stability profiles. Three patterns were stable across all times while one profile improved over time. Profile results were compared with covariates of free and reduced-price lunch, special education, and intervention status as well as outcomes of reading achievement and behavior referrals. Practice implications and areas for future research are discussed.
|
Akaike, H. (1987). Factor analysis and AIC. Psychometrika, 52, 317-332. doi:10.1007/BF02294359 Google Scholar | ISI | |
|
American Educational Research Association, American Psychological Association, & National Council on Measurement Education . (2014). The standards for educational and psychological testing. Washington, DC: Author. Google Scholar | |
|
Bierman, K. L., Coie, J. D., Dodge, K. A., Greenberg, M. T., Lochman, J. E., McMahon, R. J., Pinderhughes, E. (2010). The effects of a multiyear universal social–emotional learning program: The role of student and school characteristics. Journal of Consulting and Clinical Psychology, 78, 156-168. doi:10.1037/a0018607 Google Scholar | Medline | ISI | |
|
Chafouleas, S. M., Christ, T. J., Riley-Tillman, T. C., Briesch, A. M., Chanese, J. A. (2007). Generalizability and dependability of direct behavior ratings to assess social behavior of preschoolers. School Psychology Review, 36, 63-79. Google Scholar | ISI | |
|
Clarbour, J., Roger, D. (2004). The construction and validation of a new scale for measuring emotional response style in adolescents. The Journal of Child Psychology and Psychiatry, 45, 496-509. doi:10.1111/j.1469-7610.2004.00240.x Google Scholar | Medline | |
|
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Cook, C. R., Volpe, R. J., Livanis, A. (2010). Constructing a roadmap for future universal screening research beyond academics. Assessment for Effective Intervention, 35, 197-205. doi:10.1177/1534508410379842 Google Scholar | SAGE Journals | |
|
Cox, K. F. (2006). Investigating the impact of strength-based assessment on youth with emotional or behavioral disorders. Journal of Child and Family Studies, 15, 278-292. doi:10.1007/s10826-006-9021-5 Google Scholar | |
|
Dever, B. V., Dowdy, E., Raines, T. C., Carnazzo, K. (2015). Stability and change of behavioral and emotional screening scores. Psychology in the Schools, 52, 618-629. doi:10.1002/pits.21825 Google Scholar | |
|
Dowdy, E., Nylund-Gibson, K., Felix, E. D., Morovati, D., Carnazzo, K. W., Dever, B. V. (2014). Long-term stability of screening for behavioral and emotional risk. Educational and Psychological Measurement, 74, 453-472. doi:10.1177/0013164413513460 Google Scholar | SAGE Journals | ISI | |
|
Dowdy, E., Ritchey, K., Kamphaus, R. W. (2010). School-based screening: A population-based approach to inform and monitor children’s mental health needs. School Mental Health, 2, 166-176. doi:10.1007/s12310-010-9036-3 Google Scholar | Medline | |
|
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions. Child Development, 82, 405-432. doi:10.1111/j.1467-8624.2010.01564.x Google Scholar | Medline | ISI | |
|
Essex, M. J., Kraemer, H. C., Slattery, M. J., Burk, L. R., Thomas Boyce, W., Woodward, H. R., Kupfer, D. J. (2009). Screening for childhood mental health problems: Outcomes and early identification. The Journal of Child Psychology and Psychiatry, 50, 562-570. doi:10.1111/j.1469-7610.2008.02015.x Google Scholar | Medline | ISI | |
|
Glover, T. A., Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117-135. doi:10.1016/j.jsp.2006.05.005 Google Scholar | ISI | |
|
Guo, J., Wall, M., Amemiya, Y. (2006). Latent class regression on latent factors. Biostatistics, 7, 145-163. doi:10.1093/biostatistics/kxi046 Google Scholar | Medline | |
|
Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions. Journal of Positive Behavior Interventions, 6, 131-147. doi:10.1177/10983007040060030201 Google Scholar | SAGE Journals | ISI | |
|
Jimerson, S. R., Sharkey, J. D., Nyberg, V., Furlong, M. J. (2004). Strength-based assessment and school psychology: A summary and synthesis. The California School Psychologist, 9, 9-19. Google Scholar | |
|
King, K., Reschly, A. L., Appleton, J. J. (2012). An examination of the validity of the Behavioral and Emotional Screening System in a rural elementary school validity of the BESS. Journal of Psychoeducational Assessment, 30, 527-538. doi:10.1177/0734282912440673 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Kalberg, J. R., Bruhn, A. L., Mahoney, M. E., Driscoll, S. A. (2008). Primary prevention programs at the elementary level: Issues of treatment integrity, systematic screening, and reinforcement. Education and Treatment of Children, 31, 465-494. doi:10.1353/etc.0.0033 Google Scholar | |
|
Levitt, J. M., Saka, N., Romanelli, L. H., Hoagwood, K. (2007). Early identification of mental health problems in schools: The status of instrumentation. Journal of School Psychology, 45, 163-191. doi:10.1016/j.jsp.2006.11.005 Google Scholar | ISI | |
|
Lo, Y., Mendell, N. R., Rubin, D. B. (2001). Testing the number of components in a normal mixture. Biometrika, 88, 767-778. doi:10.1093/biomet/88.3.767 Google Scholar | ISI | |
|
Muthén, B. (2004). Latent variable analysis: Growth mixture modeling and related techniques for longitudinal data. In Kaplan, D. (Ed.), The Sage handbook of quantitative methodology for the social sciences (pp. 345-368). Thousand Oaks, CA: Sage. Google Scholar | |
|
Muthén, L. K., Muthén, B. O. (1998-2011). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
Muthén, L. K., Muthén, B. O. (2002). How to use a Monte Carlo study to decide on sample size and determine power. Structural Equation Modeling, 9, 599-620. doi:10.1207/S15328007SEM0904_8 Google Scholar | ISI | |
|
Naglieri, J. A., LeBuffe, P. A., Shapiro, V. (2010). Devereux Student Strengths Assessment-Mini. Lewisville, NC: Kaplan Press. Google Scholar | |
|
Nickerson, A. B., Fishman, C. E. (2013). Promoting mental health and resilience through strength-based assessment in US schools. Educational & Child Psychology, 30, 7-17. Google Scholar | |
|
Nishina, A., Bellmore, A., Witkow, M. R., Nylund-Gibson, K. (2010). Longitudinal consistency of adolescent ethnic identification across varying school ethnic contexts. Developmental Psychology, 46, 1389-1401. Google Scholar | Medline | ISI | |
|
Parisi, D. M., Ihlo, T., Glover, T. A. (2014). Screening within a multitiered early prevention model: Using assessment to inform instruction and promote students’ response to intervention. In Kettler, R. J., Glover, T. A., Albers, C. A., Feeney-Kettler, K. A. (Eds.), Universal screening in educational settings: Evidence-based decision making for schools (pp. 19-46). Washington, DC: American Psychological Association. Google Scholar | |
|
President’s New Freedom Commission on Mental Health . (2003). Achieving the promise: Transforming mental health care in America (Final Report for the President’s New Freedom Commission on Mental Health (SMA Publication No. 03-3832). Rockville, MD: Author. Google Scholar | |
|
Renaissance Learning . (2009). STAR early literacy. Wisconsin Rapids, WI: Author. Google Scholar | |
|
Romer, N., Merrell, K. W. (2012). Temporal stability of strength-based assessments: Test–retest reliability of student and teacher reports. Assessment for Effective Intervention, 38, 185-191. doi:10.1177/1534508412444955 Google Scholar | SAGE Journals | |
|
Schwartz, G. (1978). Estimating the dimension of a model. Annals of Statistics, 6, 461-464. Google Scholar | ISI | |
|
Szumilas, M. (2010). Explaining odds ratios. Journal of the Canadian Academy of Child & Adolescent Psychiatry, 19, 227-229. Google Scholar | Medline | |
|
Tsang, K. L. V., Wong, P. Y. H., Lo, S. K. (2011). Assessing psychosocial well-being of adolescents: A systematic review of measuring instruments. Child: Care, Health and Development, 38, 629-646. doi:10.1111/j.1365-2214.2011.01355.x Google Scholar | Medline | |
|
Walker, H. M., Small, J. W., Severson, H. H., Seeley, J. R., Feil, E. G. (2014). Multiple-gating approaches in universal screening within school and community settings. In Kettler, R. J., Glover, T. A., Albers, C. A., Feeney-Kettler, K. A. (Eds.), Universal screening in educational settings: Evidence-based decision making for schools (pp. 47-75). Washington, DC: American Psychological Association. Google Scholar | |
|
Watson, D., Walker, L. M. (1996). The long-term stability and predictive validity of trait measures of affect. Journal of Personality and Social Psychology, 70, 567-577. doi:10.1037/0022-3514.70.3.567 Google Scholar | Medline | ISI |

