Abstract
We reported findings of an exploratory validation study of a revised universal screening instrument: the Student Risk Screening Scale–Internalizing and Externalizing (SRSS-IE) for use with middle school students. Tested initially for use with elementary-age students, the SRSS-IE was adapted to include seven additional items reflecting characteristics of internalizing behaviors. The initial seven items developed by Drummond (1994) were retained, yielding a modified instrument containing 14 items (SRSS-IE14) rated by teachers on the original 4-point, Likert-type scale. First, we examined reliability of SRSS-IE14 scores by analyzing item-level data, internal consistency estimates, and factor structure with a sample of 937 middle school students. Results of a data analytic plan grounded in Classical Test Theory supported retention of five of the new seven items, producing the SRSS-IE12. Second, we established convergent validity of the SRSS-IE12 with the Strengths and Difficulties Questionnaire (Goodman, 1997), a validated screening tool. We offered recommendations for addressing the limitations of this study in future research.
|
Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YRS, & TRF profiles. Burlington: Department of Psychiatry, University of Vermont. Google Scholar | |
|
Albers, C. A., Glover, T. A., Kratochwill, T. R. (2007). Introduction to the special issue: How can universal screening enhance educational and mental health outcomes? Journal of School Psychology, 45, 113–116. Google Scholar | Crossref | ISI | |
|
Alfonso, M., Dedrick, R. F. (2010). Self-injury among early adolescents. American Journal of Health Education, 41, 74–84. Google Scholar | Crossref | |
|
American Psychiatric Association . (2000). Diagnostic and statistical manual of mental disorders (4th ed., text rev.). Washington, DC: Author. Google Scholar | |
|
Becker, A., Woerner, W., Hasselhorn, M., Banaschewski, T., Rothenberger, A. (2004). Validation of the parent and teacher SDQ in a clinical sample. European Child and Adolescent Psychiatry, 13 (Suppl.), 11–16. doi:10.1007/s00787-004-2003-5 Google Scholar | Crossref | ISI | |
|
Bellmore, A. (2011). Peer rejection and unpopularity: Associations with GPAs across the transition to middle school. Journal of Educational Psychology, 103, 282–295. doi:10.1037/a0023312 Google Scholar | Crossref | ISI | |
|
Bradley, R., Doolittle, J., Bartolotta, R. (2008). Building on the data and adding to the discussion: The experiences and outcomes of students with emotional disturbance. Journal of Behavioral Education, 17, 4–23. Google Scholar | Crossref | |
|
Bradshaw, C. P., Buckley, J., Ialongo, N. (2008). School-based service utilization among urban children with early-onset educational and mental health problems: The squeaky wheel phenomenon. School Psychology Quarterly, 23, 169–186. Google Scholar | Crossref | ISI | |
|
Breton, J. J., Bergeron, L., Valla, J., Berthiaume, C. P., Gaudet, N., Lepine, S. (1999). Quebec child mental health survey: Prevalence of SDM-III-R mental health disorders. Journal of Child Psychology and Psychiatry, 40, 375–384. Google Scholar | Crossref | Medline | ISI | |
|
Caldarella, P., Young, E. L., Richardson, M. J., Young, B. J., Young, K. R. (2008). Validation of the systematic screening for behavior disorders in middle and junior high school. Journal of Emotional and Behavioral Disorders, 16, 105–117. doi:10.1177/1063426607313121 Google Scholar | SAGE Journals | ISI | |
|
Caprara, G. V., Barbaranelli, C., Pastorelli, C., Bandura, A., Zimbardo, P. G. (2000). Prosocial foundations of children’s academic achievement. Psychological Science, 11, 302–306. Google Scholar | SAGE Journals | ISI | |
|
Coie, J. D., Dodge, K. A., Coppotelli, H. (1982). Dimensions and types of social status: A cross-age perspective. Developmental Psychology, 18, 557–570. Google Scholar | Crossref | ISI | |
|
Costello, E. J., Erkanli, A., Angold, A. (2006). Is there an epidemic of child or adolescent depression? Journal of Child Psychology and Psychiatry, 47, 1263–1271. doi:10.1111/j.1469-7610.2006.01682.x Google Scholar | Crossref | Medline | ISI | |
|
Costello, E. J., Mustillo, S., Erkanli, A., Keeler, G., Angold, A. (2003). Prevalence and development of psychiatric disorders in childhood and adolescence. Archives of General Psychiatry, 60, 837–844. doi:10.1001/archpsyc.60.8.837 Google Scholar | Crossref | Medline | |
|
Crick, N., Grotpeter, J., Bigbee, M. (2002). Relationally and physically aggressive children’s intent attributions and feelings of distress for relational and instrumental peer provocations. Child Development, 73, 1134–1142. Google Scholar | Crossref | Medline | ISI | |
|
Cronbach, L. J., Shavelson, R. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391–418. Google Scholar | SAGE Journals | ISI | |
|
Drummond, T. (1994). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program. Google Scholar | |
|
Elliott, S. N., Gresham, F. M. (2007). Social skills improvement system: Performance screening guides. Bloomington, MN: Pearson Assessments. Google Scholar | |
|
Forness, S. R., Freeman, S. F. N., Paparella, T., Kauffman, J. M., Walker, H. M. (2012). Special education implications of point and cumulative prevalence for children with emotional or behavioral disorders. Journal of Emotional and Behavioral Disorders, 20, 4–18. Google Scholar | SAGE Journals | ISI | |
|
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. Google Scholar | Crossref | Medline | ISI | |
|
Hatcher, L. (1994). A step-by-step approach to using SAS system for factor analysis and structural equation modeling. Cary, NC: The SAS Institute. Google Scholar | |
|
Hinshaw, S. (1992). Externalizing behavior problems and academic underachievement in childhood and adolescence: Casual relationships and underlying mechanisms. Psychological Bulletin, 111, 127–155. Google Scholar | Crossref | Medline | ISI | |
|
Hopkins, W. G. (2002). A scale of magnitudes for the effect statistics (A new view of statistics). Retrieved from http://www.sportsci.org/resource/stats/index.html Google Scholar | |
|
Individuals with Disabilities Education Improvement Act of 2004 , 20 U.S.C. 1400 et esq. (2004). Google Scholar | |
|
Kamphaus, R. W., Reynolds, C. R. (2007). BASC-2 behavior and emotional screening system (BASC-2 BESS). San Antonio, TX: Pearson. Google Scholar | |
|
Kessler, R. C., Berglund, P. A., Demler, O., Jin, R., Walters, E. E. (2005). Lifetime prevalence and age-of-onset distributions of DSM-IV disorders in the National Comorbidity Survey Replication (NCS-R). Archives of General Psychiatry, 62, 593–602. Google Scholar | Crossref | Medline | |
|
Lane, K. L., Bruhn, A. L., Eisner, S. L., Kalberg, J. R. (2010). Score reliability and validity of the Student Risk Screening Scale: A psychometrically-sound, feasible tool for use in urban middle schools. Journal of Emotional and Behavioral Disorders, 18, 211–224. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Kalberg, J. R., Lambert, W., Crnobori, M., Bruhn, A. (2010). A comparison of systematic screening tools for emotional and behavioral disorders: A replication. Journal of Emotional and Behavioral Disorders, 18, 100–112. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Kalberg, J. R., Menzies, H. M. (2009). Developing schoolwide programs to prevent and manage problem behaviors: A step-by-step approach. New York, NY: Guilford. Google Scholar | |
|
Lane, K. L., Kalberg, J. R., Parks, R. J., Carter, E. W. (2008). Student Risks Screening Scale: Initial evidence for score reliability and validity at the high school level. Journal of Emotional and Behavioral Disorders, 16, 178–190. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Menzies, H. M., Oakes, W. P., Kalberg, J. R. (2012). Systematic screenings of behavior to support instruction: From preschool to high school. New York, NY: Guilford. Google Scholar | |
|
Lane, K. L., Menzies, H. M., Oakes, W. P., Lambert, W., Cox, M. L., Hankins, K. (2012). A validation of the Student Risk Screening Scale for internalizing and externalizing behaviors: Patterns in rural and urban elementary schools. Behavioral Disorders, 37, 244–270. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Ennis, R. P., Cox, M. L., Schatschneider, C., Lambert, W. (2011). Additional evidence for the reliability and validity of the Student Risk Screening Scale at the high school level: A replication and extension. Journal of Emotional and Behavioral Disorders. Advance online publication. doi:10.1177/1063426611407339 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Harris, P. J., Menzies, H. M., Cox, M. L., Lambert, W. (2012). Initial evidence for the reliability and validity of the Student Risk Screening Scale for internalizing and externalizing behaviors at the elementary level. Behavioral Disorders, 37, 99–122. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Parks, R. J., Kalberg, J. R., Carter, E. W. (2007). Systematic screening at the middle school level: Score reliability and validity of the Students Risk Screening Scale. Journal of Emotional and Behavioral Disorders, 15, 209–222. Google Scholar | SAGE Journals | ISI | |
|
Malecki, C. K., Elliott, S. N. (2002). Children’s social behaviors as predictors of academic achievement: A longitudinal analysis. School Psychology Quarterly, 17, 1–23. Google Scholar | Crossref | ISI | |
|
Masten, A. S., Roisman, G. I., Long, J. D., Burt, K. B., Obradovic, J., Riley, J. R., Tellegen, A. (2005). Developmental cascades: Linking academic achievement and externalizing and internalizing symptoms over 20 years. Developmental Psychology, 41, 733–746. Google Scholar | Crossref | Medline | ISI | |
|
McEvoy, A., Welker, R. (2000). Antisocial behavior, academic failure, and school climate: A critical review. Journal of Emotional and Behavioral Disorders, 8, 130–140. Google Scholar | SAGE Journals | ISI | |
|
Meyer, E. P., Kaiser, H. F., Cerny, B. A., Green, B. G. (1977). MSA for a special Spearman matrix. Psychometrika, 42, 153–156. Google Scholar | Crossref | ISI | |
|
Midgley, C., Middleton, M. J., Gheen, M. H., Kumar, R. (2002). Stage-environment fit revisited: A goal theory approach to examining school transitions. In Midgley, C. (Ed.), Goals, goal structures, and patterns of adaptive learning (pp. 109–142). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Morris, R. J., Shah, K., Morris, Y. P. (2002). Internalizing behavior disorders. In Lane, K. L., Gresham, F. M., O’Shaughnessy, T. E. (Eds.), Interventions for children with or at risk for emotional and behavioral disorders (pp. 223–241). Boston, MA: Allyn & Bacon. Google Scholar | |
|
National Center for Education Statistics . (2012). Common Core of Data. Retrieved from http://nces.ed.gov/ccd/ Google Scholar | |
|
National Middle School Association and National Association of Elementary School Principals . (2002). Supporting students in their transition to middle school. Westerville. OH: Author. Google Scholar | |
|
Nunnally, J. C., Bernstein, I. H. (1994). Psychometric theory (3rd ed.). St. Louis, MO: McGraw-Hill. Google Scholar | |
|
Pellegrini, A. D., Long, J. D. (2002). A longitudinal study of bullying, dominance, and victimization during the transition from primary school through secondary school. British Journal of Developmental Psychology, 20, 259–280. Google Scholar | Crossref | ISI | |
|
Rapport, M. D., Denny, C. B., Chung, K., Hustace, K. (2001). Internalizing behavior problems and scholastic achievement in children: Cognitive mediators and pathways as mediators of outcomes. Journal of Clinical Child Psychology, 30, 536–551. Google Scholar | Crossref | Medline | |
|
Siedman, E., Allen, L., Aber, J. L., Mitchell, C., Feinman, J. (1994). The impact of school transitions in early adolescence on the self-system and perceived social context of poor urban youth. Child Development, 65, 507–522. Google Scholar | Crossref | Medline | ISI | |
|
Siperstein, G. N., Wiley, A. L., Forness, S. R. (2011). School context and the academic and behavioral progress of students with emotional disturbance. Behavioral Disorders, 36, 172–184. Google Scholar | ISI | |
|
Tennessee Department of Education . (2012). No Child Left Behind: Frequently asked questions. Retrieved from http://www.tn.gov/education/nclb/ayp/doc/AYP_2011-12_FAQ.pdf Google Scholar | |
|
U.S. Department of Education, Office of Special Education Programs, Data Analysis System . (2004). Percentage of children ages 6-21 served under Part B: By disability (Table AA11). Washington, DC: Data Accountability Center. Google Scholar | |
|
Walker, H. M., Severson, H. (1992). Systematic screening for behavior disorders: User’s guide and technical manual. Longmont, CO: Sopris West. Google Scholar | |
|
Walker, L. S., Beck, J. E., Garber, J., Lambert, W. (2009). Children’s Somatization Inventory: Psychometric properties of the revised form (CSI-24). Journal of Pediatric Psychology, 34, 430–440. Google Scholar | Crossref | Medline | ISI |

