Abstract
We report findings of a validation study exploring the Student Risk Screening Scale (SRSS; Drummond, 1994) for use with English learners (ELs) attending a large suburban elementary school. First, we explored the reliability of the SRSS by examining internal consistency, with results indicating adequate internal consistency (.83). Second, we examined and established a convergent validity of the SRSS scores with the social skills improvement system–performance screening guide (SSiS-PSG; Gresham & Elliott, 2007) and the systematic screening for behavior disorders (SSBD; Walker & Severson, 1992). Results indicated that SRSS scores were negatively correlated with SSiS-PSG scores, thereby suggesting that an increased behavioral risk is associated with decreases in teacher-reported reading performance, math performance, motivation to learn, and prosocial behaviors. In addition, the results yielded additional evidence of convergent validity with SSBD and SRSS scores. SRSS scores improved the chance estimates of predicting the internalizing behaviors of ELs (area under the curve [AUC] = .72) and externalizing behaviors of ELs (AUC = .98) as measured by the SSBD. Third, we examined the relation between SRSS scores and academic performance as measured by dynamic indicators of basic early literacy skills Next (Good & Kaminski, 2011), which suggested an inverse relation (r = −.41). Fourth, we examined the teachers’ perceptions of the screening tool.
|
Abedi, J. (2002). Standardized achievement tests and English language learners: Psychometrics issues. Educational Assessment, 8, 231–257. Google Scholar | Crossref | |
|
Achenbach, T. M. (1991). Integrative guide for the 1991 CBCL/4-18, YRS, & TRF profiles. Burlington: Department of Psychiatry, University of Vermont. Google Scholar | |
|
Artiles, A. J., Trent, S. C., Palmer, J. (2004). Culturally diverse students in special education: Legacies and prospects. In J. A. Banks & C. M. Banks (Evads.), Handbook of research on multicultural education (2nd ed., pp. 716–735). San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Artiles, A., Rueda, R., Salazar, J., Higareda, I. (2005). Within-group diversity in minority disproportionate representation: English language learners in urban school districts. Exceptional Children, 71, 283–300. Google Scholar | SAGE Journals | ISI | |
|
Aud, S., Fox, M., Kewal Ramani, A. (2010). Statistics and trends in the education of racial and ethnic groups (NCES 2010-015). Washington, DC: U.S. Department of Education. Google Scholar | |
|
Baker, S. K., Smolkowski, K., Katz, R., Fien, H., Seeley, J. R., Kame’enui, E. J, Thomas Beck, C. (2008). Reading fluency as a predictor of reading proficiency in low-performing, high poverty schools. School Psychology Review, 37, 18–37. Google Scholar | ISI | |
|
California Department of Education . (2010–2011). Data Quest. Retrieved from http://dq.cde.ca.gov/dataquest/ Google Scholar | |
|
Castro-Olivio, S. C., Preciado, J. A., Sanford, A. K., Perry, V. (2011). The academic and social-emotional needs of secondary Latino English learners: Implications for screening, identification, and instructional planning. Exceptionality, 19, 160–174. Google Scholar | Crossref | ISI | |
|
Cummings, K. D., Kaminski, R. A., Good, R. H., O’Neil, M. E. (2011). Assessing phonemic awareness in preschool and kindergarten: Development and initial validation of First Sound Fluency. Assessment for Effective Intervention, 36, 94–106. Google Scholar | SAGE Journals | |
|
Dawson, B. A., Williams, S. A. (2008). The impact of language status as an acculturative stressor on internalizing and externalizing behaviors among Latino/a children: A longitudinal analysis from school entry through third grade. Journal of Youth and Adolescence, 37, 399–411. Google Scholar | Crossref | ISI | |
|
Deno, S. (2003). Developments in curriculum-based measurement. The Journal of Special Education, 37, 184–192. Google Scholar | SAGE Journals | ISI | |
|
DiPerna, J. C., Elliott, S. N. (2002). Promoting academic enablers to improve student achievement: An introduction to the mini-series. School Psychology Review, 31, 293–297. Google Scholar | ISI | |
|
DiPerna, J. C., Volpe, R. J., Elliott, S. N. (2002). A model of academic enablers and elementary reading/language arts achievement. School Psychology Review, 31, 298–312. Google Scholar | ISI | |
|
Dowdy, E., Dever, B. V., DiStefano, C., Chin, J. K. (2011). Screening for emotional and behavioral risk among students with limited English proficiency. School Psychology Quarterly, 26, 14–26. doi:10.1037/a0022072 Google Scholar | Crossref | ISI | |
|
Drummond, T. (1994). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program. Google Scholar | |
|
Edl, H. M., Jones, M. H., Estell, D. B. (2008). Ethnicity and English proficiency: Teacher perceptions of academic and interpersonal competence in European American and Latino students. School Psychology Review, 37, 38–45. Google Scholar | ISI | |
|
Elliott, S. N., Gresham, F. M. (2007). Social skills improvement system: Performance screening guide. Bloomington, MN: Pearson Assessments. Google Scholar | |
|
Fallon, L. M., O’Keeffe, B. V., Sugai, G. (2012). Consideration of culture and context in school-wide positive behavior support: A review of the current literature. Journal of Positive Behavior Interventions, 14, 209–219. Google Scholar | SAGE Journals | ISI | |
|
Fien, H., Baker, S. K., Smolkowski, K., Smith, J. L. M., Kame’enui, E. J., Beck, T. (2008). Using nonsense word fluency to predict reading proficiency in kindergarten through second grade for English learners and native English speakers. School Psychology Review, 37, 391–408. Google Scholar | ISI | |
|
Gersten, R., Woodard, J. (1994). The language minority student and special education: Issues, trends, and paradoxes. Exceptional Children, 60, 310–322. Google Scholar | SAGE Journals | ISI | |
|
Glover, T. A., Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117–135. Google Scholar | Crossref | ISI | |
|
Good, R. H., Kaminski, R. A. (with Cummings, K., Dufour-Martel, Petersen C., Powell-Smith, K., Stollar, K., Wallin, J. S). (2011). DIBELS Next assessment manual. Eugene, OR: Dynamic Measurement Group. Google Scholar | |
|
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581–586. Google Scholar | Crossref | Medline | ISI | |
|
Gresham, F. M., Elliott, S. N. (2008) Social skills improvement system: Rating scale manual. Bloomington, MN: Pearson Assessments. Google Scholar | |
|
Gresham, F. M., Lane, K. L., Lambros, K. M. (2000). Comorbidity of conduct problems and ADHD: Identification of “fledgling psychopaths.” Journal of Emotional and Behavioral Disorders, 8, 83–93. Google Scholar | SAGE Journals | ISI | |
|
Halle, T., Hair, E., Wandner, L., McNamara, M., Chien, N. (2012). Predictors and outcomes of early versus later English language proficiency among English language learners. Early Childhood Research Quarterly, 27, 1–20. Google Scholar | Crossref | Medline | ISI | |
|
Harris, P. J., Oakes, W. P., Lane, K. L., Rutherford, R. B. (2009). Improving the early literacy skills of students at risk for internalizing or externalizing behaviors with limited reading skills. Behavioral Disorders, 34, 72–90. Google Scholar | SAGE Journals | ISI | |
|
Harry, B., Klingner, J. (2006). Why are so many minority students in special educations? Understanding race and disabilities in schools. New York, NY: Teachers College Press. Google Scholar | |
|
Hatcher, L., Stepanski, E. J. (1994). A step-by-step approach to using the SAS system for univariate and multivariate statistics. Cary, NC: SAS Institute. Google Scholar | |
|
Hopkins, W. G. (2002). A scale of magnitudes for the effect statistics. In A new view of statistics. Retrieved from http://www.sportsci.org/resource/stats/index.html Google Scholar | |
|
Individuals with Disabilities Education Improvement Act of 2004, 20 U.S.C. 1400 et esq . (2004). Reauthorization of Individuals with Disabilities Act 1990. Google Scholar | |
|
Institute . (2004). SAS/STAT 9.1: User’s guide. Cary, NC: SAS Publishing. Google Scholar | |
|
Kamphaus, R. W., Reynolds, C. R. (2007). Behavior Assessment System for Children-2nd edition (BASC-2): Behavior and Emotional Screening System (BESS). Bloomington, MN: Pearson. Google Scholar | |
|
Kamps, D., Wills, H. P., Heitzman-Powell, L., Laylin, J., Szoke, C., Petrillo, T., Culey, A. (2011). Class-wide function related intervention teams: Effects of group contingency programs in urban classrooms. Journal of Positive Behavior Interventions, 13, 154–176. doi:10.1177/1098300711398935 Google Scholar | SAGE Journals | ISI | |
|
Kauffman, J. M. (2001). Characteristics of emotional and behavioral disorders of children and youth (7th ed.). Columbus, OH: Merrill. Google Scholar | |
|
Lane, K. L., Kalberg, J. R., Bruhn, A. L., Mahoney, M. E., Driscoll, S. A. (2008). Primary prevention programs at the elementary level: Issues of treatment integrity, systematic screening, and reinforcement. Education & Treatment of Children, 31, 465–494. Google Scholar | Crossref | |
|
Lane, K. L., Little, M. A., Casey, A. M., Lambert, W., Wehby, J. H., Weisenbach, J. L., Phillips, A. (2009). A comparison of systematic screening tools for emotional and behavioral disorders: How do they compare? Journal of Emotional and Behavioral Disorders, 17, 93–105. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Menzies, H. M. (2002). The effects of a school-based primary intervention program: Preliminary outcomes. Preventing School Failure, 47, 26–32. Google Scholar | Crossref | |
|
Lane, K. L., Menzies, H., Bruhn, A., Crnobori, M. (2011). Research-based practices for preventing and responding to behavior problems: Effective, practical strategies that work. New York, NY: Guilford. Google Scholar | |
|
Lane, K. L., Menzies, H. M., Oakes, W. P., Kalberg, J. R. (2012). Systematic screenings of behavior to support instruction: From preschool to high school. New York, NY: Guilford. Google Scholar | |
|
Lane, K. L., Oakes, W. P. (2010). Social validity: Screening Tool Rating Scale. Unpublished rating scale. Google Scholar | |
|
Lane, K. L., Oakes, W. P., Ennis, R. P., Cox, M. L., Schatschneider, C., Lambert, W. (2013). Additional evidence for the reliability and validity of the Student Risk Screening Scale at the high school level: A replication and extension. Journal of Emotional and Behavioral Disorders. Advance online publication, 21, 97–115. doi:10.1177/1063426611407339 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Harris, P. J., Menzies, H. M., Cox, M. L., Lambert, W. (2012). Initial evidence for the reliability and validity of the Student Risk Screening Scale for internalizing and externalizing behaviors at the elementary level. Behavioral Disorders, 37, 99–122. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Menzies, H. M. (2010). Systematic screenings to prevent the development of learning and behavior problems: Considerations for practitioners, researchers, and policy makers. Journal of Disabilities Policy Studies, 21, 160–172. Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Menzies, H. M., Harris, P. J. (2013). Developing comprehensive, integrated, three-tiered models to prevent and manage learning and behavior. In Cole, T., Daniels, H., Visser, J. (Eds.), The Routledge international companion to emotional and behavioural difficulties problems (pp. 177–183). New York, NY: Routledge. Google Scholar | |
|
Lane, K. L., Parks, R. J., Kalberg, J. R., Carter, E. W. (2007). Systematic screening at the middle school level: Score reliability and validity of the students risk screening scale. Journal of Emotional and Behavioral Disorders, 15, 209–222. Google Scholar | SAGE Journals | ISI | |
|
McIntosh, K., Chard, D., Boland, J., Horner, R. (2006). A demonstration of combined efforts in school wide academic and behavioral systems and incidence of academic and behavior challenges in early elementary grades. Journal of Positive Behavior Interventions, 8, 146–154. Google Scholar | SAGE Journals | ISI | |
|
Menzies, H. M., Lane, K. L. (2012). Validity of the Student Risk Screening Scale: Evidence of predictive validity in a diverse, suburban elementary setting. Journal of Emotional and Behavioral Disorders, 20, 82–91. doi:10.1177/1063426610389613 Google Scholar | SAGE Journals | ISI | |
|
Montague, M., Enders, C., Castro, M. (2005). Academic and behavioral outcomes for students at risk for emotional and behavioral disorders. Behavioral Disorders, 31, 84–94. Google Scholar | SAGE Journals | ISI | |
|
Moore, D. W., Anderson, A., Kumar, K. (2005). Instructional adaptation in the management of escape-maintained behavior in a classroom. Journal of Positive Behavior Interventions, 7, 216–233. Google Scholar | SAGE Journals | ISI | |
|
National Center for Education Statistics . (2011). The condition of education: Participation in education. Washington, DC: Institute of Education Sciences, U.S. Department of Education. Retrieved from http://nces.ed.gov/programs/coe/indicator_lsm.asp Google Scholar | |
|
National Center for Education Statistics . (2012a). The nation’s report card: Mathematics 2011 (NCES 2012–458). Washington, DC: U.S. Department of Education. Google Scholar | |
|
National Center for Education Statistics . (2012b). The nation’s report card: Reading 2011 (NCES 2012–458). Washington, DC: U.S. Department of Education. Google Scholar | |
|
Nelson, J. R., Benner, G. J., Lane, K., Smith, B. W. (2004). An investigation of the academic achievement of K-12 students with emotional and behavioral disorders in public school settings. Exceptional Children, 71, 59–73. Google Scholar | SAGE Journals | ISI | |
|
No Child Left Behind (NCLB) Act of 2001, Pub. L. No. 107–110, § 115, Stat. 1425 (2002). Google Scholar | |
|
Nunnally, J. C., Bernstein, I. H. (1994). Psychometric theory (3rd ed.). St. Louis, MO: McGraw-Hill. Google Scholar | |
|
O’Connor, R. E., Jenkins, J. (1999). The prediction of reading disabilities in kindergarten and first grade. Scientific Studies of Reading, 3, 440–455. Google Scholar | Crossref | |
|
Office of English Language Acquisition . (2010). The growing numbers of English learner students. Retrieved from http://www.ncela.gwu.edu/files/uploads/9/growingLEP_0708.pdf Google Scholar | |
|
Pearson Education . (2010). AIMSweb behavior. Administration and technical manual. Bloomington, MN: Author. Google Scholar | |
|
Renshaw, T. L., Eklund, K., Dowdy, E., Jimerson, S. R., Hart, S. R., Earhart, J., Jones, C. N. (2009). Examining the relationship between scores on the behavior emotional screening system and student academic, behavioral, and engagement outcomes: An investigation of concurrent validity in elementary school. The California School Psychologist, 14, 81–88. Google Scholar | Crossref | |
|
Reynolds, C. R., Kamphaus, R. W. (2004). Behavioral assessment system for children (2nd ed.). Circle Pines, MN: American Guidance Service. Google Scholar | |
|
Riedel, B. W., Samuels, S. J. (2007). The relation between DIBELS, reading comprehension, and vocabulary in urban first-grade students. Reading Research Quarterly, 42, 546–567. Google Scholar | Crossref | ISI | |
|
Rumberger, R. (2011). Dropping out: Why students drop out of high school and what can be done about it. Cambridge, MA: Harvard University Press. Google Scholar | Crossref | |
|
Samson, J. F., Lesaux, N. K. (2009). Language-minority learners in special education: Rates and predictors of identification for services. Journal of Learning Disabilities, 42, 148–162. Google Scholar | SAGE Journals | ISI | |
|
Schilling, S. G., Carlisle, J. F., Scott, S. E., Zeng, J. (2007). Are fluency measures accurate predictors of reading achievement? The Elementary School Journal, 107, 429–448. Google Scholar | Crossref | ISI | |
|
Shavelson, R. J., Towne, L. (2002). Scientific research in education. Washington, DC: National Academy Press. Google Scholar | |
|
Short, D., Fitzsimmons, S. (2007). Double the work: Challenges and solutions to acquiring language and academic literacy for adolescent English language learners. A report to the Carnegie Corporation of New York. Washington, DC: Alliance for Excellent Education. Google Scholar | |
|
Todis, B., Severson, H. H., Walker, H. M. (1990). The Critical Events Scale: Behavioral profiles of students with externalizing and internalizing behavior disorders. Behavioral Disorders, 15, 75–86. Google Scholar | SAGE Journals | |
|
Vanderwood, M., Linklater, D., Healy, K. (2008). Nonsense word fluency and future literacy performance for English language learners. School Psychology Review, 37, 5–17. Google Scholar | |
|
Walker, H. M., Ramsey, E., Gresham, F. M. (2004). Antisocial behavior in school: Evidence-based practices. Belmont, CA: Wadsworth. Google Scholar | |
|
Walker, H. M., Seeley, J. R., Small, J., Severson, H. H., Graham, B. A., Feil, E. G., Forness, S. R. (2009). A randomized controlled trial of the first step to success early intervention: Demonstration of program efficacy outcomes in a diverse, urban school district. Journal of Emotional and Behavioral Disorders, 17, 197–212. Google Scholar | SAGE Journals | ISI | |
|
Walker, H. M., Severson, H. (1992). Systematic screening for behavior disorders: Technical manual. Longmont, CO: Sopris West. Google Scholar | |
|
Walker, H. M., Severson, H., Todis, B. J., Block-Pedego, A. E., Williams, G. J., Haring, N. G., Barckley, M. (1990). Systematic Screening for Behavior Disorders (SSBD): Further validation, replication, and normative data. RASE: Remedial and Special Education, 11, 32–46. Google Scholar | SAGE Journals | ISI | |
|
Wayman, M. M., Wallace, T., Wiley, H. I. (2007). Literature synthesis on curriculum-based measurement in reading. The Journal of Special Education, 41, 85–120. Google Scholar | SAGE Journals | ISI |

