![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Researchers investigated the diagnostic utility of the Social Skills Improvement System: Performance Screening Guide (SSIS-PSG). Correlational, regression, receiver operating characteristic (ROC), and conditional probability analyses were run to compare ratings on the SSIS-PSG subscales of Prosocial Behavior, Reading Skills, and Math Skills, to report card grades for conduct, reading, and math, respectively. Respective subscales were all statistically significantly correlated with one another. In addition, all regressions indicated significant predictions for the SSIS-PSG to respective report card grades. ROC analyses for SSIS-PSG Math with math grades and SSIS-PSG Reading with reading grades were statistically significant and described as fair. ROC analysis for SSIS-PSG Prosocial Behavior with conduct grades was not significant and described as poor. In a conditional probability analysis, the variable of concern for screeners concerns false negative ratios; all estimates for this fell within the targeted range.
Keywords PBS, screening, predictive validity, psychometrics, diagnostic utility
References
Section:
|
Anastasi, A., Urbina, S. (1988). Psychological testing (7th ed.). Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Basham, J. D., Israel, M., Graden, J., Poth, R., Winston, M. (2010). A comprehensive approach to RTI: Embedding universal design for learning and technology. Learning Disability Quarterly, 33, 243-255. doi:10.1177/073194871003300403 Google Scholar | SAGE Journals | ISI | |
|
Compton, D. L., Fuchs, D., Fuchs, L. S., Bouton, B., Gilbert, J. K., Barquero, L. A., Crouch, R. C. (2010). Selecting at-risk first-grade readers for early intervention: Eliminating false positives and exploring the promise of a two-stage gated screening process. Journal of Educational Psychology, 102, 327-340. doi:10.1037/a0018448 Google Scholar | Crossref | Medline | ISI | |
|
Crosby, J. W. (2011). Test review: F. M. Gresham & S. N. Elliott Social Skills Improvement System Rating Scales. Minneapolis, MN: NCS Pearson, 2008. Journal of Psychoeducational Assessment, 29, 292-296. doi:10.1177/0734282910385806 Google Scholar | SAGE Journals | |
|
Dever, B. V., Mays, K. L., Kamphaus, R. W., Dowdy, E. (2012). The factor structure of the BASC-2 Behavioral and Emotional Screening System teacher form, child/adolescent. Journal of Psychoeducational Assessment, 30, 488-495. doi:10.1177/0734282912438869 Google Scholar | SAGE Journals | ISI | |
|
Distefano, C., Kamphaus, R. W. (2007). Development and validation of a behavioral screener for preschool-age children. Journal of Behavioral and Emotional Disorders, 15, 93-102. doi:10.1177/10634266070150020401 Google Scholar | SAGE Journals | ISI | |
|
Doll, B., Jones, K. (2010). Review of the Social Skills Improvement System Rating Scales. In Spies, R. A., Carlson, J. F., Geisinger, K. F., Murphy, L. L. (Eds.), Mental measurements yearbook (pp. 561-565). Lincoln: University of Nebraska, Buros Institute of Mental Measurements. Google Scholar | |
|
Dowling, G. R. (1986). Perceived risk: The concept and its measurement. Psychology & Marketing, 3, 193-210. Google Scholar | Crossref | |
|
Drummond, T. (1994). The Student Risk Screening Scale (SRSS). Grants Pass, OR: Josephine County Mental Health Program. Google Scholar | |
|
Elliot, S. N., Gresham, F. M. (2008). Social Skills Improvement System: Classwide intervention program teacher’s guide. Bloomington, MN: Pearson. Google Scholar | |
|
Epstein, M. H., Harniss, M. K., Pearson, N., Ryser, G. (1999). The Behavioral and Emotional Rating Scale: Test-retest and inter-rater reliability. Journal of Child and Family Studies, 8, 319-327. doi:10.1023/A:1022067329751 Google Scholar | Crossref | |
|
Epstein, M. H., Sharma, H. M. (1998). Behavioral and Emotional Rating Scale. Austin, TX: Pro-Ed. Google Scholar | |
|
Glover, T. A., Albers, C. A. (2007). Considerations for evaluating universal screening assessments. Journal of School Psychology, 45, 117-135. doi:10.1016/j.jsp.2006.05.005 Google Scholar | Crossref | ISI | |
|
Good, R. H., Kaminski, R. A. (Eds.). (2002). Dynamic indicators of basic early literacy skills (6th ed.). Eugene, OR: Institute for the Development of Educational Achievement. Google Scholar | |
|
Goodman, R. (1997). The Strengths and Difficulties Questionnaire: A research note. Journal of Child Psychology and Psychiatry, 38, 581-586. doi:10.1111/j.1469-7610.1997.tb01545 Google Scholar | Crossref | Medline | ISI | |
|
Goodman, R., Scott, S. (1999). Comparing the Strengths and Difficulties Questionnaire and the Child Behavior Checklist: Is small beautiful? Journal of Abnormal Child Psychology, 27, 17-24. doi:10.1023/A:1022658222914 Google Scholar | Crossref | Medline | ISI | |
|
Gredler, G. R. (1997). Issues in early childhood screening and assessment. Psychology in the Schools, 34, 99-106. Google Scholar | Crossref | ISI | |
|
Gresham, F. M., Elliott, S. N. (1990). Social Skills Rating System. Minneapolis, MN: Pearson Assessments. Google Scholar | |
|
Gresham, F. M., Elliott, S. N. (2008). Social Skills Improvement System-Rating Scales. Minneapolis, MN: Pearson Assessments. Google Scholar | |
|
Gresham, F. M., Elliott, S. N., Cook, C. R., Vance, M. J., Kettler, R. (2010). Cross-informant agreement for ratings for social skill and problem behavior ratings: An investigation of the Social Skills Improvement System—Rating Scales. Psychological Assessment, 22, 157-166. doi:10.1037/a0018124 Google Scholar | Crossref | Medline | ISI | |
|
Gresham, F. M., Elliott, S. N., Vance, M. J., Cook, C. R. (2011). Comparability of the Social Skills Rating System to the Social Skills Improvement System: Content and psychometric comparisons across elementary and secondary age levels. School Psychology Quarterly, 26, 27-44. doi:10.1037/a0022662 Google Scholar | Crossref | ISI | |
|
Harniss, M. K., Epstein, M. H., Ryser, G., Pearson, N. (1999). The Behavioral and Emotional Rating Scale convergent validity. Journal of Psychoeducational Assessment, 17, 4-14. doi:10.1177/073428299901700101 Google Scholar | SAGE Journals | ISI | |
|
Irvin, L. K., Tobin, T. J., Sprague, J. R., Sugai, G., Vincent, C. G. (2004). Validity of office discipline referral measures as indices of school-wide behavioral status and effects of school-wide behavioral interventions. Journal of Positive Behavior Interventions, 6, 131-147. doi:10.1177/10983007040060030201 Google Scholar | SAGE Journals | ISI | |
|
Jamieson, S. (2004). Likert scales: How to (ab)use them. Medical Education, 38, 1217-1218. doi:10.1111/j.1365-2929.2004.02012 Google Scholar | Crossref | Medline | ISI | |
|
Jussim, L. (1991). Grades may reflect more than performance: Comment on Wentzel (1989). Journal of Educational Psychology, 83, 153-155. doi:10.1037/0022-0663.83.1.153 Google Scholar | Crossref | ISI | |
|
Kamphaus, R. W., Reynolds, C. R. (2007). BASC-2 Behavioral and Emotional Screening System (BASC-2 BESS). Circle Pines, MN: AGS Publishing. Google Scholar | |
|
Kern, L., Manz, P. (2004). A look at current validity issues of school-wide behavior support. Behavioral Disorders, 30, 47-59. Google Scholar | SAGE Journals | ISI | |
|
Kessel, J. B., Zimmerman, M. (1993). Reporting errors in studies of the diagnostic performance of self-administered questionnaires: Extent of the problem, recommendations for standardized presentation of results, and implications for the peer review process. Psychological Assessment, 5, 395-399. doi:10.1037/1040-3590.5.4.395 Google Scholar | Crossref | |
|
Kettler, R. J., Elliott, S. N., Davies, M., Griffin, P. (2012). Testing a multi-stage screening system: Predicting performance on Australia’s national achievement test using teachers’ ratings of academic and social behaviors. School Psychology International, 33, 93-111. doi:10.1177/0143034311403036 Google Scholar | SAGE Journals | ISI | |
|
Krach, S. K., McCreery, M. P. (2015). Technology and positive behavioral interventions and support: Evaluation, selection, and implementation of computer-based socioemotional training. In Tettegah, S. Y., Espelage, D. (Eds.), Emotions and technology, communication of feelings for, with and through digital media: Emotions, technology, and behavior. Waltham, MA: Elsevier Google Scholar | |
|
Krach, S. K., McCreery, M. P., Vallett, D. (2016, February). Interconnected relationships: Academic skills, school behaviors, and motivation to learn. Presentation at the National Association of School Psychologists Annual Convention, New Orleans, LA. Google Scholar | |
|
Landau, S., Milich, R., Widiger, T. A. (1991). Predictive power methods may be more helpful for making a diagnosis than sensitivity and specificity. Journal of Child and Adolescent Psychopharmacology, 1, 343-351. doi:10.1089/cap.1991.1.343 Google Scholar | Crossref | Medline | |
|
Landis, J. R., Koch, G. (1977). The measurement of observer agreement for categorical data. Biometrics, 33, 159-174. doi:10.2307/2529310 Google Scholar | Crossref | Medline | ISI | |
|
Lane, K. L., Kalberg, J. R., Menzies, H. M. (2009). Developing schoolwide programs to prevent and manage problem behaviors: A step-by-step approach. New York, NY: Guilford Press. Google Scholar | |
|
Lane, K. L., Kalberg, J. R., Menzies, H. M., Bruhn, A., Eisner, S., Crnobori, M. (2011). Using systematic screening data to assess risk and identify students for targeted supports: Illustrations across the K-12 continuum. Remedial and Special Education, 32, 39-54. doi:10.1177/0741932510361263 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Kalberg, J. R., Parks, R. J., Carter, E. W. (2008). Student Risk Screening Scale: Initial evidence for score reliability and validity at the high school level. Journal of Emotional and Behavioral Disorders, 16, 178-190. doi:10.1177/1063426608314218 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Oakes, W. P., Common, E. A., Zorigian, K., Brunsting, N. C., Schatschneider, C. (2015). A comparison between SRSS-IE and SSIS-PSG scores: Examining convergent validity. Assessment for Effective Intervention, 40, 114-126. doi:10.1177/1534508414560346 Google Scholar | SAGE Journals | |
|
Lane, K. L., Oakes, W. P., Menzies, H. (2010). Systematic screenings to prevent the development of learning and behavior problems: Considerations for practitioners, researchers, and policy makers. Journal of Disability Policy Studies, 21, 160-172. doi:10.1177/1044207310379123 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Parks, R. J., Kalberg, J. R., Carter, E. W. (2007). Systematic screening at the middle school level: Score reliability and validity of the Student Risk Screening Scale. Journal of Emotional and Behavioral Disorders, 15, 209-222. doi:10.1177/10634266070150040301 Google Scholar | SAGE Journals | ISI | |
|
Lane, K. L., Richards-Tutor, C., Oakes, W. P., Connor, K. (2013). Initial evidence for the reliability and validity of the student risk screening scale with elementary age English learners. Assessment for Effective Intervention, 39, 219-232. doi:10.1177/1534508413496836 Google Scholar | SAGE Journals | |
|
Lane, K. L., Wehby, J., Robertson, E. J., Rogers, L. (2007). How do different types of high school students respond to schoolwide positive behavior support programs? Characteristics and responsiveness of teacher-identified students. Journal of Emotional and Behavioral Disorders, 15, 3-20. doi:10.1177/10634266070150010201 Google Scholar | SAGE Journals | ISI | |
|
Lee-Farmer, J. (2010). Review of the Social Skills Improvement System Rating Scales. In Spies, R. A., Carlson, J. F., Geisinger, K. F., Murphy, L. L. (Eds.), Mental measurements yearbook (pp. 565-566). Lincoln, NE: University of Nebraska, Buros Institute of Mental Measurements. Google Scholar | |
|
Loeber, R., Farrington, D. P. (Eds.). (1998). Serious and violent juvenile offenders: Risk factors and successful interventions. Thousand Oaks, CA: Sage. Google Scholar | |
|
McCarthy, J. D., Hoge, D. R. (1987). The social construction of school punishment: Racial disadvantage out of universalistic process. Social Forces, 65, 1101-1120. doi:10.1093/sf/65.4.1101 Google Scholar | Crossref | ISI | |
|
McFall, R. M., Treat, T. A. (1999). Quantifying the information value of clinical assessments with signal detection theory. Annual Review of Psychology, 50, 215-241. doi:10.1146/annurev.psych.50.1.215 Google Scholar | Crossref | Medline | ISI | |
|
Menzies, H. M., Lane, K. L. (2012). Validity of the Student Risk Screening Scale: Evidence of predictive validity in a diverse, suburban elementary setting. Journal of Emotional and Behavioral Disorders, 20, 82-91. doi:10.1177/1063426610389613 Google Scholar | SAGE Journals | ISI | |
|
Milich, R., Widiger, T. A., Landau, D. (1987). Differential diagnosis of attention deficit and conduct disorders using conditional probabilities. Journal of Consulting and Clinical Psychology, 55, 762-767. doi:10.1037/0022-006X.55.5.762 Google Scholar | Crossref | Medline | ISI | |
|
Office of Special Education Programs. (2009, March). Is school-wide positive behavior support an evidence-based practice? Retrieved from http://www.pbis.org/research Google Scholar | |
|
Onwuegbuzie, A. J., Daniel, L. G. (2002). A framework for reporting and interpreting internal consistency reliability estimates. Measurement and Evaluation in Counseling and Development, 35, 89-103. Google Scholar | ISI | |
|
Pas, E. T., Bradshaw, C. P., Hershfeldt, P. A., Leaf, P. J. (2010). A multilevel exploration of the influence of teacher efficacy and burnout on response to student problem behavior and school-based service use. School Psychology Quarterly, 25, 13-27. doi:10.1037/a0018576 Google Scholar | Crossref | ISI | |
|
Pearson Education . (2014). AIMSweb. New York, NY: NCS Pearson. Google Scholar | |
|
Pyhältö, K., Pietarinen, J., Soini, T. (2015). When teaching gets tough—Professional community inhibitors of teacher-targeted bullying and turnover intentions. Improving Schools, 18, 263-276. doi:10.1177/1365480215589663 Google Scholar | SAGE Journals | ISI | |
|
Reynolds, C. R., Kamphaus, R. W. (2004). Behavior assessment system for children (2nd ed.). Circle Pines, MN: AGS Publishing. Google Scholar | |
|
Richards, J. M., Gross, J. J. (2006). Personality and emotional memory: How regulating emotion impairs memory. Journal of Research in Personality, 40, 631-651. Google Scholar | Crossref | ISI | |
|
Sattler, J. M. (2008). Assessment of children: Cognitive applications (5th ed.). San Diego, CA: Author. Google Scholar | |
|
Skiba, R. J., Michael, R. S., Nardo, A. C., Peterson, R. L. (2002). The color of discipline: Sources of racial and gender disproportionality in school punishment. The Urban Review, 34, 317-342. doi:10.1023/A:1021320817372 Google Scholar | Crossref | |
|
Sprague, J. R., Walker, H. M. (2005). Safe and healthy schools: Practical prevention strategies. New York, NY: Guilford Press. Google Scholar | |
|
Sugai, G., Horner, R. R. (2006). A promising approach for expanding and sustaining school-wide positive behavior support. School Psychology Review, 35, 245-259. Google Scholar | ISI | |
|
Sugai, G., Sprague, J. R., Horner, R. H., Walker, H. M. (2000). Preventing school violence: The use of office discipline referrals to assess and monitor school-wide discipline interventions. Journal of Emotional and Behavioral Disorders, 8, 94-101. doi:10.1177/106342660000800205 Google Scholar | SAGE Journals | ISI | |
|
Swets, J. A. (1992). The science of choosing the right decision threshold in high-stake diagnostics. American Psychologist, 47, 522-532. doi:10.1037/0003-066X.47.4.522 Google Scholar | Crossref | Medline | ISI | |
|
Tabachnick, B. G., Fidell, L. S. (1996). Using multivariate statistics (3rd ed.). New York, NY: HarperCollins. Google Scholar | |
|
U.S. Department of Education, National Center for Education Statistics . (2007–2008). Schools and Staffing Survey (SASS): Public school teacher data file. Retrieved from http://nces.ed.gov/surveys/SASS/tables/sass0708_2009324_t1s_08.asp Google Scholar | |
|
Walker, H. M., Severson, H. (1992). Systematic Screening for Behavior Disorders: Technical manual. Longmont, CO: Sopris West. Google Scholar | |
|
Walker, H. M., Severson, H. H., Feil, E. G. (2010). Systematic Screening for Behavior Disorders (SSBD). Longmont, CO: Sopris West. Google Scholar | |
|
Walker, H. M., Severson, H. H., Todis, B. J., Block-Pedego, A. E., Williams, G. J., Haring, N. G., Barckley, M. (1990). Systematic Screening for Behavior Disorders (SSBD): Further validation, replication, and normative data. Remedial and Special Education, 11(2), 32-46. doi:10.1177/074193259001100206 Google Scholar | SAGE Journals | ISI | |
|
Wentzel, K. R. (1989). Adolescent classroom goals, standards for performance, and academic achievement: An interactionist perspective. Journal of Educational Psychology, 81, 131-142. doi:10.1037/0022-0663.81.2.131 Google Scholar | Crossref | ISI | |
|
Zins, J. E., Bloodworth, M. R., Weissberg, R. P., Walberg, H. J. (2007). The scientific base linking social and emotional learning to school success. Journal of Educational and Psychological Consultation, 17, 191-210. doi:10.1080/10474410701413145 Google Scholar | Crossref | ISI |
