![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
This randomized controlled field trial examined the efficacy of the Responsive Classroom (RC) approach on student achievement. Schools (n = 24) were randomized into intervention and control conditions; 2,904 children were studied from end of second to fifth grade. Students at schools assigned to the RC condition did not outperform students at schools assigned to the control condition in math or reading achievement. Use of RC practices mediated the relation between treatment assignment and improved math and reading achievement. Effect sizes (ES) were calculated as standardized coefficients. ES relations between use of RC practices and achievement were .26 for math and .30 for reading. The RC practices and math achievement relation was greater for students with low initial math achievement (ES = .89). Results emphasize fidelity of implementation.
References
|
Abbott, R. D., O’Donnell, J., Hawkins, J. D., Hill, K. G., Kosterman, R., Catalano, R. F. (1998). Changing teaching practices to promote achievement and bonding to school. American Journal of Orthopsychiatry, 68(4), 542–552. Google Scholar | Crossref | Medline | ISI | |
|
Abry, T., Brewer, A. J., Nathanson, L., Sawyer, B., Rimm-Kaufman, S. E. (2010). Classroom Practices Observation Measure. Unpublished measure, University of Virginia, Charlottesville, VA. Google Scholar | |
|
Abry, T., Rimm-Kaufman, S. E., Larsen, R. A. A., Brewer, A. J. (2013). The influence of fidelity of implementation on teacher-student interaction quality in the context of a randomized controlled trial of the Responsive Classroom approach. Journal of School Psychology, 51, 437–453. doi:http://dx.doi.org/10/1016/j.jsp.2013.03.001 Google Scholar | |
|
Allison, P. D. (2002). Missing data: Quantitative applications in the social sciences. British Journal of Mathematical and Statistical Psychology, 55(1), 193–196. Google Scholar | |
|
Baker, S., Gersten, R., Lee, D. (2002). A synthesis of empirical research on teaching mathematics to low-achieving students. Elementary School Journal, 103(1), 51–73. Google Scholar | Crossref | ISI | |
|
Battistich, V., Schaps, E., Wilson, N. (2004). Effects of an elementary school intervention on students’ “connectedness” to school and social adjustment during middle school. The Journal of Primary Prevention, 24(3), 243–262. Google Scholar | Crossref | |
|
Battistich, V., Solomon, D., Kim, D., Watson, M., Schaps, E. (1995). Schools as communities, poverty levels of student populations, and students’ attitudes, motives, and performance: A multilevel analysis. American Educational Research Journal, 32(3), 627–658. Google Scholar | SAGE Journals | ISI | |
|
Bickman, L., Riemer, M., Brown, J. L., Jones, S. M., Flay, B. R., Li, K. K., . . . Massetti, G. (2009). Approaches to measuring implementation fidelity in school-based program evaluations. Journal of Research in Character Education, 7(2), 75–101. Google Scholar | |
|
Bloom, H. S., Michalopoulos, C. (2010). When is the story in the subgroups? Prevention Science, 1–10. Google Scholar | Medline | ISI | |
|
Brackett, M. A., Reyes, M. R., Rivers, S. E., Elbertson, N. A., Salovey, P. (2011). Assessing teachers’ beliefs about social and emotional learning. Journal of Psychoeducational Assessment. Advance online publication. doi:10.1177/0734282911424879 Google Scholar | SAGE Journals | ISI | |
|
Brackett, M. A., Rivers, S. E., Reyes, M. R., Salovey, P. (2010). Enhancing academic performance and social and emotional competence with the RULER feeling words curriculum. Learning and Individual Differences, 22, 218–224. Google Scholar | Crossref | ISI | |
|
Bradshaw, C. P., Koth, C. W., Thornton, L. A., Leaf, P. J. (2009). Altering school climate through school-wide positive behavioral interventions and supports: Findings from a group-randomized effectiveness trial. Prevention Science, 10(2), 100–115. Google Scholar | Crossref | Medline | ISI | |
|
Bradshaw, C. P., Mitchell, M. M., Leaf, P. J. (2010). Examining the effects of schoolwide positive behavioral interventions and supports on student outcomes results from a randomized controlled effectiveness trial in elementary schools. Journal of Positive Behavior Interventions, 12(3), 133–148. Google Scholar | SAGE Journals | ISI | |
|
Bradshaw, C. P., Zmuda, J. H., Kellam, S. G., Ialongo, N. S. (2009). Longitudinal impact of two universal preventive interventions in first grade on educational outcomes in high school. Journal of Educational Psychology, 101(4), 926–937. doi:10.1037/a0016586 Google Scholar | Crossref | Medline | ISI | |
|
Bryk, A. S., Sebring, P. B., Allensworth, E., Easton, J. Q., Luppescu, S. (2010). Organizing schools for improvement: Lessons from Chicago. Chicago, IL: University of Chicago Press. Google Scholar | |
|
Century, J. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. The American Journal of Evaluation, 31(2), 199–218. doi:10.1177/1098214010366173 Google Scholar | SAGE Journals | ISI | |
|
Claessens, A., Duncan, G., Engel, M. (2009). Kindergarten skills and fifth-grade achievement: Evidence from the ECLS-K. Economics of Education Review, 28(4), 415–427. Google Scholar | Crossref | ISI | |
|
Collaborative for Academic Social and Emotional Learning (CASEL) . (2013). CASEL guide: Effective social and emotional learning programs. Retrieved from www.casel.org/guide. Google Scholar | |
|
Conduct Problems Prevention Research Group . (2010). The effects of a multiyear universal social-emotional learning program: The role of student and school characteristics. Journal of Consulting and Clinical Psychology, 78(2), 156–168. Google Scholar | Crossref | Medline | ISI | |
|
Cook, T. D. (2005). Emergent principles for the design, implementation, and analysis of cluster-based experiments in social science. The Annals of the American Academy of Political and Social Science, 599(1), 176–198. Google Scholar | SAGE Journals | ISI | |
|
Cordray, D. S., Pion, G. M. (Eds.). (2006). Treatment strength and integrity: Models and methods. Washington, DC: American Psychological Association. Google Scholar | |
|
Crosnoe, R., Cooper, C. E. (2010). Economically disadvantaged children’s transitions into elementary school: Linking family processes, school contexts, and educational policy. American Educational Research Journal, 47(2), 258–291. Google Scholar | SAGE Journals | ISI | |
|
Crosnoe, R., Morrison, F., Burchinal, M., Pianta, R., Keating, D., Friedman, S. L., Clarke-Stewart, K. A. (2010). Instruction, teacher-student relations, and math achievement trajectories in elementary school. Journal of Educational Psychology, 102(2), 407–417. doi:10.1037/a0017762 Google Scholar | Crossref | Medline | ISI | |
|
Denton, P. (2005). Learning through academic choice. Turner Falls, MA: Northeast Foundation for Children. Google Scholar | |
|
Denton, P., Kriete, R. (2000). The first six weeks of school. Turner Falls, MA: Northeast Foundation for Children. Google Scholar | |
|
Domitrovich, C. E., Bradshaw, C. P., Poduska, J. M., Hoagwood, K., Buckley, J. A., Olin, S., . . . Ialongo, N. S. (2008). Maximizing the implementation quality of evidence-based preventive interventions in schools: A conceptual framework. Advances in School Mental Health Promotion, 1(3), 6–28. Google Scholar | Crossref | Medline | |
|
Duckworth, A. L., Quinn, P. D., Tsukayama, E. (2012). What No Child Left Behind leaves behind: The roles of IQ and self-control in predicting standardized achievement test scores and report card grades. Journal of Educational Psychology, 104(2), 439–451. Google Scholar | Crossref | Medline | ISI | |
|
Duncan, G. J., Dowsett, C. J., Claessens, A., Magnuson, K., Huston, A. C., Klebanov, P., . . . Brooks-Gunn, J. (2007). School readiness and later achievement. Developmental Psychology, 43(6), 1428–1446. Google Scholar | Crossref | Medline | ISI | |
|
Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based universal interventions on social and emotional learning. Child Development, 82(1), 405–432. doi:10.1111/j.1467-8624.2010 .01564.x Google Scholar | Crossref | Medline | ISI | |
|
Dusenbury, L., Zadrazil, J., Mart, A., Weissberg, R. (2011). State learning standards to advance social and emotional learning: The state scan of social and emotional learning standards, preschool through high school. Retrieved from http://casel.org/wp-content/uploads/Forum-Brief-on-the-State-Scan-5-10-2011.pdf. Google Scholar | |
|
Elliott, S. N. (1999). A multi-year evaluation of the Responsive Classroom approach: Its effectiveness and acceptability in promoting social and academic competence. Retrieved from http://www.responsiveclassroom.org/PDF_files/final_report.pdf. Google Scholar | |
|
Enders, C. K., Bandalos, D. L. (2001). The relative performance of full information maximum likelihood estimation for missing data in structural equation models. Structural Equation Modeling, 8(3), 430–457. Google Scholar | Crossref | ISI | |
|
Evans, R. (2001). The human side of school change. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Fairchild, A. J., McQuillin, S. D. (2010). Evaluating mediation and moderation effects in school psychology: A presentation of methods and review of current practice. Journal of School Psychology, 48(1), 53–84. Google Scholar | Crossref | Medline | ISI | |
|
Frank, K. A., Zhao, Y., Borman, K. (2004). Social capital and the diffusion of innovations within organizations: The case of computer technology in schools. Sociology of Education, 77, 148–171. Google Scholar | SAGE Journals | ISI | |
|
Gershoff, E. T., Aber, J. L., Raver, C. C., Lennon, M. C. (2007). Income is not enough: Incorporating material hardship into models of income associations with parenting and child development. Child Development, 78(1), 70–95. Google Scholar | Crossref | Medline | ISI | |
|
Greenberg, M. T. (2010). School-based prevention: current status and future challenges. Effective Education, 2(1), 27–52. Google Scholar | Crossref | |
|
Harcourt Educational Measurement (2003). Stanford Achievement Test Series, Tenth Edition, Primary 2. New York: Harcourt Inc. Google Scholar | |
|
Hill, C. J., Bloom, H. S., Black, A. R., Lipsey, M. W. (2008). Empirical benchmarks for interpreting effect sizes in research. Child Development Perspectives, 2(3), 172–177. Google Scholar | Crossref | ISI | |
|
Hughes, J., Kwok, O. M. (2007). Influence of student-teacher and parent-teacher relationships on lower achieving readers’ engagement and achievement in the primary grades. Journal of Educational Psychology, 99(1), 39–51. doi:10.1037/0022-0663.99.1.39 Google Scholar | Crossref | Medline | ISI | |
|
Hulleman, C., Cordray, D. S. (2009). Moving from the lab to the field: The role of fidelity and achieved relative intervention strength. Journal of Research on Educational Effectiveness, 2(1), 88–110. Google Scholar | Crossref | |
|
Jones, S. M., Brown, J. L., Aber, J. (2011). Two-year impacts of a universal school-based social-emotional and literacy intervention: An Experiment in translational developmental research. Child Development, 82, 533–554. Google Scholar | Crossref | Medline | ISI | |
|
Kieffer, M. J. (2008). Catching up or falling behind? Initial English proficiency, concentrated poverty, and the reading growth of language minority learners in the United States. Journal of Educational Psychology, 100(4), 851–868. Google Scholar | Crossref | ISI | |
|
Klein, J., Moeschberger, M. (1997). Survival analysis: Techniques for censored and truncated regression. New York, NY: Springer-Verlag. Google Scholar | Crossref | |
|
Knowlton, L. W., Phillips, C. C. (2008). The logic model guidebook: Better strategies for great results. Thousand Oaks, CA: Sage. Google Scholar | |
|
Kriete, R. (2002). The Morning Meeting book. Turner Falls, MA: Northeast Foundation for Children. Google Scholar | |
|
Larsen, W. A., McCleary, S. J. (1972). The use of partial residual plots in regression analysis. Technometrics, 14(3), 781–790. Google Scholar | Crossref | ISI | |
|
Lee, V., Smith, J. B. (1999). Social support and achievement for young adolescents in Chicago: The role of school academic press. American Educational Research Journal, 36, 907–945. Google Scholar | SAGE Journals | ISI | |
|
Li-Grining, C. P., Votruba-Drzal, E., Maldonado-Carreño, C., Haas, K. (2010). Children’s early approaches to learning and academic trajectories through fifth grade. Developmental Psychology, 46(5), 1062–1077. doi:10.1037/a0020066 Google Scholar | Crossref | Medline | ISI | |
|
Little, R. J. A., Rubin, D. (1987). Statistical analysis with incomplete data. New York, NY: John Wiley & Sons. Google Scholar | |
|
Long, J. S. (1997). Regression models for categorical and limited dependent variables (Vol. 7). Thousand Oaks, CA: Sage. Google Scholar | |
|
May, H., Perez-Johnson, I., Haimson, J., Sattar, S., Gleason, P. (2009). Using state tests in education experiments: A discussion of the issues (NCEE 2009-013). Washington, DC: National Center for Education Evaluation and Regional Assistance. Google Scholar | |
|
Murray, D. M., Hannan, P. J., Baker, W. L. (1996). A Monte Carlo study of alternative responses to intraclass correlation in community trials: Is it ever possible to avoid Cornfield’s penalties? Evaluation Review, 20(3), 313–337. Google Scholar | SAGE Journals | ISI | |
|
Muthén, L., Muthén, B. (1998–2010). Mplus user’s guide (6th ed.). Los Angeles, CA: Muthén and Muthén. Google Scholar | |
|
Nathanson, L., Sawyer, B., Rimm-Kaufman, S.E. (2007a). Classroom Practices Teacher Survey. Unpublished instrument, University of Virginia, Charlottesville, VA. Google Scholar | |
|
Nathanson, L., Sawyer, B., Rimm-Kaufman, S.E. (2007b). Classroom Practices Frequency Survey. Unpublished instrument, University of Virginia, Charlottesville, VA. Google Scholar | |
|
National Mathematics Advisory Panel . (2008). Foundations for success: The final report of the National Mathematics Advisory Panel. Washington, DC: U.S. Department of Education. Google Scholar | |
|
Neal, J. W., Neal, Z. P., Atkins, M. S., Henry, D. B., Frazier, S. L. (2011). Channels of change: Contrasting network mechanisms in the use of interventions. American Journal of Community Psychology, 47, 277–286. Google Scholar | Crossref | Medline | ISI | |
|
Northeast Foundation for Children . (2007). Responsive classroom: Level 1 resource book. Turners Falls, MA: Northeast Foundation for Children. Google Scholar | |
|
Northeast Foundation for Children . (2009). Responsive classroom: Level 2 resource book. Turners Falls, MA: Northeast Foundation for Children. Google Scholar | |
|
Northeast Foundation for Children (2014a). Good teaching changes the future. Retrieved February 12, 2014 from: http://www.responsiveclassroom.org/sites/default/files/pdf_files/RC_approach_White_paper.pdf Google Scholar | |
|
Northeast Foundation for Children (2014b). Principles and practices of responsive classroom. Retrieved February 12, 2014 from: http://www.responsiveclassroom.org/principles-and-practices-responsive-classroom Google Scholar | |
|
O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K–12 curriculum intervention research. Review of Educational Research, 78(1), 33–84. Google Scholar | SAGE Journals | ISI | |
|
Ottmar, E. R., Rimm-Kaufman, S. E, Berry, R. Q., Larsen, R. A. A. (2013). Results from a randomized controlled trial: Does the Responsive Classroom approach impact the use of standards-based mathematics teaching practices? Elementary School Journal, 113(3), 434–457. doi:10.1086/668810 Google Scholar | Crossref | ISI | |
|
Pianta, R. C., Belsky, J., Vandergrift, N., Houts, R., Morrison, F. J. (2008). Classroom effects on children’s achievement trajectories in elementary school. American Educational Research Journal, 45(2), 365–397. Google Scholar | SAGE Journals | ISI | |
|
Ransford, C. R., Greenberg, M. T., Domitrovich, C. E., Small, M., Jacobson, L. (2009). The role of teachers’ psychological experiences and perceptions of curriculum supports on the implementation of a social and emotional learning curriculum. School Psychology Review, 38(4), 510–532. Google Scholar | ISI | |
|
Raver, C. C. (2012). Low-income children’s self-regulation in the classroom: Scientific inquiry for social change. American Psychologist, 67(8), 681–689. doi:10.1037/a0030085 Google Scholar | Crossref | Medline | ISI | |
|
Reyes, M. R., Brackett, M. A., Rivers, S. E., Elbertson, N. A., Salovey, P. (2012). The interaction effects of program training, dosage, and implementation quality on targeted student outcomes for the RULER approach to social and emotional learning. School Psychology Review, 41(1), 82–99. Google Scholar | Crossref | ISI | |
|
Rimm-Kaufman, S. E., Chiu, Y. I. (2007). Promoting social and academic competence in the classroom: An intervention study examining the contribution of the Responsive Classroom approach. Psychology in the Schools, 44(4), 397–413. Google Scholar | Crossref | ISI | |
|
Rimm-Kaufman, S. E., Fan, X., Chiu, Y. I., You, W. (2007). The contribution of the Responsive Classroom approach on children’s academic achievement: Results from a three year longitudinal study. Journal of School Psychology, 45, 401–421. Google Scholar | Crossref | ISI | |
|
Rimm-Kaufman, S. E., Storm, M. D., Sawyer, B. E., Pianta, R. C., La Paro, K. M. (2006). The Teacher Belief Q-Sort: A measure of teachers’ priorities and beliefs in relation to disciplinary practices, teaching practices, and beliefs about children. Journal of School Psychology, 44, 141–165. Google Scholar | Crossref | ISI | |
|
Robinson, J. P., Lubienski, S. T. (2011). The development of gender achievement gaps in mathematics and reading during elementary and middle school: Examining direct cognitive assessments and teacher ratings. American Educational Research Journal, 48(2), 268–302. Google Scholar | SAGE Journals | ISI | |
|
Schafer, J. L., Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7(2), 147–177. Google Scholar | Crossref | Medline | ISI | |
|
Shouse, R. C. (1996). Academic press and sense of community: Conflict, congruence, and implications for student achievement. Social Psychology of Education, 1(1), 47–68. Google Scholar | Crossref | |
|
Snyder, F., Flay, B., Vuchinich, S., Acock, A., Washburn, I., Beets, M., Li, K. K. (2009). Impact of a social-emotional and character development program on school-level indicators of academic achievement, absenteeism, and disciplinary outcomes: A matched-pair, cluster-randomized, controlled trial. Journal of Research on Educational Effectiveness, 3, 26–55. Google Scholar | Crossref | |
|
Social and Character Development Research Consortium . (2010). Efficacy of schoolwide programs to promote social and character development and reduce problem behavior in elementary school children (NCER 2011–2001). Washington, DC: National Center for Education Research, Institute of Education Sciences, U.S. Department of Education. Google Scholar | |
|
Virginia Department of Education . (2008). Virginia standards of learning technical report: 2008-2009 administration cycle. Retrieved from http://www.doe.virginia.gov/testing/test_administration/technical_reports/sol_technical_report_2008-09_administration_cycle.pdf. Google Scholar | |
|
Virginia Department of Education . (2010). Virginia standards of learning assessment: Test blueprint, grade 4 mathematics. Retrieved from http://www.doe.virginia.gov/testing/sol/blueprints/mathematics_blueprints/2009/blueprint_math4%20.pdf. Google Scholar | |
|
Votruba-Drzal, E. (2006). Economic disparities in middle childhood development: Does income matter? Developmental Psychology, 42(6), 1154–1167. doi:10.1037/0012-1649.42.6.1154 Google Scholar | Crossref | Medline | ISI | |
|
Wanless, S. B., Patton, C. S., Rimm-Kaufman, S. E., Deutsch, N. L. (2013). Setting-level influences on implementation of the Responsive Classroom approach. Prevention Science, 14(1), 40–51. doi:10.1007/s11121-012-0294-1 Google Scholar | Crossref | Medline | ISI | |
|
Yoshikawa, H., Aber, J. L., Beardslee, W. R. (2012). The effects of poverty on the mental, emotional, and behavioral health of children and youth: Implications for prevention. American Psychologist, 67(4), 272–284. doi: 10.1037/a0028015 Google Scholar | Crossref | Medline | ISI |
