![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
This study examined the reliability and validity of the Classroom Assessment Scoring System–Secondary (CLASS-S) in Finnish classrooms. Trained observers coded classroom interactions based on video recordings of 46 Grade 6 classrooms (450 cycles). Concurrent associations were investigated with respect to teacher self-ratings (e.g., efficacy beliefs and teaching-related stress). Confirmatory factor analysis showed that the hypothesized three-factor structure of the original CLASS-S (Emotional Support, Organizational Support, and Instructional Support), with some modifications, provided a better fit for the data compared with one- and two-factor structures. Structural validity was demonstrated by mostly high factor loadings. Except for two interrater intraclass correlations, all item, scale, and interrater reliabilities were either acceptable or good. The study found some evidence for concurrent associations between the three CLASS-S factors and teacher self-ratings. The results provide evidence of the applicability of the CLASS-S instrument in educational contexts (Finland) outside the United States.
References
Section:
|
Allen, J., Gregory, A., Mikami, A., Lun, J., Hamre, B., Pianta, R. (2013). Observations of effective teacher–student interactions in secondary school classrooms: Predicting student achievement with the Classroom Assessment Scoring System–Secondary. School Psychology Review, 42, 76-98. Google Scholar | Medline | ISI | |
|
Andrews, P., Ryve, A., Hemmi, K., Sayers, J. (2014). PISA, TIMSS and Finnish mathematics teaching: An enigma in search of an explanation. Educational Studies in Mathematics, 87, 7-26. Google Scholar | Crossref | |
|
Atjonen, P., Halinen, I., Hämäläinen, S., Korkeakoski, E., Knubb-Manninen, G., Kupari, P., . . . Wikman, T. (2008). Tavoitteista vuorovaikutukseen. Perusopetuksen pedagogiikan arviointi [From goals to interaction. Evaluation of pedagogy in Finnish basic education]. Jyväskylä, Finland: Finnish Education Evaluation Council. Google Scholar | |
|
Aunola, K., Lerkkanen, M., Poikkeus, A., Nurmi, J. (2005). Teacher Interactional Styles Scale. Jyväskylä, Finland: University of Jyväskylä. Google Scholar | |
|
Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17, 62-87. Google Scholar | Crossref | |
|
Blatchford, P., Bassett, P., Goldstein, H., Martin, C. (2003). Are class size differences related to pupils’ educational progress and classroom processes? Findings from the Institute of Education Class Size Study of children aged 5-7 years. British Educational Research Journal, 29, 709-730. Google Scholar | Crossref | |
|
Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: John Wiley. Google Scholar | Crossref | |
|
Bowlby, J. (1979). The Bowlby-Ainsworth attachment theory. Behavioral & Brain Sciences, 2, 637-638. Google Scholar | Crossref | |
|
Bronfenbrenner, U., Morris, P. A. (1998). The ecology of developmental processes. In Damon, W., Lerner, R. M. (Eds.), Handbook of child psychology: Vol. 1: Theoretical models of human development (5th ed., pp. 993-1028). New York, NY: John Wiley. Google Scholar | |
|
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York, NY: Routledge. Google Scholar | |
|
Cicchetti, D. V., Sparrow, S. A. (1981). Developing criteria for establishing interrater reliability of specific items: Applications to assessment of adaptive behavior. American Journal of Mental Deficiency, 86, 127-137. Google Scholar | Medline | |
|
Connell, J. P., Wellborn, J. G. (1991). Competence, autonomy, and relatedness: A motivational analysis of self-system processes. In Gunnar, M. R., Sroufe, L. A. (Eds.), Self-processes and development: The Minnesota symposia on child psychology (pp. 43-77). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Curran, P. J., Bollen, K. A., Chen, F., Paxton, P., Kirby, J. B. (2003). Finite sampling properties of the point estimates and confidence intervals of the RMSEA. Sociological Methods & Research, 32, 208-252. Google Scholar | SAGE Journals | ISI | |
|
Deci, E. L., Ryan, R. M. (2000). The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry, 11, 227-268. Google Scholar | Crossref | ISI | |
|
Douglas, K. (2009). Sharpening our focus in measuring classroom instruction. Educational Researcher, 38, 518-521. Google Scholar | SAGE Journals | |
|
Finnish National Board of Education . (2014). National core curriculum for basic education 2014 (National core curriculum for basic education intended for pupils in compulsory education). Retrieved from http://www.oph.fi/english/curricula_and_qualifications/basic_education Google Scholar | |
|
Gerris, J. M., Vermulst, A., van Boxtel, D., Janssens, J., van Zutphen, R., Felling, A. (1993). Parenting in Dutch families. Nijmegen, The Netherlands: University of Nijmegen, Institute of Family Studies. Google Scholar | |
|
Gettinger, M., Walter, M. J. (2012). Classroom strategies to enhance academic engaged time. In Christenson, S. L., Reschly, A. L., Wylie, C. (Eds.), Handbook of research on student engagement (pp. 653-673). New York, NY: Springer. Google Scholar | Crossref | |
|
Gibbs, R., Poskitt, J. (2010). Student engagement in the middle years of schooling (years 7-10): A literature review. Retrieved from http://www.educationcounts.govt.nz/__data/assets/pdf_file/0010/74935/940_Student-Engagement-19052010.pdf Google Scholar | |
|
Graue, E., Rauscher, E., Sherfinski, M. (2009). The synergy of class size reduction and classroom quality. The Elementary School Journal, 110, 178-201. Google Scholar | Crossref | |
|
Gregory, A., Allen, J. P., Mikami, A. Y., Hafen, C. A., Pianta, R. C. (2014). Effects of a professional development program on behavioral engagement of students in middle and high school: Increasing behavioral engagement. Psychology in the Schools, 51, 143-163. Google Scholar | Crossref | Medline | ISI | |
|
Guo, Y., Connor, C. M., Yang, Y., Roehrig, A. D., Morrison, F. J. (2012). The effects of teacher qualifications, teacher self-efficacy and classroom practices on fifth graders’ reading outcomes. The Elementary School Journal, 113, 3-24. Google Scholar | Crossref | ISI | |
|
Hafen, C. A., Hamre, B. K., Allen, J. P., Bell, C. A., Gitomer, D. H., Pianta, R. C. (2015). Teaching through interactions in secondary school classrooms: Revisiting the factor structure and practical application of the Classroom Assessment Scoring System–Secondary. The Journal of Early Adolescence, 35, 651-680. Google Scholar | SAGE Journals | ISI | |
|
Hagelskamp, C., Brackett, M., Rivers, S., Salovey, P. (2013). Improving classroom quality with the RULER approach to social and emotional learning: Proximal and distal outcomes. American Journal of Community Psychology, 51, 530-543. Google Scholar | Crossref | Medline | ISI | |
|
Hallgren, K. A. (2012). Computing inter-rater reliability for observational data: An overview and tutorial. Tutorials in Quantitative Methods for Psychology, 8, 23-34. Google Scholar | Crossref | Medline | |
|
Hamre, B. K., Pianta, R. C., Downer, J. T., DeCoster, J., Mashburn, A. J., Jones, S. M., . . . Hamagami, A. (2013). Teaching through interactions: Testing a developmental framework of teacher effectiveness in over 4,000 classrooms. The Elementary School Journal, 111, 461-487. Google Scholar | Crossref | |
|
Hamre, B. K., Pianta, R. C., Downer, J. T., Mashburn, A. J. (2008). Teachers’ perceptions of conflict with young students: Looking beyond problem behaviors. Social Development, 17, 115-136. Google Scholar | ISI | |
|
Hamre, B. K., Pianta, R. C., Mashburn, A. J., Downer, J. T. (2007). Building a science of classrooms: Application of the CLASS framework in over 4,000 U.S. early childhood and elementary classrooms. Retrieved from https://www.fcd-us.org/building-a-science-of-classrooms-application-of-the-class-framework-in-over-4000-u-s-early-childhood-and-elementary-classrooms/ Google Scholar | |
|
Hoglund, W. L., Klingle, K. E., Hosan, N. E. (2015). Classroom risks and resources: Teacher burnout, classroom quality and children’s adjustment in high needs elementary schools. Journal of School Psychology, 53, 337-357. Google Scholar | Crossref | Medline | ISI | |
|
Jennings, P. A., Greenberg, M. T. (2009). The prosocial classroom: Teacher social and emotional competence in relation to student and classroom outcomes. Review of Educational Research, 79, 491-525. Google Scholar | SAGE Journals | ISI | |
|
Justice, L. M., Mashburn, A., Hamre, B. K., Pianta, R. C. (2008). Quality of language and literacy instruction in preschool classrooms serving at-risk pupils. Early Childhood Research Quarterly, 23, 51-68. Google Scholar | Crossref | Medline | ISI | |
|
Kane, T., Staiger, D., McCaffrey, D., Cantrell, S., Archer, J., Buhayar, S., Parker, D. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains (Technical report). Seattle, WA: Bill & Melinda Gates Foundation, Measures of Effective Teaching Project. Google Scholar | |
|
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed.). New York, NY: Guilford Press. Google Scholar | |
|
Lerkkanen, M.-K., Kiuru, N., Pakarinen, E., Poikkeus, A.-M., Rasku-Puttonen, H., Siekkinen, M., Nurmi, J.-E. (2016). Child-centered versus teacher-directed teaching practices: Associations with the development of academic skills in the first grade at school. Early Childhood Research Quarterly, 36, 145-156. Google Scholar | Crossref | |
|
Lerkkanen, M.-K., Niemi, P., Poikkeus, A.-M., Poskiparta, M., Siekkinen, M., Nurmi, J.-E. (2006-2016). The first steps study (Alkuportaat) (Unpublished data). University of Jyväskylä, Finland. Google Scholar | |
|
Leyva, D., Weiland, C., Barata, M., Yoshikawa, H., Snow, C., Treviño, E. (2015). Teacher–child interactions in Chile and their associations with prekindergarten outcomes. Child Development, 86, 781-799. Google Scholar | Crossref | Medline | |
|
Li Grining, C., Raver, C. C., Champion, K., Sardin, L., Metzger, M., Jones, S. M. (2010). Understanding and improving classroom emotional climate and behavior management in the “real world”: The role of Head Start teachers’ psychosocial stressors. Early Education and Development, 21, 65-94. Google Scholar | Crossref | |
|
Malmberg, L., Hagger, H., Burn, K., Mutton, T., Colls, H. (2010). Observed classroom quality during teacher education and two years of professional practice. Journal of Educational Psychology, 102, 916-932. Google Scholar | Crossref | ISI | |
|
Mashburn, A. J., Hamre, B. K., Downer, J. T., Pianta, R. C. (2006). Teacher and classroom characteristics associated with teachers’ ratings of prekindergartners’ relationships and behaviors. Journal of Psychoeducational Assessment, 24, 367-380. Google Scholar | SAGE Journals | ISI | |
|
Maslach, C., Jackson, S. E., Leiter, M. P. (1996). Maslach Burnout Inventory Manual (3rd ed.). Palo Alto, CA: Consulting Psychologists Press. Google Scholar | |
|
McGraw, K. O., Wong, S. P. (1996). Forming inferences about some intraclass correlation coefficients. Psychological Methods, 1, 30-46. Google Scholar | Crossref | ISI | |
|
McLean, L., Connor, C. M. (2015). Depressive symptoms in third-grade teachers: Relations to classroom quality and student achievement. Child Development, 86, 945-954. Google Scholar | Crossref | Medline | |
|
Moate, J. (2017). Living between two educational systems. In Raiker, A., Rautiainen, M. (Eds.), Educating for democracy in England and Finland: Principles and culture (pp. 17-26). New York, NY: Routledge. Google Scholar | |
|
Muthén, L. K., Muthén, B. O. (1998-2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
National Institute of Child Health and Human Development & Early Child Care Research Network . (2002). The relation of global first-grade classroom environment to structural classroom features and teacher and student behaviors. Elementary School Journal, 102, 367-387. Google Scholar | Crossref | |
|
Näätänen, P., Aro, A., Matthiesen, S., Salmela-Aro, K. (2003). Bergen burnout indicator 15. Helsinki, Finland: Edita. Google Scholar | |
|
The Organisation for Economic Co-Operation and Development . (2013). Programme for International Student Assessment (PISA). Retrieved from http://www.oecd.org/pisa/ Google Scholar | |
|
The Organisation for Economic Co-Operation and Development . (2014). Indicator D2: What is the student-teacher ratio and how big are classes? In Education at a Glance 2014: OECD indicators. Author. Retrieved from http://www.oecd.org/edu/EAG2014-Indicator%20D2%20(eng).pdf Google Scholar | |
|
Pakarinen, E., Kiuru, N., Lerkkanen, M.-K., Poikkeus, A.-M., Siekkinen, M., Nurmi, J.-E. (2010). Classroom organization and teacher stress predict learning motivation in kindergarten children. European Journal of Psychology of Education, 25, 281-300. Google Scholar | Crossref | |
|
Pakarinen, E., Lerkkanen, M., Poikkeus, A., Kiuru, N., Siekkinen, M., Rasku-Puttonen, H., Nurmi, J. (2010). A validation of the classroom assessment scoring system in Finnish kindergartens. Early Education and Development, 21, 95-124. Google Scholar | Crossref | ISI | |
|
Paris, S. G., Paris, A. H. (2001). Classroom applications of research on self-regulated learning. Educational Psychologist, 36, 89-101. Google Scholar | Crossref | ISI | |
|
Parker, A., Neuharth-Pritchett, S. (2006). Developmentally appropriate practice in kindergarten: Factors shaping teacher beliefs and practice. Journal of Research in Childhood Education, 21, 65-78. Google Scholar | Crossref | |
|
Pianta, R. C., Hamre, B. K. (2009). Conceptualization, measurement, and improvement of classroom processes: Standardized observation can leverage capacity. Educational Researcher, 38, 109-119. Google Scholar | SAGE Journals | ISI | |
|
Pianta, R. C., Hamre, B. K., Allen, J. P. (2012). Teacher-student relationships and engagement: Conceptualizing, measuring, and improving the capacity of classroom interactions. In Christenson, S. L., Reschly, A. L., Wylie, C. (Eds.), Handbook of research on student engagement (pp. 365-386). New York, NY: Springer. Google Scholar | Crossref | |
|
Pianta, R. C., Hamre, B. K., Mintz, S. L. (2010). Classroom Assessment Scoring System–Secondary (CLASS-S). Charlottesville, VA: University of Virginia. Google Scholar | |
|
Pianta, R. C., Hamre, B. K., Mintz, S. L. (2012). The CLASS-Secondary manual. Charlottesville: University of Virginia. Google Scholar | |
|
Pressley, M., Dolezal, S. E., Raphael, L. M., Mohan, L., Roehrig, A. D., Bogner, K. (2003). Motivating primary-grade students. New York, NY: Guilford Press. Google Scholar | |
|
Reyes, M. R., Brackett, M. A., Rivers, S. E., White, M., Salovey, P. (2012). Classroom emotional climate, student engagement, and academic achievement. Journal of Educational Psychology, 104, 700-712. Google Scholar | Crossref | ISI | |
|
Rimm-Kaufman, S. E., Sawyer, B. E. (2004). Primary-grade teachers’ self-efficacy beliefs, attitudes towards teaching, and discipline and teaching practice priorities in relation to the responsive classroom approach. The Elementary School Journal, 104, 321-341. Google Scholar | Crossref | |
|
Sahlberg, P. (2015). Finnish lessons 2.0: What can the world learn from educational change in Finland? (Forewords by Ravitch, D., Hargreaves, A., Afterword by Robinson, K. ) (2nd ed.). New York, NY: Teachers College Press. Google Scholar | |
|
Sandilos, L. E., DiPerna, J. C. (2014). Measuring quality in kindergarten classrooms: Structural analysis of the Classroom Assessment Scoring System (CLASS K-3). Early Education and Development, 25, 894-914. Google Scholar | Crossref | |
|
Schacter, J., Thum, Y. M. (2004). Paying for high- and low-quality teaching. Economics of Education Review, 23, 411-430. Google Scholar | Crossref | ISI | |
|
Schoorman, F., Mayer, R., Davis, J. (2007). An integrative model of organizational trust: Past, present, and future. Academy of Management Review, 32, 344-354. Google Scholar | Crossref | ISI | |
|
Slot, P., Cadima, J., Salminen, J., Pastori, G., Lerkkanen, M.-K. (2016). Multiple case study in seven European countries regarding culture-sensitive classroom quality assessment. Available from http://ecec-care.org Google Scholar | |
|
Soenens, B., Sierens, E., Vansteenkiste, M., Dochy, F., Goossens, L. (2012). Psychologically controlling teaching: Examining outcomes, antecedents, and mediators. Journal of Educational Psychology, 104, 108-120. Google Scholar | Crossref | ISI | |
|
Stipek, D., Byler, P. (1997). Early childhood education teachers: Do they practice what they preach? Early Childhood Research Quarterly, 12, 305-325. Google Scholar | Crossref | ISI | |
|
Tschannen-Moran, M., Woolfolk Hoy, A. (2001). Teacher efficacy: Capturing an elusive construct. Teaching and Teacher Education, 17, 783-805. Google Scholar | Crossref | ISI | |
|
Virtanen, T., Lerkkanen, M.-K., Poikkeus, A.-M., Kuorelahti, M. (2015). The relationship between classroom quality and students’ engagement in secondary school. Educational Psychology, 35, 963-983. Google Scholar | Crossref | |
|
Woolfolk, A. E., Rosoff, B., Hoy, W. K. (1990). Teachers’ sense of efficacy and their beliefs about managing students. Teaching and Teacher Education, 6, 137-148. Google Scholar | Crossref | ISI | |
|
Yilmaz, K. (2011). The cognitive perspective on learning: Its theoretical underpinnings and implications for classroom practices. Clearing House: A Journal of Educational Strategies, Issues and Ideas, 84, 204-212. Google Scholar | Crossref |
