![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The promotion of students’ engagement with school is an internationally acknowledged challenge in education. There is a need to examine the structure of the concept of student engagement and to discover the best practices for fostering it across societies. That is why the cross-cultural invariance testing of students’ engagement measures is highly needed. This study aimed, first, to find the reduced set of theoretically valid items to represent students’ affective and cognitive engagement forming the Brief-SEI (brief version of the Student Engagement Instrument; SEI). The second aim was to test the measurement invariance of the Brief-SEI across three countries (Denmark, Finland, and Portugal). A total of 4,437 seventh-grade students completed the SEI questionnaires in the three countries. The analyses revealed that of the total 33 original instrument items, 15 items indicated acceptable psychometric properties of the Brief-SEI. With these 15 items, cross-national factorial validity and invariances across genders and students with different levels of academic performance (samples from Finland and Portugal) were demonstrated. This article discusses the utility of the Brief-SEI in cross-cultural research and its applicability in different national school contexts.
References
|
Appleton, J. J. (2012). Systems consultation: Developing the assessment-to-intervention link with the student engagement instrument. In Christenson, S. L., Reschly, A. L., Wylie, C. (Eds.), Handbook of research on student engagement (pp. 725-741). New York, NY: Springer. doi:10.1007/978-1-4614-2018-7_35 Google Scholar | Crossref | |
|
Appleton, J. J., Christenson, S. L., Kim, D., Reschly, A. L. (2006). Measuring cognitive and psychological engagement: Validation of the student engagement instrument. Journal of School Psychology, 44, 427-445. doi:10.1016/j.jsp.2006.04.002 Google Scholar | Crossref | ISI | |
|
Archambault, I., Janosz, M., Fallu, J., Pagani, L. S. (2009). Student engagement and its relationship with early high school dropout. Journal of Adolescence, 32, 651-670. doi:10.1016/j.adolescence.2008.06.007 Google Scholar | Crossref | Medline | ISI | |
|
Betts, J. E., Appleton, J. J., Reschly, A. L., Christenson, S. L., Huebner, E. S. (2010). A study of the factorial invariance of the Student Engagement Instrument (SEI): Results from middle and high school students. School Psychology Quarterly, 25, 84-93. doi:10.1037/a0020259 Google Scholar | Crossref | ISI | |
|
Bollen, K. A. (1989). Structural equations with latent variables. New York, NY: Wiley InterScience. doi:10.1002/9781118619179 Google Scholar | Crossref | |
|
Borsboom, D. (2006). When does measurement invariance matter? Medical Care, 44(11, Suppl. 3), S176-S181. Google Scholar | Crossref | Medline | ISI | |
|
Brown, T. A. (2006). Conformatory factor analysis for applied research. New York, NY: Guilford Press. Google Scholar | |
|
Byrne, B. M. (2008). Testing for multigroup equivalence of a measuring instrument: A walk through the process. Psicothema, 20, 872-882. Google Scholar | Medline | ISI | |
|
Byrne, B. M. (2012). Structural equation modeling with Mplus: Basic concepts, applications, and programming. New York, NY: Routledge. doi:10.4324/9780203807644 Google Scholar | Crossref | |
|
Carter, C. P., Reschly, A. L., Lovelace, M. D., Appleton, J. J., Thompson, D. (2012). Measuring student engagement among elementary students: Pilot of the student engagement instrument—Elementary version. School Psychology Quarterly, 27, 61-73. doi:10.1037/a0029229 Google Scholar | Crossref | Medline | |
|
Cevea . (2014). Mere end hvert sjette barn går på privatskole [More than every sixth child attends private school]. Retrieved from http://www.cevea.dk/analyse/end-hvert-sjette-barn-gaar-paa-privatskole Google Scholar | |
|
Cheung, G. W. (2008). Testing equivalence in the structure, means, and variances of higher-order constructs with structural equation modeling. Organizational Research Methods, 11, 593-613. doi:10.1177/1094428106298973 Google Scholar | SAGE Journals | ISI | |
|
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, N.J: Lawrence Erlbaum. Google Scholar | |
|
Currie, C., Zanotti, C., Morgan, A., Currie, D., de Looze, M., Roberts, C., . . . Barnekow, V. (Eds.). (2012). Social determinants of health and well-being among young people. Health Behaviour in School-Aged Children (HBSC) study: International report from the 2009/2010 survey (Health Policy for Children and Adolescents, No. 6). Copenhagen, Denmark: WHO Regional Office for Europe. Google Scholar | |
|
Eccles, J. S., Midgley, C. (1989). Stage-environment fit: Developmentally appropriate classrooms for young adolescents. In Ames, C., Ames, R. (Eds.), Research on motivation in education, vol. 3: Goals and cognitions (pp. 139-186). San Diego, CA: Academic Press. Google Scholar | |
|
Fredricks, J. A., Blumenfeld, P. C., Paris, A. H. (2004). School engagement: Potential of the concept, state of the evidence. Review of Educational Research, 74, 59-109. doi:10.3102/00346543074001059 Google Scholar | SAGE Journals | ISI | |
|
Grier-Reed, T., Appleton, J., Rodriguez, M., Ganuza, Z., Reschly, A. L. (2012). Exploring the student engagement instrument and career perceptions with college students. Journal of Educational and Developmental Psychology, 2(2), 85-96. doi:10.5539/jedp.v2n2p85 Google Scholar | Crossref | |
|
Hayduk, L. A., Littvay, L. (2012). Should researchers use single indicators, best indicators, or multiple indicators in structural equation models? BMC Medical Research Methodology, 12(1), 159-175. doi:10.1186/1471-2288-12-159 Google Scholar | Crossref | Medline | |
|
Kline, R. B. (2011). Principles and practice of structural equation modeling (3rd ed. ed.). New York, NY: Guilford Press. Google Scholar | |
|
Little, R. A. (1988). A test of missing completely at random for multivariate data with missing values. Journal of the American Statistical Association, 83, 1198-1202. doi:10.2307/2290157 Google Scholar | Crossref | ISI | |
|
Lovelace, M. D., Reschly, A. L., Appleton, J. J., Lutz, M. E. (2014). Concurrent and predictive validity of the student engagement instrument. Journal of Psychoeducational Assessment, 32, 509-520. doi:10.1177/0734282914527548 Google Scholar | SAGE Journals | ISI | |
|
Meads, D. M., Bentall, R. P. (2008). Rasch analysis and item reduction of the hypomanic personality scale. Personality and Individual Differences, 44, 1772-1783. doi:10.1016/j.paid.2008.02.009 Google Scholar | Crossref | ISI | |
|
Meredith, W., Teresi, J. A. (2006). An essay on measurement and factorial invariance. Medical Care, 44(11, Suppl. 3), S69-S77. doi:10.1097/01.mlr.0000245438.73837.89 Google Scholar | Crossref | Medline | ISI | |
|
Moreira, P. A. S., Machado Vaz, F., Dias, P., Petracchi, P. (2009). Psychometric properties of the Portuguese version of the School Engagement Instrument. Canadian Journal of School Psychology, 24, 303-317. doi:10.1177/0829573509346680 Google Scholar | SAGE Journals | |
|
Muthén, L. K., Muthén, B. O. (1998-2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
National Advisory Board on Research Ethics . (2009). Ethical principles of research in the humanities and social and behavioural sciences and proposals for ethical review. Retrieved from http://www.tenk.fi/sites/tenk.fi/files/ethicalprinciples.pdf Google Scholar | |
|
Organisation for Economic Co-Operation and Development . (2013). Programme for International Student Assessment (PISA). Retrieved from http://www.oecd.org/pisa/ Google Scholar | |
|
Organisation for Economic Co-Operation and Development . (2016). Programme for International Student Assessment (PISA). Retrieved from http://www.oecd.org/pisa/ Google Scholar | |
|
Reschly, A. L., Betts, J. E., Appleton, J. J. (2014). An examination of the validity of two measures of student engagement. International Journal of School & Educational Psychology, 2, 106-114. http://dx.doi.org/10.1080/21683603.2013.876950 Google Scholar | |
|
Rubin, D. B. (1987). Multiple imputation for nonresponse in surveys. New York, NY: John Wiley. doi:10.1002/9780470316696 Google Scholar | Crossref | |
|
Samuelsen, K. M. (2012). Part V commentary: Possible new directions in the measurement of student engagement. In Christenson, S. L., Reschly, A. L., Wylie, C. (Eds.), Handbook of research on student engagement (pp. 805-811). New York, NY: Springer. doi:10.1007/978-1-4614-2018-7_39 Google Scholar | Crossref | |
|
Skinner, E. A., Furrer, C. J., Marchand, G., Kindermann, T. A. (2008). Engagement and disaffection in the classroom: Part of a larger motivational dynamic? Journal of Educational Psychology, 100(4), 765-781. doi: 10.1037/a0012840 Google Scholar | Crossref | ISI | |
|
Stafford, R. (2011). Evaluation of the Student Engagement Instrument: Measurement invariance across economic status and association with academic achievement (Master’s thesis). Available from ProQuest Dissertations and Theses database. (UMI No. 1502352) Google Scholar | |
|
van de Vijver, F., Tanzer, N. K. (2004). Bias and equivalence in cross-cultural assessment: An overview. Revue Europeenne De Psychologie Appliquee, 54, 119-135. doi:10.1016/j.erap.2003.12.004 Google Scholar | Crossref | |
|
Virtanen, T. E., Kiuru, N., Lerkkanen, M.-K., Poikkeus, A.-M., Kuorelahti, M. (2016). Assessment of student engagement among junior high school students and associations with self-esteem, burnout, and academic achievement. Journal for Educational Research Online, 8, 136-157. Google Scholar | |
|
Wang, M., Eccles, J. S. (2012). Social support matters: Longitudinal effects of social support on three dimensions of school engagement from middle to high school. Child Development, 83(3), 877-895. doi: 10.1111/j.1467-8624.2012.01745.x Google Scholar | Crossref | Medline | ISI | |
|
Wang, M., Willett, J. B., Eccles, J. S. (2011). The assessment of school engagement: Examining dimensionality and measurement invariance by gender and race/ethnicity. Journal of School Psychology, 49(4), 465-480. doi:10.1016/j.jsp.2011.04.001 Google Scholar | |
|
Wetzel, E., Carstensen, C. H., Böhnke, J. R. (2013). Consistency of extreme response style and nonextreme response style across traits. Journal of Research in Personality, 47, 178-189. doi:10.1016/j.jrp.2012.10.010 Google Scholar | Crossref | ISI |
