![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The purposes of this study were to report on a systematic approach to validating a Spanish version of the Principal Instructional Management Rating Scale and then to apply the scale in a cross-national comparison of principal instructional leadership. The study yielded a validated Spanish language version of the PIMRS Teacher Form and offers a model of scale validation for other scholars who are interested in preparing an instrument for use outside of its culture of origin. The researchers used a back translation and expert panel procedure combined with psychometric analysis in order to achieve cultural equivalency for the translation. Psychometric properties of reliability (G Theory test of reliability) and validity (CFA, Rasch analysis) of the new version were assessed and compared to the original version in order to underpin its validity. The validation study employed a sample of 595 teachers and 26 principals in Santiago, Chile. The study yielded both a comprehensive analytical approach to cultural adaptation of survey instruments, as well a scale that can be used in Spanish speaking contexts. The study further demonstrated variability in patterns of instructional leadership practice across several national contexts.
References
Section:
|
Adler, NJ (1983) Cross-cultural management research: the ostrich and the trend. Academy of Management Review 8(2): 226–232. Google Scholar | ISI | |
|
Ajiferuke, M, Boddewyn, J (1970) ‘Culture’ and other explanatory variables in comparative management studies. Academy of Management Journal 13(2): 153–163. Google Scholar | Crossref | ISI | |
|
American Educational Research Association (AERA) (1999) Standards for educational and psychological tests. American Psychological Association and National Council on Measurement in Education. Washington DC: American Educational Research Association. Google Scholar | |
|
Andrich, D (1978) A rating formulation for ordered response categories. Psychometrika 43: 561–73. Google Scholar | Crossref | ISI | |
|
Avalos, B, Assael, J (2006) Moving from resistance to agreement: the case of the Chilean teacher performance evaluation. International Journal of Educational Research 45(4): 254–266. Google Scholar | Crossref | |
|
Avilés, I (2009) Retos estrategias y liderazgo instruccional de directores noveles en escuelas primarias. Maestro en Administración de Organizaciones Educativas, Universidad Autónoma de Yucatán, Mérida de Yucatán, Mexico. Google Scholar | |
|
Bajunid, IA (1996) Preliminary explorations of indigenous perspectives of educational management: the evolving Malaysian experience. Journal of Educational Administration 34(5): 50–73. Google Scholar | Crossref | |
|
Bellibas, MS, Bulut, O, Hallinger, P, Wang, WC (2016) Developing a validated instructional leadership profile of Turkish primary school principals. International Journal of Educational Research 76: 115–133. Google Scholar | Crossref | ISI | |
|
Bridges, E (1967) Instructional leadership: a concept re-examined. Journal of Educational Administration 5(2): 136–147. Google Scholar | Crossref | |
|
Bridges, E (1982) Research on the school administrator: the state-of-the-art, 1967–1980. Educational Administration Quarterly 18(3): 12–33. Google Scholar | SAGE Journals | ISI | |
|
Brislin, RW (1986) Field methods in cross-cultural research. In Lonner, W, Berry, JW (eds) Cross-cultural Research and Methodology Series Vol. 8. Thousand Oaks, CA: SAGE, pp. 137–164. Google Scholar | |
|
Browne, MW, Cudeck, R (1993) Alternative ways of assessing model fit. In Bollen, KA, Long, JS (eds) Testing Structural Equation Models. Beverly Hills, CA: SAGE, pp. 136–162. Google Scholar | |
|
Cronbach, LJ (1951) Coefficient alpha and the internal structure of tests. Psychometrika 16(3): 297–334. Google Scholar | Crossref | |
|
Cronbach, LJ (1988) Five perspectives on validity argument. In Wainer, H, Braun, H (eds) Test Validity. Hillsdale, NJ: Lawrence Erlbaum, pp. 3–17. Google Scholar | |
|
Cronbach, LJ, Gleser, GC, Nanda, H, Rajaratnam, N (1972) The Dependability of Behavioral Measurements. New York: Wiley. Google Scholar | |
|
Dale, A, Phillips, R (2011) Influences of instructional leadership, transformational leadership and the mediating effects of self-efficacy on students’ achievement. Paper presented at the 6th International Conference of the American Institute of Higher Education, Charleston, SC. Google Scholar | |
|
Dimmock, C, Walker, A (2000) Developing comparative and international educational leadership and management: a cross-cultural model. School Leadership & Management, 20(2): 143–160. Google Scholar | Crossref | |
|
Erickson, DA (1967) The school administrator. Review of Educational Research 37(4): 417–432. Google Scholar | SAGE Journals | ISI | |
|
Goldring, E, Cravens, XC, Murphy, J, Porter, A, Elliott, S (2012) The convergent and divergent validity of the Vanderbilt Assessment of Leadership in Education™ (VAL-ED): Instructional leadership and emotional intelligence. Paper presented at the Annual Conference of Association for Education Finance and Policy, Boston, MA. Google Scholar | |
|
Greb, W (2011) Principal leadership and student achievement: what is the effect of transformational leadership in conjunction with instructional leadership on student achievement? Unpublished doctoral dissertation, Marian University, Indianapolis, IN. Google Scholar | |
|
Gross, N, Herriot, R (1965) Staff Leadership in Schools. New York: Wiley. Google Scholar | |
|
Haller, E (1979) Questionnaires and the dissertation in educational administration. Educational Administration Quarterly, 15(1): 47–66. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P (1982, 1990) Principal Instructional Management Rating Scale. Sarasota, FL: Leading Development Associates. Google Scholar | |
|
Hallinger, P (2011a) A review of three decades of doctoral studies using the Principal Instructional Management Rating Scale: a lens on methodological progress in educational leadership. Educational Administration Quarterly 47(2): 271–306. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P (2011b) Leadership for learning: lessons from 40 years of empirical research. Journal of Educational Administration 49(2): 125–142. Google Scholar | Crossref | |
|
Hallinger, P, Bryant, DA (2013) Accelerating knowledge production on educational leadership and management in East Asia: a strategic analysis. School Leadership and Management, 33(3): 202–223. Google Scholar | Crossref | |
|
Hallinger, P, Heck, RH (1996) Reassessing the principal’s role in school effectiveness: a review of empirical research, 1980–1995. Educational Administration Quarterly 32(1): 5–44. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P, Lee, MS (2013) Exploring principal capacity to lead reform of teaching and learning quality in Thailand. International Journal of Educational Development 33: 305–315. Google Scholar | Crossref | ISI | |
|
Hallinger, P, Leithwood, K (1996) Culture and leadership in educational administration. Journal of Educational Administration 34(5): 98–116. Google Scholar | Crossref | |
|
Hallinger, P, Murphy, J (1985) Assessing the instructional management behavior of principals. The Elementary School Journal 86(2): 217–247. Google Scholar | Crossref | ISI | |
|
Hallinger, P, Wang, WC (2015) Assessing Instructional Leadership with the Principal Instructional Management Rating Scale. Dordrecht: Springer. Google Scholar | Crossref | |
|
Hallinger, P, Wang, WC, Chen, CW (2013) Assessing the measurement properties of the Principal Instructional Management Rating Scale: a meta-analysis of reliability studies. Educational Administration Quarterly, 49(2): 272–309. Google Scholar | SAGE Journals | ISI | |
|
Heck, RH, Hallinger, P (2005) The study of educational leadership and management: where does the field stand today? Educational Management Administration & Leadership 33(2): 229–244. Google Scholar | SAGE Journals | |
|
Heck, RH, Hallinger, P (2014) Modeling the effects of school leadership on teaching and learning over time. Journal of Educational Administration 52(5): 653–681. Google Scholar | Crossref | |
|
Heck, RH, Larsen, TJ, Marcoulides, GA (1990) Instructional leadership and school achievement: validation of a causal mode. Educational Administration Quarterly 26(2): 94–125. Google Scholar | SAGE Journals | ISI | |
|
House, R, Javidan, M, Hanges, P, Dorfman, P (2002) Understanding cultures and implicit leadership theories across the globe: an introduction to project GLOBE. Journal of World Business 37(1): 3–10. Google Scholar | Crossref | ISI | |
|
Jones, EG, Kay, M (1992) Instrumentation in cross-cultural research. Nursing research 41(3): 186–188. Google Scholar | Crossref | Medline | ISI | |
|
Kane, MT, Gilmore, GM, Crooks, TJ (1976) Student evaluations of teaching: the generalizability of class means. Journal of Educational Measurement 13(3): 171–183. Google Scholar | Crossref | ISI | |
|
Krüger, M, Witziers, B, Sleegers, P (2007) The impact of school leadership on school level factors: validation of a causal model. School Effectiveness and School Improvement 18(1): 1–20. Google Scholar | Crossref | ISI | |
|
Latham, G, Wexley, K (1981) Increasing Productivity Through Performance Appraisal. Menlo Park, CA: Addison Wesley. Google Scholar | |
|
Lee, MS, Hallinger, P (2012) Exploring the impact of national context on principals’ time use: Economic development, societal culture, and educational system. School Effectiveness and School Improvement 23(4): 461–482. Google Scholar | |
|
Leithwood, KA, Begley, PT, Cousins, BJ (1990) The nature, causes and consequences of principals’ practices: an agenda for future research. Journal of Educational Administration 28(4): 5–31. Google Scholar | Crossref | |
|
Leithwood, KA, Sun, JP (2012) The nature and effects of transformational school leadership: A meta-analytic review of unpublished research. Educational Administration Quarterly 48(3): 387–423. Google Scholar | SAGE Journals | ISI | |
|
Leithwood, KA, Harris, A, Hopkins, D (2008) Seven strong claims about successful school leadership. School Leadership and Management 28(1): 27–42. Google Scholar | Crossref | |
|
Lipham, JM (1981) Effective Principal Effective School. Eugene, OR: ERIC. Google Scholar | |
|
Lissitz, RW, Samuelsen, K (2007) A suggested change in terminology and emphasis regarding validity and education. Educational Researcher 36, 437–448. Google Scholar | SAGE Journals | |
|
Marsh, HW, Hau, KT, Artelt, C, Baumert, J, Peschar, JL (2006) OECD’s brief self-report measure of educational psychology’s most useful affective constructs: cross-cultural, psychometric comparisons across 25 countries. International Journal of Testing 6(4): 311–360. Google Scholar | Crossref | |
|
Mineduc (2014) Cuenta pública de educación 2010–2014. Available at: http://www.mineduc.cl//usuarios/mineduc/doc/cuenta_publica2013_e.pdf (accessed 30 March 2014). Google Scholar | |
|
Murphy, JF, Torre, D (2014) School goals: essential scaffolding. Educational Management Administration & Leadership. doi: 10.1177/1741143214523017. Google Scholar | ISI | |
|
Muthén, LK, Muthén, BO (2010) Mplus 6. Los Angeles, CA: Muthén and Muthén. Google Scholar | |
|
Neumerski, CM (2013) Rethinking instructional leadership, a review: what do we know about principal, teacher and coach instructional leadership and where should we gof here? Educational Administration Quarterly 49(2): 310–347. Google Scholar | SAGE Journals | ISI | |
|
Nunnally, J (1978) Psychometric Methods. New York: McGraw Hill. Google Scholar | |
|
OECD (2013) TALIS – Country profile Chile. Paris: Organisation for Economic Co-operation and Development. Google Scholar | |
|
Perneger, TV, Leplège, A, Etter, J-F. (1999) Cross-cultural adaptation of a psychometric instrument: two methods compared. Journal of Clinical Epidemiology 52(11): 1037–1046. Google Scholar | Crossref | Medline | ISI | |
|
Rigby, JG (2013) Three logics of instructional leadership. Educational Administration Quarterly. DOI: 0013161X13509379. Google Scholar | ISI | |
|
Shafeeu, I (2011) A study of principals’ instructional leadership in schools of Gaafu Dhaalu Atoll Maldives. Unpublished master thesis, University of Malaya, Kuala Lumpur, Malaysia. Google Scholar | |
|
Shatzer, RH (2009) A comparison study between instructional and transformational leadership theories: wffects on student achievement and teacher job satisfaction. Unpublished doctoral dissertation, Brigham Young University, Provo, UT. Google Scholar | |
|
Sebastian, J, Allensworth, E (2012) The influence of principal leadership on classroom instruction and student learning: a study of mediated pathways to learning. Educational Administration Quarterly 48(4): 626–663. Google Scholar | SAGE Journals | ISI | |
|
Steiger, JH (2007) Understanding the limitations of global fit assessment in structural equation modeling. Personality and Individual Differences, 42, 893–898. Google Scholar | Crossref | ISI | |
|
Tsui, AS, Nifadkar, SS, Ou, AY (2007) Cross-national, cross-cultural organizational behavior research: advances, gaps and recommendations. Journal of Management 33(3): 426–478. Google Scholar | SAGE Journals | ISI | |
|
Volante, P, Mladinic, M, Lincovil, C, Fernandez, M, Johanek, M (2012) Diseño de Assessment Center para la selección de equipos directivos en establecimientos educacionales. En Centro de Políticas Públicas UC, Propuestas para Chile, Concurso Políticas Públicas 2011.Santiago, Chile: Pontificia Universidad Católica de Chile. Google Scholar | |
|
Walker, A, Dimmock, C (2002) Moving school leadership beyond its narrow boundaries: developing a cross-cultural approach. In Leithwood, KA, Hallinger, P (eds) Second International Handbook of Educational Leadership And Administration. Dordrecht: Kluwer, pp. 67–204. Google Scholar | Crossref | |
|
Walker, AD, Ko, J (2011) Principal leadership in an era of accountability: a perspective from the Hong Kong context. School Leadership & Management 31(4): 369–392. Google Scholar | Crossref | |
|
Weinstein, J, Muñoz, G (2012) ¿Qué sabemos sobre los directores de escuela en Chile? Santiago: CEPPE and Fundación Chile. Google Scholar | |
|
Wong, YN (2010) Instructional leadership in Malaysia. Unpublished master thesis. Open University of Malaysia, Kuala Lumpur, Malaysia. Google Scholar | |
|
Wright, B, Master, G (1982) Rating Scale Analysis. Chicago, IL: MESA. Google Scholar | |
|
Wright, BD, Linacre, JM, Gustafen, JE, Martin-Lof, P (1994) Reasonable meansquare fit values. Rasch Measurement Transactions 8: 370. Google Scholar |
