![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
During the last 25 years researchers have proposed a number of conceptual frameworks to measure the various functions of instructional leadership. One of the most frequently used frameworks is the Principal Instructional Management Rating Scale (PIMRS). Despite the great number of studies employing the PIMRS, evidence for its reliability and validity is relatively limited. In addition, we still don’t know much about the extent to which this instrument could be used in diverse demographic and cultural educational settings. This study explores the content, face, and construct validity, reliability and internal consistency of the PIMRS in the Chinese educational system. A total number of 311 teachers from five middle schools in the Haidian District of Beijing participated in the study. The data were analysed using Confirmatory Factor Analysis (CFA). On an overall basis the results provided support for the face, content, and construct validity, reliability and internal consistency of the PIMRS. However, six out of the 50 items had to be removed to reach satisfactory fit indices. Implications of the findings in relation to the importance of evaluating the measuring properties of research instruments are discussed and, finally, suggestions for future studies are provided.
References
Section:
|
Allison, P (2002) Missing Data. Thousand Oaks, CA: SAGE Publications. Google Scholar | Crossref | |
|
Antoniou, P (2012) The short- and long-term effects of secondary schools upon students’ academic success and development. Educational Research and Evaluation 18(7): 621–640. Google Scholar | Crossref | |
|
Antoniou, P (2013a) A longitudinal study investigating relations between stages of effective teaching, teaching experience and teacher professional development approaches. Journal of Classroom Interaction 48(2): 25–40. Google Scholar | |
|
Antoniou, P (2013b) Development of research on school leadership through evidence-based and theory-driven approaches: A review of school leadership effects revisited. School Effectiveness and School Improvement 24(1): 122–128. Google Scholar | |
|
Antoniou, P, Kyriakides, L (2011) The impact of a dynamic approach to professional development on teacher instruction and student learning: Results from an experimental study. School Effectiveness and School Improvement 22(3): 291–311. Google Scholar | Crossref | ISI | |
|
Antoniou, P, Kyriakides, L (2013) A dynamic integrated approach to teacher professional development: Impact and sustainability of the effects on improving teacher behavior and student outcomes. Teaching and Teacher Education 29(1): 1–12. Google Scholar | |
|
Antoniou, P, Kyriakides, L, Creemers, BPM (2015) A dynamic integrated approach to teacher professional development. Rationale and main characteristics. Teacher Development 19(4): 535–552. Google Scholar | Crossref | ISI | |
|
Beaton, DE, Bombardier, C, Guillemin, F, Ferraz, MB (2000) Guidelines for the process of cross-cultural adaptation of self-report measures. Spine 25: 3186–3191. Google Scholar | Crossref | Medline | ISI | |
|
Bossert, S, Dwyer, D, Rowan, B, Lee, G (1982) The instructional management role of the principal. Educational Administration Quarterly 18(3): 34–64. Google Scholar | SAGE Journals | ISI | |
|
Bush, T (2011) Theories of Educational Leadership and Management. 4th ed. London: SAGE Publications. Google Scholar | |
|
Bush, T (2014) Educational leadership and leadership development in Africa: Building the knowledge base. Educational Management Administration & Leadership 42(6): 787–791. Google Scholar | SAGE Journals | ISI | |
|
Bush, T (2015) Understanding instructional leadership. Educational Management Administration & Leadership 43(4): 487–489. Google Scholar | SAGE Journals | ISI | |
|
Bush, T, Glover, D (2014) School leadership models: What do we know? School Leadership and Management 34(5): 553–571. Google Scholar | Crossref | |
|
Byrne, BM (1998) Structural Equation Modeling with LISREL, PRELIS and SIMPLIS: Basic Concepts, Applications and Programming. Mahwah, NJ: Lawrence Erlbaum Associates. Google Scholar | |
|
Chen, CC, Lee, YT (2008) Leadership and Management in China – Philosophies, Theories, and Practices. Cambridge: Cambridge University Press. Google Scholar | Crossref | |
|
Chen, FF, Sousa, KH, West, SG (2005) Testing measurement invariance of second-order factor models. Structural Equation Modeling 12(3): 471–492. Google Scholar | Crossref | ISI | |
|
Condon, C, Matthews, C (2010) Measuring Principal Performance: How Rigorous are Commonly used Principal Performance Assessment Instruments? A Quality School Leadership Issue Brief. Naperville, IL: Learning Point Associates. Google Scholar | |
|
Collins, S, Clarke, A (2008) Activity frames and complexity thinking: honouring both public and personal agendas in an emergent curriculum. Teaching and Teacher Education 24: 1003–1014. Google Scholar | Crossref | ISI | |
|
Crawford, M (2012) Solo and distributed leadership: Definitions and dilemmas. Educational Management Administration & Leadership 40(5): 610–620. Google Scholar | SAGE Journals | ISI | |
|
Creemers, BPM, Kyriakides, L, Antoniou, P (2012) Teacher Professional Development for Improving Quality of Teaching. New York, USA: Springer Publishing. Google Scholar | |
|
Creemers, BPM, Kyriakides, L (2010) Explaining stability and changes in school effectiveness by looking at changes in the functioning of school factors. School Effectiveness and School Improvement 21(4): 409–427. Google Scholar | |
|
Cronbach, LJ (1990) Essentials of Psychological Testing. 3rd ed. New York: Harper and Row. Google Scholar | |
|
Crow, GM (2001) School leader preparation: A short review of the knowledge base. Nottingham: National College for School Leadership. Available at: http://www.ncsl.org.uk/researchpublications (accessed 11 August 2016) Google Scholar | |
|
Davis, S, Darling-Hammond, L, LaPointe, M, Myerson, D (2005) Review of Research, School Leadership Study: Developing Successful Principals. Stanford, CA: Educational Leadership Institute. Google Scholar | |
|
DeVon, HA, Block, ME, Moyle-Wright, P, Hayden, SJ, Lazzara, DJ, Savoy, SM, Kostas-Polston, E (2007) A psychometric toolbox for testing validity and reliability. Journal of Nursing Scholarship 39(2): 155–164. Google Scholar | Crossref | Medline | ISI | |
|
DeYoung, CG, Peterson, JB, Higgins, DM (2002) Higher-order factors of the big five predict conformity: Are there neuroses of health? Personality and Individual Differences 33: 533–552. Google Scholar | Crossref | ISI | |
|
Dimmock, C (2011) Formulating a research agenda in school leadership and organisational change for school improvement in Singapore. School Leadership and Management 31(4): 321–338. Google Scholar | Crossref | |
|
Dimmock, C, Walker, A (2005) Educational Leadership: Culture and Diversity. London: SAGE Publications. Google Scholar | |
|
Dwyer, FR, Sejo, O (1987) Output sector munificence effects on the internal political economy of marketing channels. Journal of Marketing Research 24(November): 347–358. Google Scholar | SAGE Journals | |
|
Eacott, S, Asuga, GN (2014) School leadership preparation and development in Africa: A critical insight. Educational Management Administration & Leadership 42(6): 919–934. Google Scholar | SAGE Journals | ISI | |
|
Ebel, R (1951) Estimation of the reliability of ratings. Psychometrika 16: 407–424. Google Scholar | Crossref | |
|
Edwards, G, Turnbull, S (2013) A cultural approach to evaluating leadership development. Advances in Developing Human Resources 15(1): 46–60. Google Scholar | SAGE Journals | |
|
Fromm, G, Hallinger, P, Volante, P, Wang, WC (2016) Validating a Spanish version of the PIMRS: Application in national and cross-national research on instructional leadership. Educational Management Administration & Leadership. Epub ahead of print 23 May 2016. DOI: 1741143215617948. Google Scholar | |
|
Glanz, J, Neville, RF (1997) Educational Supervision: Perspectives, Issues, and Controversies. Norwood, MA: Christopher-Gordon. Google Scholar | |
|
Gronn, P (2003) The New Work of Educational Leaders: Changing Leadership Practice in an Era of School Reform. London: Paul Chapman. Google Scholar | |
|
Haladyna, TM (1999) Developing and Validating Multiple-Choice Test Items. Mahwah, NJ: Lawrence Erlbaum Associates. Google Scholar | |
|
Hallinger, P (1983) Assessing the instructional management behavior of principals. PhD Thesis, Stanford University, USA. Google Scholar | |
|
Hallinger, P (2008) A review of PIMRS studies of principal instructional leadership: Assessment of progress over 25 years. Paper presented at the Annual meeting of the American Educational Research Association (AERA), New York, 14 May 2008. Google Scholar | |
|
Hallinger, P (2011) A review of three decades of doctoral studies using the principal instructional management rating scale: A lens on methodological progress in educational leadership. Educational Administration Quarterly 47(2): 271–306. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P, Chen, J (2015) Review of research on educational leadership and management in Asia: A comparative analysis of research topics and methods, 1995–2012. Educational Management Administration & Leadership 43(1): 5–27. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P, Lee, M (2014) Mapping instructional leadership in Thailand: Has education reform impacted principal practice? Educational Management Administration & Leadership 42(1): 6–29. Google Scholar | SAGE Journals | ISI | |
|
Hallinger, P, Murphy, J (1985) Assessing the instructional leadership behavior of principals. Elementary School Journal 86(2): 217–248. Google Scholar | Crossref | ISI | |
|
Hallinger, P, Wang, WC (2013) Measurement Properties of the Principal Instructional Management Rating Scale. Technical Report, version 4.2. Hong Kong: Hong Kong Institute of Education, Asia Pacific Centre for Leadership and Change. Google Scholar | |
|
Hallinger, P, Wang, WC, Chen, CW (2013) Assessing the measurement properties of the principal instructional management rating scale: A meta-analysis of reliability studies. Educational Administration Quarterly 49(2): 272–309. Google Scholar | SAGE Journals | ISI | |
|
Heck, RH, Hallinger, P (2005) The study of educational leadership and management. Where does the field stand today? Educational Management Administration & Leadership 33(2): 229–244. Google Scholar | SAGE Journals | |
|
Howe, W (1995) Instructional leadership in catholic elementary schools: An analysis of personal, organizational, and environmental correlates. PhD Thesis, Stanford University, USA. Google Scholar | |
|
Jones, P (1987) The relationship between principal behavior and student achievement in Canadian secondary schools. PhD Thesis, Stanford University, USA. Google Scholar | |
|
Kline, RB (2010) Principles and Practice of Structural Equation Modeling. 3rd ed. New York: Guilford Press. Google Scholar | |
|
Krug, SE (1990) Leadership and learning: A measurement-based approach for analyzing school effectiveness and developing effective school leaders. Project Report No. BBB28334. Urbana, IL: National Center for School Leadership. Google Scholar | |
|
Kyriakides, L, Creemers, BPM (2009) The effects of teacher factors on different outcomes: Two studies testing the validity of the dynamic model. Effective Education 1(1): 61–85. Google Scholar | Crossref | |
|
Kyriakides, L, Creemers, BPM, Antoniou, P, Demetriou, D, Charalambous, C (2015) The impact of school policy and stakeholders’ actions on student learning: a longitudinal study. Learning and Instruction 36: 113–124. Google Scholar | Crossref | |
|
Law, WW (2010) Culture and school leadership in China: Exploring school leaders’ views of relationship- and rule-based governance. In: Wiseman, A (ed.) Educational Leadership: Global Contexts and International Comparisons. Bingley: Emerald Publishing, pp.303–341. Google Scholar | |
|
Lee, M, Hallinger, P, Walker, A (2012) A distributed perspective on instructional leadership in International Baccalaureate (IB) schools. Educational Administration Quarterly 48(4): 664–698. Google Scholar | SAGE Journals | ISI | |
|
Leithwood, K, Stager, M (1989) Expertise in principals’ problem solving. Educational Administration Quarterly 25(2): 126–161. Google Scholar | SAGE Journals | ISI | |
|
Leithwood, K, Steinbach, R (1991) Indicators of transformational leadership in everyday problem-solving of school administrators. Journal of Personnel Evaluation in Education 4(3): 221–244. Google Scholar | Crossref | |
|
Leithwood, K, Day, C, Sammons, P, Harris, A, Hopkins, D (2006) Seven Strong Claims about Successful School Leadership. Nottingham: National College of School Leadership. Google Scholar | |
|
Leithwood, K, Louis, K, Anderson, S, Wahlstrom, K (2004) Review of Research: How Leadership Influence Student Learning? New York: Wallace Foundation. Google Scholar | |
|
Leung, K (2012) Indigenous Chinese management research: Like it or not, we need it. Management and Organizational Review 8(1): 1–5. Google Scholar | Crossref | |
|
Li, PP, Leung, K, Chen, C, Luo, J-D (2012) Indigenous research on Chinese management: What and how. Management and Organizational Review 8(1): 7–24. Google Scholar | Crossref | ISI | |
|
Marks, H, Printy, S (2003) Principal leadership and school performance: An integration of transformational and instructional leadership. Educational Administration Quarterly 39(3): 370–397. Google Scholar | SAGE Journals | ISI | |
|
Mulford, B (2008) The Leadership Challenge: Improving Learning in Schools. Victoria: Australian Council for Educational Research. Google Scholar | |
|
Nogay, K (1995) The relationship of superordinate and subordinate gender to the perceptions of leadership behaviors of female secondary principals. PhD Thesis, Youngstown State University, USA. Google Scholar | |
|
Ogawa, R, Bossert, S (1995) Leadership as an organizational quality. Educational Administration Quarterly 31(2): 224–243. Google Scholar | SAGE Journals | ISI | |
|
Opfer, VD, Pedder, D (2011) Conceptualizing Teacher Professional Learning. Review of Educational Research 81(3): 376–407. Google Scholar | SAGE Journals | |
|
Pilot, D, Hunger, B (1999) Nursing Research: Principals and Methods. Philadelphia: Lippincott Williams & Wilkins. Google Scholar | |
|
Pitner, N (1988) The study of administrator effects and effectiveness. In: Boyan, N (ed.) Handbook of Research in Educational Administration. New York: Longman, pp.106–132. Google Scholar | |
|
Portin, B, DeArmond, M, Gundlach, L, Schneider, P (2003) A Practical Look at School Leadership. Policy Brief. Seattle, WA: Center on Reinventing Public Education. Google Scholar | |
|
Robinson, VMJ, Lloyd, C, Rowe, KJ (2008) The impact of leadership on student outcomes: An analysis of the differential effects of leadership type. Educational Administration Quarterly 44(5): 635–674. Google Scholar | SAGE Journals | ISI | |
|
Sawyer, E (1997) The relationship between cognitive styles and instructional leadership. PhD Thesis, University of Missouri, USA. Google Scholar | |
|
Schumacker, RE, Lomax, RG (2004) A Beginner’s Guide to Structural Equation Modelling. 2nd ed. Mahwah, NJ: Lawrence Erlbaum Associates. Google Scholar | Crossref | |
|
Shatzer, HR, Caldarella, P, Hallam, RP, Brown, BL (2014) Comparing the effects of instructional and transformational leadership on student achievement: Implications for practice. Educational Management Administration & Leadership 42(4): 445–459. Google Scholar | SAGE Journals | ISI | |
|
Sun, M (2014) 30 years of Chinese educational management: Achievements, characteristics and problems. International Journal of Educational Management 28(3): 340–348. Google Scholar | |
|
Taraseina, P (1993) Assessing instructional leadership behavior of secondary school principals in Thailand. PhD Thesis, Peabody College for Teachers of Vanderbilt University, Nashville, USA. Google Scholar | |
|
Trochim, WMK (2001) The Research Methods Knowledge Base. Cincinnati, OH: Atomic Dog. Google Scholar | |
|
Walker, A, Dimmock, C (2002) Cross-cultural and comparative insights into educational administration and leadership: An initial framework. In: Walker, A, Dimmock, C (eds) School Leadership and Administration: Adopting a Cultural Perspective. New York: Routledge Falmer, pp.13–32. Google Scholar | |
|
Wotany, J (1999) The training, selection, and hiring practices of Cameroonian school leaders and the evaluation of the present effectiveness of their instructional leadership behaviors. PhD Thesis, University of Missouri, USA. Google Scholar | |
|
Yang, Y (2014) Principals’ transformational leadership in school improvement. International Journal of Educational Management 28(3): 279–288. Google Scholar | |
|
Yukl, G (2006) Leadership in Organizations. 6th ed. Upper Saddle River, NJ: Prentice Hall. Google Scholar |
