Abstract
The purpose of this study is to describe an alternative means of estimating school effectiveness, referred to as an “absolute year” of schooling and demonstrate its usefulness as a measure of school effectiveness in the middle grades. More specifically, the study investigated (a) whether the absolute schooling effect in math and reading outcomes varied across a statewide sample of 53 secondary schools (e.g., middle, intermediate) and (b) whether differences in school variables explained the variability in the absolute-schooling effect.
|
Alspaugh, J. W. (1998). Achievement loss associated with the transition to middle school and high school. Journal of Educational Research, 92, 20-26. Google Scholar | Crossref | ISI | |
|
Arcia, E. (2007). A comparison of elementary/k-8 and middle schools’ suspension rates. Urban Education, 42, 456-469. Google Scholar | SAGE Journals | ISI | |
|
Balfanz, R., Legters, N., West, T. C., Weber, L. M. (2007). Are NCLB’s measures, incentives and improvement strategies the right ones for the nation’s low-performing high schools? American Educational Research Journal, 44, 559-593. Google Scholar | SAGE Journals | |
|
Barth, R. (1990). Improving schools from within. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Beane, J., Lipka, R. (2006). Guess again: Will changing the grades save middle-level education? Educational Leadership, 63(7), 26-30. Google Scholar | |
|
Birnbaum, R. (2000). Policy scholars are from Venus: Policy makers are from Mars. Review of Higher Education, 23, 119-132. Google Scholar | Crossref | |
|
Bloom, H. S., Hill, C. J., Black, A. R., Lipsey, M. W. (2008). Performance trajectories and performance gaps as achievement effect-size benchmarks for educational evaluations. Journal of Research on Educational Effectiveness, 1, 289-328. Google Scholar | Crossref | |
|
Bosker, R. J., Scheerens, J. (1994). Conceptual and methodological advances in educational effectiveness research. International Journal of Educational Research, 21, 123-231. Google Scholar | Crossref | |
|
Byrnes, V., Ruby, A. (2007). Comparing achievement between K-8 and middle schools: A large scale empirical study. American Journal of Education, 114, 101-135. Google Scholar | Crossref | |
|
Cahan, S., Cohen, N. (1989). Age versus schooling effects on intelligence development. Child Development, 60, 1239-1249. Google Scholar | Crossref | Medline | ISI | |
|
Cahan, S., Davis, D. (1987). A between-grades-level approach to the investigation of the absolute effects of schooling on achievement. American Educational Research Journal, 24, 1-12. Google Scholar | SAGE Journals | |
|
California Department of Education . (2008). California’s middle grades at a glance (2007-08). Retrieved from http://www.cde.ca.gov/ci/gs/mg/documents/ataglance.doc Google Scholar | |
|
Christie, K. (2005). Providing the facts. Phi Delta Kappan, 86, 341-342. Google Scholar | SAGE Journals | |
|
Coe, R., Fitz-Gibbon, C. (1998). School effectiveness research: criticisms and recommendations. Oxford Review of Education, 24, 421-438. Google Scholar | Crossref | ISI | |
|
Cohen, D., Raudenbush, S., Ball, D. (2003). Resources, instruction, and research. Educational Evaluation and Policy Analysis, 25, 1-24. Google Scholar | SAGE Journals | |
|
Coladarci, T., Hancock, J. (2003). The (Limited) evidence regarding effects of grade-span configurations on academic achievement: What rural educators should know. Retrieved from http://www.ericdigests.org/2003-2/rural.html Google Scholar | |
|
Connolly, F., Yakimowski-Srebnick, M. E., Russo, C. V. (2002). An examination of K-5, 6-8 versus K-8 grade configurations. ERS Spectrum, 20(2), 28-37. Google Scholar | |
|
Cook, T. (2002). Randomized experiments in education: A critical examination of the reason the educational evaluation community has offered for not doing them Educational Evaluation and Policy Analysis, 24, 175-200. Google Scholar | SAGE Journals | |
|
Cook, T. D. (2008). Waiting for life to arrive: A history of the regression-discontinuity design in psychology, statistics and economics. Journal of Econometrics, 142, 636-654. Google Scholar | Crossref | |
|
Creemers, B. P. M., Kyriakides, L. (2008). The dynamics of educational effectiveness: A contribution to policy, practice and theory in contemporary schools. London, England: Routledge. Google Scholar | |
|
Davison, M. L., Seo, Y. S., Davenport, E. C., Butterbaugh, D., Davison, L. J. (2004). When do children fall behind? What can be done? Phi Delta Kappan, 85, 752-761. Google Scholar | SAGE Journals | |
|
Eccles, J. S., Lord, S., Midgley, C. (1991). What are we doing to early adolescents? The impact of educational contexts on early adolescents. American Journal of Education, 99, 521-542. Google Scholar | Crossref | ISI | |
|
Erb, T. O. (2006). Middle school models are working in many grade configurations to boost student performance. American Secondary Education, 34(3), 4-13. Google Scholar | |
|
Gamoran, A., Ayalon, H. (2000). Stratification in academic secondary programs and educational inequality in Israel and the United States. Comparative Education Review, 44, 54-80. Google Scholar | Crossref | |
|
Goldstein, H. (1997). Methods is school effectiveness research. School Effectiveness and School Improvement, 8, 369-395. Google Scholar | Crossref | |
|
Gomez, M. O., Marcoulides, G. A., Heck, R. H. (2012). Examining culture and performance at different middle school level structures. International Journal of Educational Management, 26, 205-222. Google Scholar | |
|
Gronna, S. S. (1998). Effects of grade of school transition and school characteristics of eight-grade achievement: A multilevel analysis (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (ProQuest ID No. 733030101) Google Scholar | |
|
Hammond, D. H. (2006). Securing the right to learn: Policy and practice for powerful teaching and learning. Educational Researcher, 35(7), 13-24. Google Scholar | SAGE Journals | |
|
Heck, R. H. (2006). Assessing school achievement progress: Comparing alternative approaches. Educational Administration Quarterly, 42, 667-699. Google Scholar | SAGE Journals | ISI | |
|
Heck, R. H. (2009). Teacher effectiveness and student achievement: Investigating a multilevel cross-classified model. Journal of Educational Administration, 47, 227-249. Google Scholar | Crossref | |
|
Heck, R. H., Hallinger, P. (2009). Assessing the contribution of distributed leadership to school improvement and growth in math achievement. American Educational Research Journal, 46, 659-689. Google Scholar | SAGE Journals | ISI | |
|
Heller, R., Calderon, S., Medrich, E. (2003). Academic achievement in the middle grades: What does research tell us? A review of the literature. Atlanta, GA: Southern Regional Education Board. Retrieved from http://www.eric.ed.gov/PDFS/ED478009.pdf Google Scholar | |
|
Hill, H. C. (2007). Mathematical knowledge of middle school teachers: Implications for the No Child Left Behind policy initiative. Educational Evaluation and Policy Analysis, 29, 95-114. Google Scholar | SAGE Journals | ISI | |
|
Hill, P. W., Rowe, K. J. (1996). Multilevel modeling in school effectiveness research. School Effectiveness and School Improvement, 7, 1-32. Google Scholar | Crossref | ISI | |
|
Howley, C. B. (2002). Grade-span configurations: Where 6th and 7th grades are assigned may influence student achievement, research suggests. The School Administrator, March, 1-6. Google Scholar | |
|
Hox, J. J. (2010). Multilevel analysis: Techniques and applications (2nd ed.). Mahwah, NJ: Lawrence Erlbaum. Google Scholar | Crossref | |
|
Imbens, G. W., Lemieux, T. (2008). Regression discontinuity designs: A guide to practice. Journal of Econometrics, 142, 615-635. Google Scholar | Crossref | ISI | |
|
Klump, J. (2006). What the research says (or doesn’t say) about K-8 versus middle school grade configurations. Changing Face of the Classroom, 11(3), 1-4. Google Scholar | |
|
Konstantopoulos, S. (2006). Trends of school effects on student achievement: evidence from NLS:72, HSB:82 and NELS:92. Teachers College Record, 108, 2550-2581. Google Scholar | Crossref | |
|
Kyriakides, L., Luyten, H. (2009). The contribution of schooling to the cognitive development of secondary education students in Cyprus. School Effectiveness and School Improvement, 20, 167-186. Google Scholar | Crossref | |
|
Lee, V. E., Bryk, A. S. (1989). A multilevel model of the social distribution of high school achievement. Sociology of Education, 62, 172-192. Google Scholar | Crossref | ISI | |
|
Lee, V. E., Burkam, D. T. (2003). Dropping out of high school: The role of school organization and structure. American Educational Research Journal, 40, 353-394. Google Scholar | SAGE Journals | ISI | |
|
Linn, R. L., Baker, E. L., Betebenner, D. W. (2002). Accountability systems: Implications of requirements of the No Child Left Behind Act of 2001. Educational Researcher, 31(6), 3-16. Google Scholar | SAGE Journals | |
|
Linn, R. L., Haug, C. (2002). Stability of school-building accountability scores and gains. Educational Evaluation and Policy Analysis, 24, 29-36. Google Scholar | SAGE Journals | ISI | |
|
Luyten, H. (2006). An empirical assessment of the absolute effect of schooling: Regression discontinuity applied to TIMSS-95. Oxford Review of Education, 32, 397-429. Google Scholar | Crossref | |
|
Luyten, H., Peschar, J., Coe, R. (2008). Effects of schooling on reading performance, reading engagement, and reading activities of 15-year olds in England. American Educational Research Journal, 45, 319-342. Google Scholar | SAGE Journals | |
|
Luyten, H., Tymms, P., Jones, P. (2009). Assessing school effects without controlling for prior achievement? School Effectiveness and School Improvement, 20, 145-165. Google Scholar | Crossref | ISI | |
|
Moss, B. G., Yeaton, W. H. (2006). Shaping policies related to developmental education: An evaluation using the regression-discontinuity design. Educational Evaluation and Policy Analysis, 28, 215-299. Google Scholar | SAGE Journals | ISI | |
|
Murdock, T. B., Miller, A. (2003). Teachers as sources of middle school students’ motivational identity. Variable-centered and person-centered analytic approaches. Elementary School Journal, 103, 383-399. Google Scholar | Crossref | |
|
National Center for Educational Statistics . (2011). Fast facts. Retrieved from http://nces.ed.gov/fastfacts/display.asp?id=1 Google Scholar | |
|
Oakes, J. (2005). Keeping track: How schools structure inequality (2nd ed.). New Haven, CT: Yale University Press. (Original work published 1985) Google Scholar | |
|
Offenberg, R. (2001, March). The efficacy of Philadelphia’s K-to-8 schools compared to middle grades schools. Middle School Journal, 32, 23-29. Google Scholar | Crossref | |
|
Opdenakker, M. C., Van Damme, J. (2007). Do school context, student composition, ands school leadership affect school practice and outcomes in secondary education? British Educational Research Journal, 33, 179-206. Google Scholar | Crossref | |
|
Pedhazur, E. J., Schmelkin, L. P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Peugh, J. L., Enders, C. K. (2004). Missing data in educational research: A review of reporting practices and suggestions for improvement. Review of Educational Research, 74, 525-556. Google Scholar | SAGE Journals | ISI | |
|
Roeser, R., Eccles, J. (1998). Adolescents’ perceptions of middle school: Relation to longitudinal changes in academic and psychological adjustment. Journal of Research on Adolescence, 8, 123-158. Google Scholar | Crossref | ISI | |
|
Sammons, P., Luyten, H. (2009). Editorial article for special issue on alternative methods for assessing school effects and schooling effects. School Effectiveness and School Improvement, 20, 133-143. Google Scholar | Crossref | ISI | |
|
Sammons, P., Nuttall, D., Cuttance, P. (1993). Differential school effectiveness: Results from a re-analysis of the Inner London Education Authority’s junior school project data. British Educational Research Journal, 19, 381-405. Google Scholar | Crossref | |
|
Scheerens, J. (2012). Anatomy of some representative school leaders’ effectiveness studies. In Sheerens, J. (Ed.), School leadership effects revisited: Review and meta-analysis of empirical studies (pp. 45-64). London, England: Springer. Google Scholar | Crossref | |
|
Scheerens, J., Bosker, R. J. (1997). The foundations of educational effectiveness. Oxford, England: Pergamon. Google Scholar | |
|
Shadish, W. R., Cook, T. D., Campbell, D. T. (2002). Experimental and quasi-experimental design for generalized causal inference. Boston, MA: Houghton Mifflin. Google Scholar | |
|
Teddlie, C., Reynolds, D. (2000). The international handbook of school effectiveness research. London, England: Falmer Press. Google Scholar | |
|
Thistlethwaite, D., Campbell, D. (1960). Regression-discontinuity analysis: An alternative to ex post facto experiment. Journal of Educational Psychology, 51, 309-317. Google Scholar | Crossref | |
|
Thomas, S. L., Heck, R. H. (2009, December 31). Hawaiian Cultural Influences in Education (HCIE) multilevel statistical analyses. Report prepared for Kamehameha Schools/Bishop Estate, Honolulu. Google Scholar | |
|
Trochim, W. M. K. (1984). Research design for program evaluation: The regression-discontinuity approach. London, England: Sage. Google Scholar | |
|
U.S. Department of Education . (2005). Scientifically based evaluation methods (Notice RIN 1890-ZA00). Federal Register, 70, 3586-3589. Google Scholar | |
|
Viadero, D. (2008). Evidence for moving to K-8 not airtight. Education Week, 27(19), 11-13. Google Scholar | |
|
Weiss, C. C. (2008). Re-examining middle school effects: What the research says. Principal, 87(3), 60-61. Google Scholar | |
|
Weiss, C. C., Kipnes, L. (2006). Reexamining middle school effects: A comparison of middle grades students in middle schools and K-8 schools. American Journal of Education, 112, 239-272. Google Scholar | Crossref | |
|
Whitley, J., Lupart, J. L., Beran, T. (2007). Differences in achievement between adolescents who remain in a K-8 school and those who transition to junior high school. Canadian Journal of Education, 30, 649-669. Google Scholar | Crossref | |
|
Williams, T., Kirst, M. W., Haertel, E., Levin, J., Padia, B., Balfanz, R., . . . Woodward, K. M. (2010). Gaining ground in the middle grades: Why some schools do better. Mountain View, CA: EdSource. Retrieved from http://www.edsource.org/middle-grades-summary.html Google Scholar | |
|
Willms, J. D., Raudenbush, S. W. (1989). A longitudinal hierarchical linear model for estimating school effects and their stability. Journal of Educational Measurement, 26(3), 209-232. Google Scholar | Crossref | ISI | |
|
Yecke, C. P. (2006). Mayhem in the middle: Why we should shift to K-8. Educational Leadership, 63(7), 20-25. Google Scholar | |
|
Zanobini, M., Usai, C. M. (2002). Domain-specific self-concept and achievement motivation in the transition from primary to low middle school. Educational Psychology, 22, 203-217. Google Scholar | Crossref |
Bios
Elias Ali is a high school principal in the Hawaii Department of Education. His research interests include school effects on student learning.
Ronald H. Heck is a professor of educational administration at the University of Hawaii at Manoa. His research interests include school leadership and school improvement.

