![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
A primary focus of recent educational policymaking has been on improving measures of teaching effectiveness, attributable in part to recent federal policies such as the Race to the Top initiative and Investing in Innovation. To date, neither researchers nor practitioners have arrived at a consensus on the best methods for evaluating special educators. While value-added scores are likely not suitable for the majority of special education teachers, observation systems appear to be more promising because they can be used across a variety of instructional settings and formats. To illustrate the steps that would be necessary to validate observation systems for use with special educators, we examine the observation system being most commonly used in school districts—Charlotte Danielson’s Framework for Teaching (FFT). Drawing on empirical research, we propose a definition of effective special education teaching, and we then use this definition to frame our investigation into FFT. We conclude with a series of recommendations for research that would establish the validity of using FFT to evaluate special educators. We also describe how the challenges specific to FFT would generalize to other observation systems.
Keywords instruction, observation, professional development
References
Section:
|
American Institutes for Research . (2012). Database on state teacher evaluation policies. Retrieved from http://resource.tqsource.org/stateevaldb/Default.aspx Google Scholar | |
|
Baker, S., Gersten, R., Haager, D., Dingle, M. (2006). Teaching practice and the reading growth of first-grade English learners: Validation of an observation instrument. Elementary School Journal, 107, 199–221. Google Scholar | Crossref | ISI | |
|
Bell, C., Gitomer, D., McCaffrey, D., Hamre, B., Pianta, R., Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17, 62–87. Google Scholar | Crossref | |
|
Bell, C., Jones, N., Lewis, J., Qi, Y. (2013, March). Predicting observer training satisfaction and certification. Paper presented at the spring meeting of Society for Research on Educational Effectiveness, Washington, DC. Google Scholar | |
|
Bill & Melinda Gates Foundation . (2010). Measures of effective teaching project. Available from http://www.metproject.org/ Google Scholar | |
|
Bill & Melinda Gates Foundation . (2012). Gathering feedback for teaching: Combining high quality observations with student surveys and achievement gains. Seattle, WA: Author. Google Scholar | |
|
Bill & Melinda Gates Foundation . (2013). Ensuring fair and reliable measures of effective teaching: Culminating findings from the MET project’s three-year study. Seattle, WA: Author. Google Scholar | |
|
Blanton, L. (1992). Preservice education: Essential knowledge for the effective special education teacher. Teacher Education and Special Education, 15, 87–96. Google Scholar | SAGE Journals | |
|
Boyd, D., Lankford, H., Loeb, S., Wyckoff, J. (2005). The impact of assessment and accountability on teacher recruitment and retention: Are there unintended consequences? Washington, DC: U.S. Department of Education. Google Scholar | |
|
Boyer, L., Gillespie, P. (2000). Keeping the committed: The importance of induction and support programs for new special educators. Teaching Exceptional Children, 33, 10–15. Google Scholar | SAGE Journals | |
|
Brownell, M., Bishop, A., Gersten, R., Klingner, J., Penfield, R., Dimino, J., . . .Sindelar, P. (2009). The role of domain expertise in beginning special education teacher quality. Exceptional Children, 75, 391–411. Google Scholar | SAGE Journals | ISI | |
|
Brownell, M., Haager, D., Bishop, A., Klingner, J., Menon, S., Penfield, R., Dingle, M. (2007, April). Teacher quality in special education: The role of knowledge, classroom practice, and school environment. Paper presented at the Annual Meeting for the American Education Research Association, Chicago, IL. Google Scholar | |
|
Brownell, M., Sindelar, P., Kiely, M., Danielson, L. (2010). Special education teacher quality and preparation: Exposing foundations, constructing a new model. Exceptional Children, 76, 357–377. Google Scholar | SAGE Journals | ISI | |
|
Brownell, M., Smith, S., Crockett, J., Griffin, C. (2012). Inclusive instruction: Evidence-based practices for teaching students with disabilities. New York, NY: Guilford Press. Google Scholar | |
|
Buzick, H., Laitusis, C. (2010). Using growth for accountability: Measurement challenges for students with disabilities and recommendations for research. Educational Researcher, 9, 537–544. Google Scholar | SAGE Journals | ISI | |
|
Cochran-Smith, M., Lytle, S. (1990). Research on teaching and teacher research: The issues that divide. Educational Researcher, 19, 2–11. Google Scholar | SAGE Journals | |
|
Danielson, C. (1996). Enhancing professional practice: A framework for teaching (1st ed.). Alexandria, VA: Association for Supervision and Curriculum Development. Google Scholar | |
|
Danielson, C. (2007). Enhancing professional practice: A framework for teaching (2nd ed.). Alexandria, VA: Association for Supervision and Curriculum Development. Google Scholar | |
|
Danielson, C. (2011). The framework for teaching evaluation instrument. Princeton, NJ: The Danielson Group. Google Scholar | |
|
Dwyer, C. A. (1994). Criteria for performance-based teacher assessments: Validity, standards, and issues. Journal of Personnel Evaluation in Education, 8, 135–150. Google Scholar | Crossref | |
|
Englert, C., Tarrant, K., Mariage, T. (1992). Defining and redefining instructional practice in special education: Perspectives on good teaching. Teacher Education and Special Education, 15, 62–86. Google Scholar | SAGE Journals | |
|
Feng, L., Sass, T. R. (2010). What makes special-education teacher special? Teacher training and achievement of students with disabilities (CALDER Working Paper 49). Washington, DC: The Urban Institute. Google Scholar | Crossref | |
|
Gallagher, H. A. (2004). Vaughn Elementary’s innovative teacher evaluation system: Are teacher evaluation scores related to growth in student achievement? Peabody Journal of Education, 79, 79–107. doi:10.1207/s15327930pje7904_5 Google Scholar | Crossref | |
|
Gersten, R., Baker, S., Haager, D., Graves, A. (2005). Exploring the role of teacher quality in predicting reading outcomes for first-grade English learners. Remedial and Special Education, 26, 197–206. Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Beckmann, S., Clarke, B., Foegen, A., Marsh, L., Star, J., Witzel, B. (2009). Assisting students struggling with mathematics: Response to Intervention (RtI) for elementary and middle schools (NCEE 2009-4060). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ies.ed.gov/ncee/wwc/publications/practiceguides/ Google Scholar | |
|
Gersten, R., Compton, D., Connor, C., Dimino, J., Santoro, L., Linan-Thompson, S., Tilly, W. (2008). Assisting students struggling with reading: Response to intervention and multi-tier intervention for reading in the primary grades: A practice guide (NCEE 2009-4045). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. Retrieved from http://ies.ed.gov/ncee/wwc/publications/practiceguides/ Google Scholar | |
|
Gimbert, B., Bol, L., Wallace, D. (2007). The influence of teacher preparation on student achievement and the application of national standards by teachers of mathematics in urban secondary schools. Education and Urban Society, 40, 91–117. Google Scholar | SAGE Journals | ISI | |
|
Goe, L. (2007). The link between teacher quality and student outcomes: A research synthesis. Washington, DC: National Comprehensive Center for Teacher Quality. Google Scholar | |
|
Gordon, R., Kane, T., Staiger, D. (2006). Identifying effective teachers using performance on the job (Discussion Paper 2006–01). Washington, DC: Brookings Institution. Google Scholar | |
|
Hill, H., Charalambous, C., Kraft, M. (2012). When rater reliability is not enough: Teacher observation systems and a case for the generalizability study. Educational Researcher, 41, 56–64. Google Scholar | SAGE Journals | ISI | |
|
Hill, H., Kapitula, L., Umland, K. (2011). A validity argument approach to evaluating teacher value-added scores. American Educational Research Journal, 48, 794–831. Google Scholar | SAGE Journals | ISI | |
|
Holdheide, L. (2013). Inclusive design: Building educator evaluation systems that support students with disabilities. Available from www.gtlcenter.org Google Scholar | |
|
Holtzapple, E. (2003). Criterion-related validity evidence for a standards-based teacher evaluation system. Journal of Personnel Evaluation in Education, 17, 207–219. Google Scholar | Crossref | |
|
Individuals with Disabilities Education Act Amendments of 1997, Pub. L. No. 105–17 . (1997). Retrieved from http://www.ed.gov/offices/OSERS/Policy/IDEA/the_law.html Google Scholar | |
|
Individuals with Disabilities Education Improvement Act of 2004, Pub. L. No. 108–446 . (2004). Retrieved from http://idea.ed.gov/explore/view/p/%2Croot%2Cstatute%2C Google Scholar | |
|
Jones, N. D., Buzick, H. M., Turkan, S. (2013). Including students with disabilities and English learners in measures of educator effectiveness. Educational Researcher, 42, 234–241. Google Scholar | SAGE Journals | ISI | |
|
Jordan, A., Stanovich, P. (2003). Teachers’ personal epistemological beliefs about students with disabilities as indicators of effective teaching practices. Journal of Research in Special Educational Needs, 3, 1–14. Google Scholar | Crossref | |
|
Kane, M. (2006). Validation. In Brennan, R. L. (Ed.), Educational measurement (pp. 17–64). New York, NY: Praeger. Google Scholar | |
|
Kavale, K., Forness, S. (2000). What definitions of learning disability say and don’t say: A critical analysis. Journal of Learning Disabilities, 33, 239–256. Google Scholar | SAGE Journals | ISI | |
|
Kimball, S., White, B., Milanowski, A., Borman, G. (2004). Examining the relationship between teacher evaluation and student assessment results in Washoe County. Peabody Journal of Education, 79, 54–78. doi:10.1207/s15327930pje7904_4 Google Scholar | Crossref | |
|
Leinhardt, G., Zigmond, N., Cooley, W. (1981). Reading instruction and its effects. American Educational Research Journal, 18, 343–361. Google Scholar | SAGE Journals | ISI | |
|
Lockwood, J., McCaffrey, D., Hamilton, L., Stecher, B., Le, V., Martinez, J. (2007). The sensitivity of value-added teacher effect estimates to different mathematics achievement measures. Journal of Educational Measurement, 44, 47–67. Google Scholar | Crossref | ISI | |
|
Marszalek, J., Odom, A., LaNasa, S., Adler, S. (2010). Distortion or clarification: Defining highly qualified teachers and the relationship between certification and achievement. Education Policy Analysis Archives, 18(27). Retrieved from http://epaa.asu.edu/ojs/article/view/837/867 Google Scholar | |
|
Marzano, R. J. (2007). The art and science of teaching: A comprehensive framework for effective instruction. Alexandria, VA: Association for Supervision and Curriculum Development. Google Scholar | |
|
McCaffrey, D., Lockwood, J. (2011). Missing data in value-added modeling of teacher effects. Annals of Applied Statistics, 5, 773–797. Google Scholar | Crossref | ISI | |
|
Milanowski, A. (2004). Relationships among dimension scores of standards-based teacher evaluation systems, and the stability of evaluation score: Student achievement relationships over time. Madison: Wisconsin Center for Education Research, Consortium for Policy Research in Education, University of Wisconsin-Madison. Google Scholar | |
|
No Child Left Behind Act of 2001, 20 U.S.C.A. § 6301 et seq . (West 2003). Google Scholar | |
|
Nougaret, A., Scruggs, T., Mastropieri, M. (2005). Does teacher education produce better special education teachers? Exceptional Children, 71, 217–229. Google Scholar | SAGE Journals | ISI | |
|
Pianta, R. C., La Paro, K. M., Hamre, B. K. (2008). Classroom Assessment Scoring System: Manual K-3. Baltimore, MD: Paul H. Brookes. Google Scholar | |
|
Rice, J. (2003). Teacher quality: Understanding the effectiveness of teacher attributes. Washington, DC: Economic Policy Institute. Google Scholar | |
|
Rivkin, S. G., Hanushek, E. A., Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73, 471–458. Google Scholar | Crossref | ISI | |
|
Sanders, W., Rivers, J. (1996). Cumulative and residual effects of teachers on future student academic achievement. Knoxville: Value-Added Research and Assessment Center, University of Tennessee. Google Scholar | |
|
Seo, S. (2006). Special education reading teachers’ understandings and enactment of motivational teaching for elementary students with learning disabilities (Unpublished dissertation). University of Florida, Gainesville. Google Scholar | |
|
Seo, S., Brownell, M., Bishop, A., Dingle, M. (2008). Beginning special education teachers’ classroom reading instruction: Practices that engage elementary students with learning disabilities. Exceptional Children, 75, 97–122. Google Scholar | SAGE Journals | ISI | |
|
Shulman, L. (1986). Paradigms and research programs in the study of teaching: A contemporary perspective. In Wittrock, M. C. (Ed.), Handbook of research on teaching (3rd ed., pp. 3–36). New York, NY: Macmillan. Google Scholar | |
|
Sindelar, P., Daunic, A., Rennells, M. S. (2004). Comparisons of traditionally and alternatively trained teachers. Exceptional Children, 12, 209–223. Google Scholar | |
|
Sindelar, P., Smith, M., Harriman, N., Hale, R., Wilson, R. (1986). Teacher effectiveness in special education programs. Journal of Special Education, 20, 195–207. Google Scholar | SAGE Journals | ISI | |
|
Swanson, E. A. (2008). Observing reading instruction for students with learning disabilities: A synthesis. Learning Disability Quarterly, 31, 115–133. Google Scholar | SAGE Journals | ISI | |
|
Swanson, L., Hoskyn, M., Lee, C. (1999). Interventions for students with learning disabilities. New York, NY: Guilford Press. Google Scholar | |
|
Taylor, B., Pearson, D., Peterson, D., Rodriguez, D. (2005). The CIERA school change framework: An evidence-based approach to professional development and school reading improvement. Reading Research Quality, 40, 40–69. Google Scholar | Crossref | ISI | |
|
U.S. Department of Education . (2009, October 6). U.S. Secretary of Education announces national competition to invest in innovation [Press release]. Retrieved from http://www2.ed.gov/news/pressreleases/2009/10/10062009a.html Google Scholar | |
|
U.S. Department of Education (2010, March). ESEA a blueprint for reform: The reauthorization of the Elementary and Secondary Education Act. Retrieved from http://www2.ed.gov/policy/elsec/leg/blueprint/blueprint.pdf Google Scholar | |
|
Vannest, K., Hagan-Burke, S. (2010). Teacher time use in special education. Remedial and Special Education, 31, 126–142. Google Scholar | SAGE Journals | ISI | |
|
Vaughn, S., Gersten, R., Chard, D. (2000). The underlying message in LD intervention research: Findings from research syntheses. Exceptional Children, 67, 99–114. Google Scholar | SAGE Journals | ISI | |
|
Vaughn, S., Wanzek, J., Murray, C. S., Scammacca, N., Linan-Thompson, S., Woodruff, A. L. (2009). Response to early reading intervention: Examining higher and lower responders. Exceptional Children, 75, 165–183. Google Scholar | SAGE Journals | ISI | |
|
Wanzek, J., Vaughn, S., Roberts, G., Fletcher, J. M. (2011). Efficacy of a reading intervention for middle school students with disabilities. Exceptional Children, 79, 73–87. Google Scholar | SAGE Journals | ISI | |
|
Wayne, A., Youngs, P. (2003). Teacher characteristics and student achievement gains: A review. Review of Educational Research, 73, 89–122. Google Scholar | SAGE Journals | ISI | |
|
Wilson, S., Floden, R. (2003). Creating effective teachers: Concise answers for hard questions. New York, NY: AACTE Publications. Google Scholar | |
|
Wright, S. P., Horn, S. P., Sanders, W. L. (1997). Teacher and classroom context effects on student achievement: Implications for teacher evaluation. Journal of Personnel Evaluation in Education, 11, 57–67. Google Scholar | Crossref |
