![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
There is currently little consensus on how special education teachers should be evaluated. The lack of consensus may be due to several reasons. Special education teachers work under a variety of complex conditions, with a very heterogeneous population, and support student progress toward a very individualized set of goals. In addition, special education is marked by historical rates of attrition, with a lack of highly qualified teachers entering the field, and a number of special education teachers completing alternate certification programs, leading to a combined effect that impacts overall professional quality. In this article, we first review the challenges associated with evaluating special education teachers, describe and analyze current approaches, and present a conceptual framework for an approach to special education teacher evaluation. We then provide an overview of the Recognizing Effective Special Education Teachers (RESET) tool as a possible alternative to measure special education teacher effectiveness. Given the current zeitgeist of teacher evaluation systems that fail to address the unique circumstances related to special education teachers, it is hoped that the information in this article will contribute to the small but growing body of research on special education teacher evaluation and effectiveness.
Keywords observation, measurement theory, instruction
References
Section:
|
Baker, E. L., Barton, P. E., Darling-Hammond, L., Haertel, E., Ladd, H. F., Linn, R. L., . . . Shepard, L. A. (2010). Problems with the use of student test scores to evaluate teachers (Economic Policy, Vol. 278, pp. 1–29.). Economic Policy Institute. Retrieved from http://epi.3cdn.net/b9667271ee6c154195_t9m6iij8k.pdf Google Scholar | |
|
Bell, C. A., Gitomer, D. H., McCaffrey, D. F., Hamre, B. K., Pianta, R. C., Qi, Y. (2012). An argument approach to observation protocol validity. Educational Assessment, 17, 62–87. doi:10.1080/10627197.2012.715014 Google Scholar | Crossref | |
|
Bellini, S., Peters, J. K., Benner, L., Hopf, A. (2007). A meta-analysis of school-based social skills interventions for children with autism spectrum disorders. Remedial and Special Education, 28, 153–162. Google Scholar | SAGE Journals | ISI | |
|
Berkeley, S., Scruggs, T. E., Mastropieri, M. A. (2009). Reading comprehension instruction for students with learning disabilities, 1995-2006: A meta-analysis. Remedial and Special Education, 31, 423–436. doi:10.1177/0741932509355988 Google Scholar | SAGE Journals | ISI | |
|
Betebenner, D. (2009). Norm- and criterion-referenced student growth. Educational Measurment: Issues and Practices, 28(4), 42–51. doi:10.1111/j.1745-3992.2009.00161.x Google Scholar | Crossref | |
|
Billingsley, B. S. (2004). Special education teacher retention and attrition: A critical analysis of the research literature. The Journal of Special Education, 38, 39–55. doi:10.1177/00224669040380010401 Google Scholar | SAGE Journals | ISI | |
|
Boe, E. E., Cook, L. H., Sunderland, R. J. (2008). Teacher turnover: Examining exit attrition, teaching area transfer, and school migration. Exceptional Children, 75(I), 7–31. Google Scholar | SAGE Journals | |
|
Burns, M. K., Ysseldyke, J. E. (2008). Reported prevalence of evidence-based instructional practices in special education. The Journal of Special Education, 43, 3–11. doi:10.1177/0022466908315563 Google Scholar | SAGE Journals | ISI | |
|
Buzick, H. M., Laitusis, C. C. (2010). Using growth for accountability: Measurement challenges for students with disabilities and recommendations for research. Educational Researcher, 39, 537–544. doi:10.3102/0013189X10383560 Google Scholar | SAGE Journals | ISI | |
|
Coggshall, J. G., Bivona, L., Reschly, D. J. (2012). Evaluating the effectiveness of teacher preparation programs for support and accountability. Washington, DC. Retrieved from http://www.gtlcenter.org/sites/default/files/docs/TQ_RandP_BriefEvaluatingEffectiveness.pdf Google Scholar | |
|
Connelly, V., Graham, S. (2009). Student teaching and teacher attrition in special education. Teacher Education and Special Education, 32, 257–269. doi:10.1177/0888406409339472 Google Scholar | SAGE Journals | |
|
Cook, B. G., Tankersley, M., Landrum, T. J. (2009). Determining evidence-based practices in special education. Exceptional Children, 75, 365–383. Google Scholar | SAGE Journals | ISI | |
|
Council for Exceptional Children . (2012). The council for exceptional children’s position on special education teacher evaluation. Arlington, VA. Retrieved from http://cec.metapress.com/content/022w828643484g12/ Google Scholar | |
|
Danielson, C. (2007). Enhancing professional practice: A framework for teaching. Alexandria, VA: Association for Supervision and Curriculum Development. Google Scholar | |
|
Darling-Hammond, L. (2010). Evaluating teacher effectiveness: How teacher performance assessments can measure and improve teaching. Retrieved from http://www.americanprogress.org/issues/education/report/2010/10/19/8502/evaluating-teacher-effectiveness/ Google Scholar | |
|
Dexter, D. D., Park, Y. J., Hughes, C. A. (2011). A meta-analytic review of graphic organizers and science instruction for adolescents with learning disabilities: Implications for the intermediate and secondary science classroom. Learning Disabilities Research & Practice, 26, 204–213. doi:10.1111/j.1540-5826.2011.00341.x Google Scholar | Crossref | ISI | |
|
Duffy, G. G., Roehler, L. R., Meloth, M. S., Vavrus, L. G., Book, C., Putnam, J., Wesselman, R. (1986). The relationship between explicit verbal explanations during reading skill instruction and student awareness and achievement: A study of reading teacher effects. Reading Research Quarterly, 21, 237–252. Google Scholar | Crossref | ISI | |
|
Engelmann, S., Colvin, G. (2006). Rubric for identifying authentic Direct Instruction programs. Eugene, OR: Engelmann Foundation. Google Scholar | |
|
Feng, L., Sass, T. R. (2010). What makes special education teachers special? Teacher training and achievement of students with disabilities. Retrieved from http://www.urban.org/publications/1001435.html Google Scholar | |
|
Gersten, R., Chard, D. J., Jayanthi, M., Baker, S. K., Murphy, P., Flojo, J. (2009). Mathematics instruction for students with learning disabilities: A meta-analysis of instructional components. Review of Educational Research, 79, 1202–1242. Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Keating, T., Yovanoff, P., Harniss, M. K. (2001). Working in special education: Factors that enhance special educators’ intent to stay. Exceptional Children, 67, 549–567. Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Lynn, L. S., Williams, J. P., Baker, S. K. (2001). Teaching reading comprehension strategies to students with learning disabilities: A review of research. Review of Educational Research, 71, 279–320. Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Vaughn, S., Deshler, D., Schiller, E. (1997). What we know about using research findings: Implications for improving special education practice. Journal of Learning Disabilities, 30, 466–476. Retrieved from http://www.ncbi.nlm.nih.gov/pubmed/9293227 Google Scholar | |
|
Gersten, R., Woodward, J., Darch, C. (1986). Direct instruction: A research-based approach to curriculum design and teaching. Exceptional Children, 53, 17–31. Google Scholar | SAGE Journals | |
|
Goe, L., Croft, A. (2009). Methods of evaluating teacher effectiveness. Retrieved from http://www.gtlcenter.org/sites/default/files/docs/RestoPractice_EvaluatingTeacherEffectiveness.pdf Google Scholar | |
|
Goe, L., Holdheide, L. (2011). Measuring teachers’ contributions to student learning growth for nontested grades and subjects. Retrieved from http://www.tqsource.org/publications/MeasuringTeachersContributions.pdf Google Scholar | |
|
Gordon, R., Kane, T. J., Staiger, D. O. (2006). Identifying effective teachers using performance on the job. Retrieved from http://www.brookings.edu/research/papers/2006/04/education-gordon Google Scholar | |
|
Harry, B., Klingner, J. K. (2006). Why are so many minority students in special education?: Understanding race & disability in schools. New York, NY: Teachers College Press. Google Scholar | |
|
Hill, H. C., Blunk, M. L., Charalambous, C. Y., Lewis, J. M., Phelps, G. C., Sleep, L., Ball, D. L. (2008). Mathematical knowledge for teaching and the mathematical quality of instruction: An exploratory study. Cognition and Instruction, 26, 430–511. doi:10.1080/07370000802177235 Google Scholar | Crossref | ISI | |
|
Hill, H. C., Charalambous, C. Y., Blazar, D., McGinn, D., Kraft, M. A., Beisiegel, M., . . . Lynch, K. (2012). Validating arguments for observational instruments: Attending to multiple sources of variation. Educational Assessment, 17, 88–106. doi:10.1080/10627197.2012.715019 Google Scholar | Crossref | |
|
Ho, A. D., Kane, T. J. (2013). The reliability of classroom observations by school personnel. Retrieved from http://www.metproject.org/downloads/MET_ReliabilityofClassroomObservations_ResearchPaper.pdf Google Scholar | |
|
Holdheide, L. (2012, July). State considerations in designing and implementing evaluation systems that include teachers of students with disabilities. Office of Special Education Programs Project Director’s Conference, Washington, DC. Google Scholar | |
|
Holdheide, L., Browder, D., Warren, S., Buzick, H., Jones, N. (2012). Summary of “using student growth to evaluate educators of students with disabilities: Issues, challenges, and next steps.” Retrieved from http://www.gtlcenter.org/sites/default/files/docs/TQ_Forum_SummaryUsing_Student_Growth.pdf Google Scholar | |
|
Holdheide, L., Goe, L., Croft, A., Reschly, D. J. (2010). Challenges in evaluating special education teachers and English language learner specialists. Retrieved from http://nwcc.educationnorthwest.org/resource/801 Google Scholar | |
|
Johnson, E. S., Semmelroth, C. L. (2012). Examining interrater agreement analyses of a pilot special education observation tool. Journal of Special Education Apprenticeship, 1(4), Article 9. Google Scholar | |
|
Jones, N. D., Buzick, H. M., Turkan, S. (2013). Including students with disabilities and English Learners in measures of educator effectiveness. Educational Researcher, 42, 234–241. doi:10.3102/0013189X12468211 Google Scholar | SAGE Journals | ISI | |
|
Kane, T. J., Cantrell, S. (2013). Ensuring fair and reliable measures of effective teaching: Culminating findings from the MET project’s three-year study. Retrieved from http://www.metproject.org/downloads/MET_Ensuring_Fair_and_Reliable_Measures_Practitioner_Brief.pdf Google Scholar | |
|
Kane, T. J., Staiger, D. O. (2012). Gathering feedback for teaching: Combining high-quality observations with student surveys and achievement gains. Retrieved from http://www.metproject.org/downloads/MET_Gathering_Feedback_Research_Paper.pdf Google Scholar | |
|
Karvonen, M., Wakeman, S., Moody, S., Flowers, C. (2012, September). Building blocks: Cross-grade progressions in alternate assessments based on alternate achievement standards (AA-AAS). Presented at National Council on Measurement in Education, Vancouver, British Columbia, Canada. Google Scholar | |
|
Littrell, P. C., Billingsley, B. S., Cross, L. H. (1994). The effects of principal support on special and general educators’ stress, job satisfaction, school commitment, health, and intent to stay in teaching. Remedial and Special Education, 15, 297–310. Google Scholar | SAGE Journals | ISI | |
|
Martineau, J. A. (2006). Distorting value added: The use of longitudinal, vertically scaled student achievement data for growth-based, value-added accountability. Journal of Educational and Behavioral Statistics, 31, 35–62. Google Scholar | SAGE Journals | ISI | |
|
McLeskey, J., Billingsley, B. S. (2008). How does the quality and stability of the teaching force influence the research-to-practice gap? A perspective on the teacher shortage in special education. Remedial and Special Education, 29, 293–305. doi:10.1177/0741932507312010 Google Scholar | SAGE Journals | ISI | |
|
McLeskey, J., Tyler, N. C., Flippin, S. S. (2004). The supply of and demand for special education teachers: A review of research regarding the chronic shortage of special education teachers. The Journal of Special Education, 38, 5–21. Google Scholar | SAGE Journals | ISI | |
|
Meyer, J. P., Cash, A. H., Mashburn, A. (2011). Occasions and the reliability of classroom observations: Alternative conceptualizations and methods of analysis. Educational Assessment, 16, 227–243. doi:10.1080/10627197.2011.638884 Google Scholar | Crossref | |
|
Mislevy, R. J., Haertel, G. D. (2006). Implications of evidence-centered design for educational testing. Educational Measurement: Issues and Practices, 25(4), 6–20. Google Scholar | Crossref | |
|
Mislevy, R. J., Steinberg, L. S., Almond, R. G. (2003). On the structure of educational assessments. Measurement: Interdisciplinary Research and Perspectives, 1, 3–62. Google Scholar | Crossref | |
|
Morgan, P. L., Frisco, M. L., Farkas, G., Hibel, J. (2008). A propensity score matching analysis of the effects of special education services. The Journal of Special Education, 43, 236–254. doi:10.1177/0022466908323007 Google Scholar | SAGE Journals | ISI | |
|
National Autism Center . (2009). National standards report. Randolph, MA. Retrieved from http://www.nationalautismcenter.org/nsp/reports.php Google Scholar | |
|
Newman, L., Wagner, M., Knokey, A.-M., Marder, C., Nagle, K., Shaver, D., . . . Schwarting, M. (2011). The post-high school outcomes of young adults with disabilities up to 8 years after high school (A report from the National Longitudinal Transition Study-2 [NLTS2], NCSER 2011-3005, Vol. 2). Menlo Park, CA: Sri International. Retrieved from www.nlts2.org/reports/ Google Scholar | |
|
Odom, S. L. (2009). The tie that binds: Evidence-based practice, implementation science, and outcomes for children. Topics in Early Childhood Special Education, 29, 53–61. Google Scholar | SAGE Journals | ISI | |
|
Odom, S. L., Brantlinger, E., Gersten, R., Horner, R. H., Thompson, B., Harris, K. R. (2005). Research in special education: Scientific methods and evidence-based practices. Exceptional Children, 71, 137–148. Google Scholar | SAGE Journals | ISI | |
|
Odom, S. L., Collet-Klingenberg, L., Rogers, S. J., Hatton, D. D. (2010). Evidence-based practices in interventions for children and youth with Autism Spectrum Disorders. Preventing School Failure: Alternative Education for Children and Youth, 54, 275–282. doi:10.1080/10459881003785506 Google Scholar | Crossref | |
|
Parker, R. I., Vannest, K. J., Davis, J. L. (2011). Effect size in single-case research: A review of nine nonoverlap techniques. Behavior Modification, 35, 303–322. doi:10.1177/0145445511399147 Google Scholar | SAGE Journals | ISI | |
|
Rockoff, J. E., Speroni, C. (2010). Subjective and objective evaluations of teacher effectiveness. American Economic Review, 100(2), 261–266. Google Scholar | Crossref | ISI | |
|
Rosenshine, B., Meister, C., Chapman, S. (1996). Teaching students to generate questions: A review of the intervention studies. Review of Educational Research, 66, 181–221. Google Scholar | SAGE Journals | ISI | |
|
Rothstein, J. (2010). Teacher quality in educational production: Tracking, decay, and student achievement. Quarterly Journal of Economics, 125, 175–214. Google Scholar | Crossref | ISI | |
|
Russ, S., Chiang, B., Rylance, B. J., Bongers, J. (2001). Caseload in special education: An integration of research findings. Exceptional Children, 67, 161–172. Google Scholar | SAGE Journals | |
|
Semmelroth, C. L., Johnson, E. S., Allred, K. (2013). Special educator evaluation: Cautions, concerns and considerations. Journal of the American Academy of Special Education Professionals. Retrieved from http://www.naset.org/3852.0.html Google Scholar | |
|
Simmons, D. C., Fuchs, L. S., Fuchs, D., Mathes, P., Pate, J. H. (1995). Effects of explicit teaching and peer tutoring on the reading achievement of learning-disabled and low-performing students in regular classrooms. The Elementary School Journal, 95, 387–408. Google Scholar | Crossref | ISI | |
|
Sindelar, P. T., Brownell, M. T., Billingsley, B. (2010). Special education teacher education research: Current status and future directions. Teacher Education and Special Education, 33, 8–24. doi:10.1177/0888406409358593 Google Scholar | SAGE Journals | |
|
Smolkowski, K., Gunn, B. (2012). Reliability and validity of the Classroom Observations of Student–Teacher Interactions (COSTI) for kindergarten reading instruction. Early Childhood Research Quarterly, 27, 316–328. doi:10.1016/j.ecresq.2011.09.004 Google Scholar | Crossref | ISI | |
|
Sprague, J. R., Horner, R. H. (1984). The effects of single instance, multiple instance, and general case training on generalized vending machine use by moderatley and severely handicapped students. Journal of Applied Behavior Analysis, 17, 273–278. Google Scholar | Crossref | Medline | ISI | |
|
Stempien, L. R., Loeb, R. C. (2002). Differences in job satisfaction between general education and special education teachers: Implications for retention. Remedial and Special Education, 23, 258–267. doi:10.1177/07419325020230050101 Google Scholar | SAGE Journals | ISI | |
|
Swanson, H. L., Sachse-Lee, C. (2000). A meta-analysis of single-subject-design intervention research for students with LD. Journal of Learning Disabilities, 33, 114–136. Google Scholar | SAGE Journals | ISI | |
|
Tyler, N. C., Yzquierdo, Z., Lopez-Reyna, N., Flippin, S. S. (2004). Cultural and linguistic diversity and the special education workforce: A critical overview. The Journal of Special Education, 38, 22–38. Google Scholar | SAGE Journals | ISI | |
|
U.S. Department of Education . (2011). The nation’s report card. Retrieved from http://nces.ed.gov/nationsreportcard/ Google Scholar | |
|
Vannest, K. J., Hagan-Burke, S. (2009). Teacher time use in special education. Remedial and Special Education, 31, 126–142. doi:10.1177/0741932508327459 Google Scholar | SAGE Journals | ISI | |
|
Vaughn, S., Dammann, J. E. (2001). Science and sanity in special education. Behavioral Disorders, 27, 21–29. Google Scholar | SAGE Journals | ISI | |
|
Vaughn, S., Linah-Thompson, S., Hickman, P. (2003). Response to instruction as a means of identifying students with reading/learning disabilities. Exceptional Children, 69, 391–409. Google Scholar | SAGE Journals | ISI | |
|
Xin, Y. P., Jitendra, A. K., Deatline-Buchman, A. (2005). Effects of mathematical word problem-solving instruction on middle school students with learning problems. The Journal of Special Education, 39, 181–192. Google Scholar | SAGE Journals | ISI |
