![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
In an environment of accountability, the development of evidence-based practices is expected. To demonstrate that a practice is evidence based, quality indicators of rigorous methodology should be present including indications that teachers implementing an intervention have done so with fidelity to its design. Because evidence-based practices assume fidelity of implementation (FOI), failure to establish FOI limits the conclusions that can be drawn from any outcome evaluation. This study surveys the gifted education literature to ascertain the degree to which FOI has been assessed, reported, and tied to measured outcomes in curriculum intervention efficacy studies and outcome evaluations. Of the 11 curriculum intervention studies included in this survey, each addressed FOI. The nature and quality of the methods used, however, to measure FOI, as well as the degree to which fidelity data were reported, varied widely among these studies, which suggests the need for increased methodological rigor in gifted curriculum research.
References
Section:
|
Achinstein, B., Ogawa, R. T. (2006). (In)Fidelity: What resistance of new teachers reveals about professional principles and prescriptive educational policies. Harvard Educational Review, 76, 30-63. Google Scholar | Crossref | ISI | |
|
Aljughaiman, A. M., Ayoub, A. E. A. (2012). The effect of an enrichment program on developing analytical, creative, and practical abilities of elementary gifted students. Journal for the Education of the Gifted, 35, 153-174. doi:10.1177/0162353212440616 Google Scholar | SAGE Journals | |
|
Ambrose, D., VanTassel-Baska, J., Coleman, L. J., Cross, T. L. (2010). Unified, insular, firmly policed, or fractured, porous, contested, gifted education? Journal for the Education of the Gifted, 33, 453-478. doi:10.1177/016235321003300402 Google Scholar | SAGE Journals | |
|
Azano, A. P., Missett, T. C., Callahan, C. M., Oh, S., Foster, L. M., Moon, T. (2011). Exploring the relationship between fidelity of implementation and academic achievement in a third-grade gifted curriculum: A mixed-methods study. Journal of Advanced Academics, 22, 693-719. doi:10.1177/1932202X11424878 Google Scholar | SAGE Journals | |
|
Callahan, C. M., Moon, T. R. (2007). Sorting the wheat from the chaff: What makes for good evidence of effectiveness in the literature in gifted education? Gifted Child Quarterly, 51, 305-319. doi:10.1177/0016986207306317 Google Scholar | SAGE Journals | ISI | |
|
Carroll, C., Patterson, M., Wood, S., Booth, A., Rick, J., Balain, S. (2007). A conceptual framework for implementation fidelity. Implementation Science, 2(1), 2-40. doi:10.1186/1748-5908-2-40 Google Scholar | Crossref | Medline | ISI | |
|
Century, J., Rudnick, M., Freeman, C. (2010). A framework for measuring fidelity of implementation: A foundation for shared language and accumulation of knowledge. American Journal of Evaluation, 31, 199-218. doi:10.1177/1098214010366173 Google Scholar | SAGE Journals | ISI | |
|
Coleman, R. C., Gallagher, J. J., Job, J. (2012). Developing and sustaining professionalism within gifted education. Gifted Child Today, 35, 27-36. Google Scholar | SAGE Journals | |
|
Cook, B. G., Cook, S. C. (2011). Unraveling evidence-based practices in special education. Journal of Special Education, 47, 71-82. doi:10.1177/0022466911420877 Google Scholar | SAGE Journals | ISI | |
|
Cook, B. G., Tankersley, M., Landrum, T. J. (2009). Determining evidence-based practices in special education. Exceptional Children, 75, 365-383. doi: 10.1177/1053451208324504 Google Scholar | SAGE Journals | ISI | |
|
Dai, D. Y., Swanson, J. A., Cheng, J. (2011). State of research on giftedness and gifted education: A survey of empirical studies published during 1998-2010 (April). Gifted Child Quarterly, 55, 126-138. doi:10.1177/0016986210397831 Google Scholar | SAGE Journals | ISI | |
|
Feng, A. X., VanTassel-Baska, J., Quek, C., Bai, W., O’Neill, B. (2005). A longitudinal assessment of gifted students’ learning using the integrated curriculum model (ICM): Impacts and perceptions of the William and Mary language arts and science curriculum. Roeper Review, 27, 78-83. doi:10.1080/02783190509554294 Google Scholar | Crossref | |
|
Fogelman, J., McNeill, K. L., Krajcik, J. (2011). Examining the effect teachers’ adaptations of a middle school science inquiry-oriented curriculum unit on student learning. Journal of Research in Science Teaching, 48, 149-169. doi:10.1002/tea.20399 Google Scholar | Crossref | ISI | |
|
Foster, L. (2011). Fidelity: Snapshots of implementation of a curricular intervention (Doctoral dissertation) (ProQuest Document Identification No. 908430898). Retrieved from http://search.proquest.com//docview/908430898 Google Scholar | |
|
Gallagher, J. J. (2006). How to shoot oneself in the foot with program evaluation. Roeper Review, 28, 122-124. Google Scholar | Crossref | |
|
Gavin, M. K., Casa, T. M., Adelson, J. L., Carroll, S. R., Sheffield, L. J. (2009). Project M3: Mentoring mathematical minds—A research-based curriculum for talented elementary students. Gifted Child Quarterly, 53, 188-202. doi:10.1177/0016986209334964 Google Scholar | SAGE Journals | ISI | |
|
Gavin, M. K., Casa, T. M., Adelson, J. L., Carroll, S. R., Sheffield, L. J., Spinelli, A. M. (2007). Project M3: Mentoring mathematical minds—A research-based curriculum for talented elementary students. Journal of Advanced Academics, 18, 566-585. doi:10.4219/jaa-2007-552 Google Scholar | SAGE Journals | |
|
Gavin, M. K., Casa, T. M., Adelson, J. L., Firmender, J. M. (2013). The impact of challenging geometry and measurement units on the achievement of Grade 2 students. Journal for Research in Mathematics Education, 44, 478-509. Google Scholar | Crossref | ISI | |
|
Gavin, M. K., Casa, T. M., Firmender, J. M., Carroll, S. (2013). The impact of advanced geometry and measurement curriculum units on the mathematics achievement of first-grade students. Gifted Child Quarterly, 57, 71-84. doi:10.1177/0016986213479564 Google Scholar | SAGE Journals | ISI | |
|
Gentry, M., Peters, S. J. (2009). Effect sizes in gifted education research. Gifted Child Quarterly, 53, 219-222. doi:10.1177/0016986209334976 Google Scholar | SAGE Journals | ISI | |
|
Gersten, R., Fuchs, L. S., Compton, D., Coyne, M., Greenwood, C., Innocenti, M. S. (2005). Quality indicators for group experimental and quasi-experimental research in special education. Exceptional Children, 71, 149-164. Google Scholar | SAGE Journals | ISI | |
|
Hertberg-Davis, H. L., Callahan, C. M. (2013). Defensible curriculum for gifted students: An introduction. In Callahan, C. M., Hertberg-Davis, H. L. (Eds.), Fundamentals of gifted education: Considering multiple perspectives (pp. 259-262). New York, NY: Routledge. Google Scholar | |
|
Horner, R. H., Sugai, G., Anderson, C. M. (2010). Examining the evidence base for school-wide positive behavior support. Focus on Exceptional Children, 42, 1-13. Google Scholar | |
|
Jolly, J. L., Kettler, T. (2008). Gifted education research 1994-2003: A disconnect between priorities and practice. Journal for the Education of the Gifted, 31, 427-446. doi:1177/0162353212440610 Google Scholar | SAGE Journals | |
|
Keller-Margulis, M. A. (2012). Fidelity of implementation framework: A critical need for response to intervention models. Psychology in the Schools, 49, 342-352. doi:10.1002/pits.21602 Google Scholar | Crossref | ISI | |
|
Kim, K. H., VanTassel-Baska, J., Bracken, B. A., Feng, A., Stambaugh, T., Bland, L. (2012). Project Clarion: Three years of science instruction in title I schools among K-third grade students. Research in Science Education, 42, 813-829. doi:10.1007/s11165-011-9218-5 Google Scholar | Crossref | ISI | |
|
Klimis, J., VanTassel-Baska, J. (2013). Designing self-contained middle schools for the gifted: A journey in program development. Gifted Child Today, 36, 172-178. Google Scholar | SAGE Journals | |
|
Little, C. A., Feng, A. X., VanTassel-Baska, J., Rogers, K. B., Avery, L. D. (2007). A study of curriculum effectiveness in social studies. Gifted Child Quarterly, 51, 272-284. doi:10:1177/0016986207302722 Google Scholar | SAGE Journals | ISI | |
|
Makel, M. C., Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education science. Educational Researcher, 43, 304-316. doi:10.3102/0013189X14545513 Google Scholar | SAGE Journals | ISI | |
|
Matthews, M. S., Gentry, M., McCoach, D. B., Worrell, F. C., Matthews, D., Dixon, F. (2008). Evaluating the state of the field: Effect size reporting in gifted education. The Journal of Experimental Education, 77, 55-65. Google Scholar | Crossref | ISI | |
|
Mowbray, C. T., Holter, M. C., Teague, G. B., Bybee, D. (2003). Fidelity criteria: Development, measurement, and validation. American Journal of Education, 24, 315-340. Google Scholar | Abstract | |
|
Mofield, E. L., Chakraborti-Ghosh, S. (2010). Addressing multidimensional perfectionism in gifted adolescents with affective curriculum. Journal for the Education of the Gifted, 33, 479-513. doi:10.1177/016235321003300403 Google Scholar | SAGE Journals | |
|
O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research. Review of Educational Research, 78, 33-84. doi:10.3102/0034654307313793 Google Scholar | SAGE Journals | ISI | |
|
Reis, S. M., McCoach, D. B., Little, C. A., Muller, L. M., Kaniskan, R. B. (2011). The effects of differentiated instruction and enrichment pedagogy on reading achievement in five elementary schools. American Educational Research Journal, 48, 462-501. doi:10.3102/0002831210382891 Google Scholar | SAGE Journals | ISI | |
|
Slavin, R. E. (2002). Evidence-based education policies: Transforming educational practice and research. Educational Researcher, 31, 15-21. doi:10.3102/0013189X031007015 Google Scholar | SAGE Journals | |
|
U.S. Department of Education . (2003, December). Identifying and implementing educational practices supported by rigorous evidence: A user-friendly guide. Washington, DC: Institute of Education Sciences. Google Scholar | |
|
Valentine, J. C., Cooper, H. (2003). What Works Clearinghouse study design and implementation assessment device (Version 1.0). Washington, DC: U.S. Department of Education. Google Scholar | |
|
VanTassel-Baska, J. (2013). Matching curriculum, instruction and assessment. In Plucker, J. A., Callahan, C. M. (Eds.), Critical issues and practices in gifted education (pp. 377-385). Waco, TX: Prufrock Press. Google Scholar | |
|
VanTassel-Baska, J., Bracken, B., Feng, A., Brown, E. (2009). A longitudinal study of enhancing critical thinking and reading comprehension in title I classrooms. Journal for the Education of the Gifted, 33, 7-37. Google Scholar | SAGE Journals | |
|
VanTassel-Baska, J., Brown, E. F. (2007). Toward best practice: An analysis of the efficacy of curriculum models in gifted education. Gifted Child Quarterly, 51, 342-358. doi:10.1177/0016986207306323 Google Scholar | SAGE Journals | ISI | |
|
VanTassel-Baska, J., Robinson, N. M., Coleman, L. J., Shore, B. M., Subotnik, R. F. (2006). A report card on the state of research in the field of gifted education. Gifted Child Quarterly, 50, 339-355. Google Scholar | SAGE Journals | ISI | |
|
Walsh, R. L., Kemp, C. R., Hodge, K. A., Bowes, J. M. (2012). Searching for evidence-based practice: A review of the research on educational interventions for intellectually gifted children in the early childhood years. Journal for the Education of the Gifted, 35, 103-138. doi:10.1177/0162353212440610 Google Scholar | SAGE Journals | |
|
White, K., Fletcher-Campbell, F., Ridley, K. (2003). What works for gifted and talented pupils: A review of recent research. Slough, Berkshire: National Foundation for Educational Research. Google Scholar | |
|
White, T., Kim, J., Kingston, H., Foster, L. (2014). Replicating the effects of a teacher-scaffolded voluntary summer reading program: The role of poverty. Reading Research Quarterly, 49, 5-30. doi:10.1002/rrq.62 Google Scholar | Crossref | ISI |
