Abstract
Treatment integrity data are essential to drawing valid conclusions in treatment outcome studies. Such data, however, are not always included in peer-reviewed research articles in school psychology or related fields. To gain a better understanding of why treatment integrity data are lacking in the school psychology research, we surveyed the authors of the 210 treatment outcome articles published in four school psychology journals from 1995 through 2008 regarding their perceptions of barriers to implementing treatment integrity procedures. Results indicated that (a) lack of theory and specific guidelines on treatment integrity procedures; (b) lack of general knowledge about treatment integrity; (c) time, cost, and labor demands; and (d) lack of editorial requirement were broadly perceived as barriers by school psychology researchers to implementing treatment integrity procedures. Implications for future research are discussed.
|
Cochrane, W. S., Laux, J. M. (2008). A survey investigating school psychologists’ measurement of treatment integrity in school-based interventions and their beliefs about its importance. Psychology in the Schools, 45, 499–507. Google Scholar | Crossref | ISI | |
|
Costenbader, V., Swartz, J., Petrix, L. (1992). Consultation in the schools: The relationship between preservice training, perception of consultative skills, and actual time spent in consultation. School Psychology Review, 21, 95–108. Google Scholar | ISI | |
|
Dane, A. V., Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. Google Scholar | Crossref | Medline | ISI | |
|
DiGennaro, F. D., Martens, B. K, Kleinmann, A. E. (2007). A comparison of performance feedback procedures on teachers’ treatment implementation integrity and students’ inappropriate behavior in special education classrooms. Journal of Applied Behavior Analysis, 40, 447–461. Google Scholar | Crossref | Medline | ISI | |
|
DiGennaro, F. D., Martens, B. K., McIntyre, L. L. (2005). Increasing treatment integrity through negative reinforcement: Effects on teacher and student behavior. School Psychology Review, 34, 220–231. Google Scholar | ISI | |
|
DiGennaro Reed, F. D., Reed, D. D., Baez, C., Maguire, H. (2011). A parametric analysis of errors of commission during discrete trial teaching. Journal of Applied Behavior Analysis, 44, 611–615. Google Scholar | Crossref | Medline | ISI | |
|
Gresham, F. M. (1989). Assessment of treatment integrity in school consultation and prereferral intervention. School Psychology Review, 18, 37–50. Google Scholar | ISI | |
|
Gresham, F. M. (1997). Treatment integrity in single-subject research. In Franklin, R. D., Allison, D. B., Gorman, B. S. (Eds.), Design and analysis of single-case research. Mahwah, NJ: Erlbaum. Google Scholar | |
|
Gresham, F. M., Gansle, K., Noell, G. H. (1993). Treatment integrity in applied behavior analysis with children. Journal of Applied Behavior Analysis, 26, 257–263. Google Scholar | Crossref | Medline | ISI | |
|
Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S. (1993). Treatment integrity of school-based behavioral intervention studies: 1980-1990. School Psychology Review, 22, 254–272. Google Scholar | ISI | |
|
Gwinner, C. (n.d.). 5-point versus 6-point likert scales (Infosurv white paper). Retrieved from Infosurv website: http://www.infosurv.com/resourcecenter/white-papers/ Google Scholar | |
|
Hirschstein, M. K., Edstrom, L. V., Frey, K. S., Snell, J. L., MacKenzie, E. P. (2007). Walking the talk in bully prevention: Teacher implementation variable related to initial impact of the Steps to Respect program. School Psychology Review, 36, 3–21. Google Scholar | ISI | |
|
Jones, H. A., Clarke, A. T., Power, T. J. (2008). Expanding the concept of intervention integrity: A multidimensional model of participant engagement. In Balance, 23, 4–5. Google Scholar | |
|
McIntyre, L. L., Gresham, F. M., DiGennaro, F. D., Reed, D. D. (2007). Treatment integrity of school-based interventions with children in the Journal of Applied Behavior Analysis 1991-2005. Journal of Applied Behavior Analysis, 40, 659–672. Google Scholar | Crossref | Medline | ISI | |
|
Moncher, F. J., Prinz, R. J. (1991). Treatment fidelity in outcome studies. Clinical Psychology Review, 11, 247–266. Google Scholar | Crossref | ISI | |
|
Noell, G. H. (2008). Research examining the relationships among consultation process, treatment integrity, and outcomes. In Erchul, W. P., Sheridan, S. M. (Eds.), Handbook of research in school consultation: Empirical foundations for the field (pp. 315–334). Mahwah, NJ: Erlbaum. Google Scholar | |
|
Noell, G. H., Gansle, K. A. (2006). Assuring the form has substance: Treatment plan implementation as the foundation of assessing response to intervention. Assessment for Effective Intervention, 32, 32–39. Google Scholar | SAGE Journals | |
|
Noell, G. H., Gresham, F. M., Gansle, K. A. (2002). Does treatment integrity matter? A preliminary investigation of instructional implementation and mathematics performance. Journal of Behavioral Education, 11, 51–67. Google Scholar | Crossref | |
|
O’Donnell, C. L. (2008). Defining, conceptualizing, and measuring fidelity of implementation and its relationship to outcomes in K-12 curriculum intervention research. Review of Educational Research, 78, 33–84. Google Scholar | SAGE Journals | ISI | |
|
Perepletchikova, F., Hilt, L. M., Chereji, E., Kazdin, A. E. (2009). Barriers to implementing treatment integrity procedures: Survey of treatment outcome researchers. Journal of Consulting and Clinical Psychology, 77, 212–218. Google Scholar | Crossref | Medline | ISI | |
|
Peterson, L., Homer, A., Wonderlich, S. (1982). The integrity of independent variables in behavior analysis. Journal of Applied Behavior Analysis, 15, 477–492. Google Scholar | Crossref | Medline | ISI | |
|
Power, T. J., Blom-Hoffman, J., Clarke, A. T., Riley-Tillman, T. C., Kellerher, C., Manz, P. (2005). Reconceptualizing intervention integrity: A partner-based framework for linking research with practice. Psychology in the Schools, 42, 495–507. Google Scholar | Crossref | ISI | |
|
Resnick, B., Bellg, A. J., DeFrancesco, C., Breger, R., Hecht, J., Sharp, D. L., . . . Czajkowski, S. (2005). Examples of implementation and evaluation of treatment fidelity in the BCC studies: Where we are and where we need to go. Annals of Behavioral Medicine, 29, 46–54. Google Scholar | Crossref | Medline | ISI | |
|
Sanetti, L. M. H., Gritter, K. L., Dobey, L. (2011). Treatment integrity of interventions with children in the school psychology literature from 1995 to 2008. School Psychology Review, 40, 72–84. Google Scholar | ISI | |
|
Sanetti, L. M. H., Kratochwill, T. R. (2008). Treatment integrity in behavioral consultation: Measurement, promotion, and outcomes. International Journal of Behavioral Consultation and Therapy, 4, 95–114. Google Scholar | Crossref | |
|
Sanetti, L. M. H., Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445–459. Google Scholar | ISI | |
|
Shadish, W. R., Cook, T. D., Campbell, D. T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. Google Scholar | |
|
St. Peter Pipkin, C., Vollmer, T. R., Sloman, K. N. (2010). Effects of treatment integrity failures during differential reinforcement of alternative behavior: A translational model. Journal of Applied Behavior Analysis, 43, 47–70. Google Scholar | Crossref | Medline | ISI | |
|
Waltz, J., Addis, M. E., Koerner, K., Jacobson, N. S. (1993). Testing the integrity of a psychotherapy protocol: Assessment of adherence and competence. Journal of Consulting and Clinical Psychology, 61, 620–630. Google Scholar | Crossref | Medline | ISI | |
|
Wilder, D. A., Atwell, J., Wine, B. (2006). The effects of varying levels of treatment integrity on child compliance during treatment with a three-step prompting procedure. Journal of Applied Behavior Analysis, 39, 369–373. Google Scholar | Crossref | Medline | ISI | |
|
Yeaton, W. H., Sechrest, L. (1981). Critical dimensions in the choice and maintenance of successful treatments: Strength, integrity, and effectiveness. Journal of Consulting and Clinical Psychology, 49, 156–167. Google Scholar | Crossref | Medline | ISI |

