![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Few studies have examined Response to Intervention (RTI) implementation adherence at the school level. Although tools designed to assess the implementation of RTI exist, the technical properties have not been rigorously documented, and psychometric techniques now being used to develop instrumentation appear not to have been used. The purpose of this preliminary study was to address this gap by developing the RTI Implementation Scale for Reading (RTIS-R). The instrument was developed based on theory, and items were refined based on data from expert reviews and cognitive interviews. Data were collected from 53 principals and school psychologists implementing RTI in 33 schools in a Midwestern state. Rasch analysis was used to examine and refine the instrument; it also facilitated the computation of equal interval item measures and person measures. Results suggest that the instrument is rigorous and has strong reliability. Interesting trends in responses emerged, which reveal an ordering of item difficulty that matches that predicted from theory. Implications of these findings for research and practice are discussed.
Keywords RTI, reading, implementation, Rasch analysis, tiers
References
Section:
|
Alonzo, J., Tindal, G., Robinson, Q. (2008). Using schoolwide response to intervention to close the achievement gap in reading. ERS Spectrum, 26, 1–9. Google Scholar | |
|
Batsche, G., Elliott, J., Graden, J. L., Grimes, J., Kovaleski, J. F., Prasse, D., . . . Tilly, D. W. (2006). Response to intervention: Policy considerations and implementation. Alexandria, VA: National Association of State Directors of Special Education. Google Scholar | |
|
Beatty, P. C., Willis, G. B. (2007). Research synthesis: The practice of cognitive interviewing. Public Opinion Quarterly, 71, 287–311. doi:10.1093/poq/nfm006 Google Scholar | Crossref | ISI | |
|
Bender, W. N. (2009). Beyond the RTI pyramid: Solutions for the first years of implementation. Bloomington, IN: Solution Tree Press. Google Scholar | |
|
Bender, W. N., Shores, C. (2007). Response to intervention: A practical guide for every teacher. Thousand Oaks, CA: Corwin Press. Google Scholar | |
|
Benner, G. J., Nelson, J. R., Stage, S. A., Ralston, N. C. (2011). The influence of fidelity of implementation on the reading outcomes of middle school students experiencing reading difficulties. Remedial and Special Education, 32, 79–88. doi:10.1177/0741932510361265 Google Scholar | Crossref | ISI | |
|
Berkel, C., Mauricio, A. M., Schoenfelder, E., Sandler, I. N. (2011). Putting the pieces together: An integrated model of program implementation. Prevention Science, 12, 23–33. doi:10.1007/s11121-010-0186-1 Google Scholar | Crossref | Medline | ISI | |
|
Berkeley, S., Bender, W. N., Peaster, L. G., Saunders, L. (2009). Implementation of response to intervention: A snapshot of progress. Journal of Learning Disabilities, 42, 85–95. doi:10.1177/0022219408326214 Google Scholar | SAGE Journals | ISI | |
|
Bollman, K. A., Silberglitt, B., Gibbons, K. A. (2007). The St. Croix River Education District model: Incorporating systems-level organization and a multi-tiered problems-solving process for intervention delivery. In Jimerson, S. R., Burns, M. K., VanDerHeyden, A. (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 319–330). New York, NY: Springer Science + Business Media. Google Scholar | Crossref | |
|
Bond, T. G., Fox, C. M. (2009). Applying the Rasch model: Fundamental measurement in the human sciences (2nd ed.). New York, NY: Routledge. Google Scholar | |
|
Boone, W. J., Staver, J. R., Yale, M. S. (2014). Rasch analysis in the human sciences. Berlin, Germany: Springer. Google Scholar | Crossref | |
|
Bradley, M. C., Daley, T., Levin, M., O’Reilly, R., Parsad, A., Robertson, A., Werner, A. (2011). IDEA National Assessment Implementation Study (NCEE 2011-4027). Washington, DC: National Center for Education Evaluation and Regional Assistance, Institute of Education Sciences, U.S. Department of Education. Google Scholar | |
|
Brown-Chidsey, R., Bronaugh, L., McGraw, K. (2009). RTI in the classroom: Guidelines and recipes for success. New York, NY: Guilford Press. Google Scholar | |
|
Brown-Chidsey, R., Steege, M. W. (2005). Response to intervention: Principles and strategies for effective practice. New York, NY: Guilford Press. Google Scholar | |
|
Burns, M. K., Gibbons, K. A. (2008). Implementing response-to-intervention in elementary and secondary schools: Procedures to assure scientific-based practices. New York, NY: Routledge. Google Scholar | |
|
Bursuck, B., Blanks, B. (2010). Evidence based early reading practices within a response to intervention system. Psychology in the Schools, 47, 421–431. doi:10.1002/pits.20480 Google Scholar | Crossref | ISI | |
|
Callender, W. A. (2007). The Idaho results-based model: Implementing response to intervention statewide. In Jimerson, S. R., Burns, M. K., VanDerHeyden, A. (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 331–342). NewYork, NY: Springer Science + Business Media. Google Scholar | Crossref | |
|
Canter, A., Klotz, M. B., Cowan, K. (2009). Response to intervention: The future for secondary schools. Principal Leadership, 8(6), 12–15. Google Scholar | |
|
Cochrane, W. S., Laux, J. M. (2008). A survey investigating school psychologists’ measurement of treatment integrity in school-based interventions and their beliefs about its importance. Psychology in the Schools, 45, 499–507. doi:10.1002/pits.20319 Google Scholar | Crossref | ISI | |
|
Collins, C. (2003). Pre-testing survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229–238. Retrieved from http://www.springer.com/medicine/journal/11136 Google Scholar | |
|
Dane, A. V., Schneider, B. H. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. doi:10.1016/S0272-7358(97)00043-3 Google Scholar | Crossref | Medline | ISI | |
|
Dillman, D. A., Smyth, J. D., Christian, L. M. (2009). Mail and internet surveys: The tailored design method (3rd ed.). New York, NY: John Wiley. Google Scholar | |
|
Duncan, P. W., Bode, R., Lai, S. M., Perera, S. (2003). Rasch analysis of a new stroke-specific outcome scale: The stroke impact scale. Archives of Physical Medicine and Rehabilitation, 84, 950-963. Google Scholar | Crossref | Medline | ISI | |
|
Dykes, F. (2009). RTI implementation challenges for rural elementary principals. Southeastern Teacher Education Journal, 2(3), 31–40. Google Scholar | |
|
Fixsen, D. L., Naoom, S. F., Blasé, K. A., Friedman, R. M., Wallace, F. (2005). Implementation research: A synthesis of the literature. Tampa: University of South Florida. Google Scholar | |
|
Fuchs, L. S., Fuchs, D., Compton, D. L. (2010). Rethinking response to intervention at middle and high school. School Psychology Review, 39, 22–28. Google Scholar | ISI | |
|
Gansle, K. A., Noell, G. H. (2007). The fundamental role of intervention implementation in assessing response to intervention. In Jimerson, S. R., Burns, M. K., VanDerHeyden, A. (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 244–254). New York, NY: Springer Science + Business Media. Google Scholar | Crossref | |
|
Glover, T. A. (2010). Key RTI service delivery components: Considerations for research-informed practice. In Glover, T. A., Vaughn, S. (Eds.), The promise of response to intervention: Evaluating current science and practice (pp. 7–22). New York, NY: Guilford Press. Google Scholar | |
|
Gresham, F. M., Gansle, K. A., Noell, G. H., Cohen, S., Rosenblum, S. (1993). Treatment integrity of school-based behavioral intervention studies. School Psychology Review, 22, 254–272. Retrieved from http://www.nasponline.org/publications/spr/index-list.aspx Google Scholar | |
|
Hill, D. R., King, S. A., Lemons, C. J., Partanen, J. N. (2012). Fidelity of implementation and instructional alignment in response to intervention research. Learning Disabilities Research & Practice, 27, 116–124. Google Scholar | Crossref | ISI | |
|
Hoover, J. J., Baca, L., Wexler-Love, E., Saenz, L. (2008). National implementation of response to intervention: Research summary (Special Education Leadership and Quality Teacher Initiative). Boulder: BUENO Center-School of Education, University of Colorado. Retrieved from http://www.spannj.org/pti/NationalImplementationofRTI-ResearchSummary.pdf Google Scholar | |
|
Juel, C. (1988). Learning to read and write: A longitudinal study of 54 children from first through fourth grades. Journal of Educational Psychology, 80, 437–447. doi:10.1037//0022-0663.80.4.437. Google Scholar | Crossref | ISI | |
|
Justice, L. M., McGinty, A., Guo, Y., Moore, D. (2009). Implementation of responsiveness to intervention in early education settings. Seminars in Speech and Language, 30, 59–74. doi:10.1055/s-0029-1215715 Google Scholar | Crossref | Medline | |
|
Kame’enui, E. J., Simmons, D. C. (2003). Planning and Evaluation Tool for Effective Schoolwide Reading Programs–Revised (PET-R). Eugene, OR: Institute for the Development of Educational Achievement. Google Scholar | |
|
Kaufman, R. C., Ring, M. (2011). Pathways to leadership and professional development: Inspiring novice special educators. Teaching Exceptional Children, 43(5), 52–60. Google Scholar | SAGE Journals | |
|
Keller-Margulis, M. A. (2012). Fidelity of implementation framework: A critical need for response to intervention models. Psychology in the Schools, 49, 342–352. doi:10.1002/pits.21602 Google Scholar | Crossref | ISI | |
|
Kline, R. B. (2009). Becoming a behavioral science researcher: A guide to producing research that matters. New York, NY: Guilford Press. Google Scholar | |
|
Kovaleski, J. F. (2007). Response to intervention: Considerations for research and systems change. School Psychology Review, 36, 638–646. Retrieved from http://www.nasponline.org/publications/spr/index-list.aspx Google Scholar | |
|
Linacre, J. M. (1994). Sample size and item calibration [or person measure] stability. Retrieved from www.rasch.org/rmt/rmt74m.htm Google Scholar | |
|
Linacre, J. M. (2012). Winsteps manual 3.75.0. Beaverton, OR: Winsteps.com. Google Scholar | |
|
Linacre, J. M. (2013). Winsteps® Rasch measurement computer program. Beaverton, OR: Winsteps.com. Google Scholar | |
|
Linacre, J. M., Wright, B. D. (1994). Dichotomous infit and outfit mean-square fit statistics. Rasch Measurement Transactions, 8, 360. Google Scholar | |
|
Liu, X. (2010). Using and developing measurement instruments in science education: A Rasch modeling approach. Charlotte, NC: Information Age Publishing. Google Scholar | |
|
Lunz, M. E. (2010). Using the very useful Wright map. Retrieved from http://www.rasch.org/mra/mra-01-10.htm Google Scholar | |
|
Mellard, D. F., Johnson, G. (2008). RTI: A practitioner’s guide to implementing response to intervention. Thousand Oaks, CA: Corwin Press. Google Scholar | Crossref | |
|
Mellard, D. F., McKnight, M., Jordan, J. (2010). RTI tier structures and instructional intensity. Learning Disabilities Research & Practice, 25, 217–225. doi:10.1111/j.1540-5826.2010.00319.x Google Scholar | Crossref | |
|
National Association of State Directors of Special Education . (2008a). Response to intervention: Blueprints for implementation (District level). Alexandria, VA: Author. Available from http://www.nasdse.org/ Google Scholar | |
|
National Association of State Directors of Special Education . (2008b). Response to intervention: Blueprints for implementation (School building level). Alexandria, VA: Author. Available from http://www.nasdse.org/ Google Scholar | |
|
Power, T. J., Blom-Hoffman, J., Clarke, A. T., Riley-Tillman, T. C., Kelleher, C., Manz, P. H. (2005). Reconceptualizing intervention integrity: A partnership-based framework for linking research with practice. Psychology in the Schools, 42, 495–507. doi:10.1002/pits.20087 Google Scholar | Crossref | ISI | |
|
Rasch, G. (1960). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danmarks Paedagogiske Institut. Google Scholar | |
|
Shaywitz, S. E., Fletcher, J. M., Holahan, J. M., Shneider, A. E., Marchione, K. E., Stuebing, K. K., . . . Shaywitz, B. A. (1999). Persistence of dyslexia: The Connecticut Longitudinal Study at adolescence. Pediatrics, 104, 1351–1359. Google Scholar | Crossref | Medline | ISI | |
|
Smith, R. M. (1996). Polytomous mean-square fit statistics. Rasch Measurement Transactions, 10, 516–517. Google Scholar | |
|
Smith, R. M., Linacre, J. M., Smith, E. V. (2003). Guidelines for manuscripts. Journal of Applied Measurement, 4, 189–204. Google Scholar | |
|
Sugai, G., Lewis-Palmer, T., Todd, A., Horner, R. H. (2001). School-wide evaluation tool. Eugene, OR: Educational and Community Supports, University of Oregon. Google Scholar | |
|
Sullivan, A. L., Long, L. (2010). Examining the changing landscape of school psychology practice: A survey of school-based practitioners regarding response to intervention. Psychology in the Schools, 47, 1059–1070. doi:10.1002/pits Google Scholar | Crossref | ISI | |
|
U.S. Department of Education, Institute of Education Sciences, National Center for Education Statistics . (2011). National Assessment of Educational Progress (NAEP) grade 8 national results. Retrieved from http://nationsreportcard.gov/reading_2011/nat_g8.aspx?tab_id=tab2&subtab_id=Tab_1#chart Google Scholar | |
|
Wiersma, W. (2000). Research methods in education: An introduction (7th ed.). Boston, MA: Allyn & Bacon. Google Scholar | |
|
Wright, B. D., Linacre, J. M. (1994). Reasonable mean-square fit values. Rasch Measurement Transactions, 8(3), 370. Google Scholar | |
|
Wright, B. D., Masters, G. N. (1982). Rating scale analysis Rasch measurement. Chicago, IL: MESA Press. Google Scholar |
