![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The Perceptions of RtI Skills Survey is a self-report measure that assesses educators’ perceptions of their data-based problem-solving skills—a critical element of many Response-to-Intervention (RtI) models. Confirmatory factor analysis (CFA) was used to evaluate the underlying factor structure of this tool. Educators from 68 (n = 2,397) and 60 (n = 1,961) schools in a southeastern state participated during the spring of 2008 and spring of 2010, respectively. Results supported a correlated three-factor model with the following dimensions: Perceptions of RtI Skills Applied to Academic Content, Perceptions of RtI Skills Applied to Behavior Content, and Perceptions of Data Display Skills. Internal consistency estimates for all factors exceeded .90. In addition, significant associations between factor scores and data-based problem-solving fidelity at Tiers I and II were found. Implications for educators facilitating RtI implementation are discussed.
Keywords professional development, program evaluation
References
Section:
|
Bandalos, D. L., Finney, S. J. (2010). Factor analysis: Exploratory and confirmatory. In Hancock, G. R., Mueller, R. O. (Eds.), The reviewer’s guide to quantitative methods in the social sciences (pp. 93–114). New York, NY: Routledge. Google Scholar | |
|
Baruch, Y., Holtom, B. C. (2008). Survey response rate levels and trends in organizational research. Human Relations, 61, 1139–1160. doi:10.1177/0018726708094863 Google Scholar | SAGE Journals | ISI | |
|
Batsche, G. M., Elliot, J., Graden, J. L., Grimes, J., Kovaleski, J. F., Prasse, D., . . . Tilly, W. D. (2005). Response to intervention: Policy considerations and implementation. Alexandria, VA: National Association of State Directors of Special Education. Google Scholar | |
|
Bentler, P. M., Chou, C. (1987). Practical issues in structural modeling. Social Methods & Research, 16, 78–117. Google Scholar | SAGE Journals | ISI | |
|
Bergan, J. R. (1970). A systems approach to psychological services. Psychology in the Schools, 8, 315–319. Google Scholar | Crossref | ISI | |
|
Bergan, J. R., Kratochwill, T. R. (1990). Behavioral consultation and therapy. New York, NY: Plenum. Google Scholar | |
|
Bergan, J. R., Tombari, M. L. (1976). Consultant skill and efficiency and the implementation and outcomes of consultation. Journal of School Psychology, 14, 3–14. Google Scholar | Crossref | ISI | |
|
Berkeley, S., Bender, W. N., Peaster, L. G., Saunders, L. (2009). Implementation of response to intervention: A snapshot of progress. Journal of Learning Disabilities, 42, 85–95. doi:10.1177/0022219408326214 Google Scholar | SAGE Journals | ISI | |
|
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press. Google Scholar | |
|
Brown-Chidsey, R., Steege, M. W. (2010). Response to intervention: Principles and strategies for effective practice (2nd ed.). New York, NY: Guilford Press. Google Scholar | |
|
Burns, M. K. (n.d.). Using technology to enhance RtI implementation. Retrieved from http://www.rtinetwork.org/getstarted/implement/using-technology-to-enhance-rti-implementation Google Scholar | |
|
Burns, M. K., Gibbons, K. (2012). Implementing response-to-intervention in elementary and secondary schools: Procedures to ensure scientific-based practices (2nd ed.). New York, NY: Routledge. Google Scholar | |
|
Caffarella, R. S. (1994). Planning programs for adult learners: A practical guide for educators, trainers, and staff developers. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Castillo, J. M., Batsche, G. M., Curtis, M. J., Stockslager, K., March, A., Minch, D. (2010). Problem Solving/Response to Intervention Project: Evaluation tool technical assistance manual. Tampa, FL: Florida Problem Solving/Response to Intervention Project, University of South Florida. Google Scholar | |
|
Castillo, J. M., Batsche, G. M., Curtis, M. J., Stockslager, K., March, A., Minch, D., Hines, C. (2012). Problem Solving/Response to Intervention evaluation tool technical assistance manual–revised. Tample, FL: Florida Problem Solving/Response to Intervention Project, University of South Florida. Google Scholar | |
|
Castillo, J. M., Hines, C. M., Batsche, G. M., Curtis, M. J. (2011). The Florida Problem Solving/Response to Intervention Project: Year 3 evaluation report. Florida Problem Solving/Response to Intervention Project, University of South Florida. Google Scholar | |
|
Cohen, J. (1988). Statistical power analysis for the behavioral sciences (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Crocker, L., Algina, J. (1986). Introduction to classical and modern test theory. New York, NY: Holt, Rinehart & Winston. Google Scholar | |
|
Danielson, L., Doolittle, J., Bradley, R. (2007). Professional development, capacity building, and research needs: Critical issues for response to intervention. School Psychology Review, 36, 632–637. Google Scholar | ISI | |
|
Dedrick, R. F., Greenbaum, P. E. (2011). Multilevel confirmatory factor analysis of a scale measuring interagency collaboration of children’s mental health agencies. Journal of Emotional and Behavioral Disorders, 19, 27–40. doi:10.1177/1063426610365879 Google Scholar | SAGE Journals | ISI | |
|
Denton, C. A. (2012). Response to Intervention for reading difficulties in the primary grades: Some answers and lingering questions. Journal of Learning Disabilities, 45, 232–243. doi:10.1177/0022219412442155 Google Scholar | SAGE Journals | ISI | |
|
Desimone, L. M. (2009). Improving impact studies of teachers’ professional development: Toward better conceptualizations and measures. Educational Researcher, 38, 181–199. doi:10.3102/0013189X08331140 Google Scholar | SAGE Journals | ISI | |
|
DeVellis, R. F. (2012). Scale development: Theory and applications. Thousand Oaks, CA: SAGE. Google Scholar | |
|
Fletcher, J. M., Vaughn, S. (2009). Response to Intervention: Preventing and remediating academic difficulties. Child Development Perspectives, 3, 30–37. doi:10.1111/j.1750-8606.2008.00072.x Google Scholar | Crossref | Medline | ISI | |
|
Florida’s Multi-Tiered System of Supports . (n.d.). MTSS implementation components: Ensuring common language and understanding. Retrieved from http://www.florida-rti.org/educatorResources/MTSS_Book_ImplComp_012612.pdf Google Scholar | |
|
Flugum, K. R., Reschly, D. J. (1994). Prereferral interventions: Quality indices and outcomes. Journal of School Psychology, 32, 1–14. doi:10.1016/0022-4405(94)90025-6 Google Scholar | Crossref | ISI | |
|
Freeman, R., Lohrmann, S., Irvin, L. K., Kincaid, D., Vossler, V., Ferro, J. (2009). Systems change and the complementary roles of in-service and preservice training in schoolwide positive behavior support. In Sailor, W., Dunlap, G., Sugai, G., Horner, R. (Eds.), Handbook of positive behavior supports (pp. 603–629). New York, NY: Springer. Google Scholar | Crossref | |
|
Fullan, M. (2010). All systems go: The change imperative for whole system reform. Thousand Oaks, CA: Corwin. Google Scholar | |
|
Glover, T. A., DiPerna, J. C. (2007). Service delivery for Response to Intervention: Core components and directions for future research. School Psychology Review, 36, 526–540. Google Scholar | ISI | |
|
Greenwood, C. R., Min Kim, J. (2012). Response to Intervention (RTI) services: An ecobehavioral perspective. Journal of Educational and Psychological Consultation, 22, 79–105. doi:10.1080/10474412.2011.649648 Google Scholar | Crossref | Medline | ISI | |
|
Gresham, F. M. (2004). Current status and future directions of school-based behavioral interventions. School Psychology Review, 33, 326–343. Google Scholar | ISI | |
|
Guskey, T. R. (2002). Does it make a difference? Evaluating professional development. Educational Leadership, 59(6), 45–51. Google Scholar | ISI | |
|
Gutkin, T. B., Curtis, M. J. (2009). School-based consultation: The science and practice of indirect service delivery. In Gutkin, T. B., Reynolds, C. R. (Eds.), The handbook of school psychology (4th ed., pp. 591–635). Hoboken, NJ: John Wiley. Google Scholar | |
|
Hall, G. E., Hord, S. M. (2015). Implementing change: Patterns, principles and potholes (4th ed.). Boston, MA: Pearson. Google Scholar | |
|
Haslam, M. B. (2010, January). Teacher professional development evaluation guide. Oxford, OH: National Skill Development Corporation. Google Scholar | |
|
Hauerwas, L. B., Brown, R., Scott, A. N. (2013). Specific learning disability and response to intervention: State-level guidance. Exceptional Children, 80, 101–120. doi:10.1177/001440291308000105 Google Scholar | SAGE Journals | ISI | |
|
Heath, B., Lakshmanan, A., Perlmutter, A., Davis, L. (2010). Measuring the impact of professional development on science teaching: A review of survey, observation, and interview protocols. International Journal of Research & Method in Education, 33, 3–20. doi:10.1080/17437270902947304 Google Scholar | Crossref | |
|
Hollenbeck, A. F. (2007). From IDEA to implementation: A discussion of foundational and future responsiveness-to-intervention research. Learning Disabilities Research & Practice, 22, 137–146. doi:10.1111/j.1540-5826.2007.00238.x Google Scholar | Crossref | |
|
Hord, S. M., Roussin, J. L. (2013). Implementing change through learning: Concerns-based concepts, tools, and strategies guiding change. Thousand Oaks, CA: Corwin. Google Scholar | Crossref | |
|
Hox, J. J., de Leeuw, E. D. (1994). A comparison of nonresponse in mail, telephone, and face to face surveys: Applying multilevel modeling to meta-analysis. Quality & Quantity, 28, 329–344. Google Scholar | Crossref | ISI | |
|
Hu, L., Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structure Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118 Google Scholar | Crossref | ISI | |
|
Illinois State Professional Development Grant . (n.d.). Problem solving method of decision making. Retrieved from http://www.illinoisrti.org/i-rti-network/for-educators/understanding-rti-mtss/problem-solving-process Google Scholar | |
|
Killion, J. (2008). Assessing impact: Evaluating staff development. Thousand Oaks, CA: Corwin. Google Scholar | |
|
Kratochwill, T. R., Volpiansky, P., Clements, M., Ball, C. (2007). Professional development in implementing and sustaining multitier prevention models: Implications for response to intervention. School Psychology Review, 36, 618–631. Google Scholar | ISI | |
|
Learning Forward . (2011). Standards for professional learning. Oxford, OH: Author. Google Scholar | |
|
Lodico, M. G., Spaulding, D. T., Voegtle, K. H. (2010). Methods in educational research: From theory to practice. San Francisco, CA: John Wiley. Google Scholar | |
|
Luke, D. A. (2004). Multilevel modeling. Thousand Oaks, CA: SAGE. Google Scholar | Crossref | |
|
Mayer, D. P. (1999). Measuring instructional practice: Can policymakers trust survey data? Educational Evaluation and Policy Analysis, 21, 29–45. doi:10.3102/01623737021001029 Google Scholar | SAGE Journals | ISI | |
|
Merriam, S. B., Simpson, E. L. (2000). A guide to research for educators and trainers of adults (2nd ed.). Malabar, FL: Krieger. Google Scholar | |
|
Muijs, D. (2006). Measuring teacher effectiveness: Some methodological reflections. Educational Research and Evaluation, 12, 53–74. doi:10.1080/13803610500392236 Google Scholar | Crossref | |
|
Muthén, L. K., Muthén, B. O. (1998–2012). Mplus user’s guide (7th ed.). Los Angeles, CA: Author. Google Scholar | |
|
Noell, G. H., Gansle, K. A. (2006). Assuring the form has substance: Treatment plan implementation as the foundation of assessing response to intervention. Assessment for Effective Instruction, 32, 32–39. doi:10.1177/15345084060320010501 Google Scholar | Crossref | |
|
Noell, G. H., Witt, J. C., Slider, N. J., Connell, J. E., Gatti, S. L., Williams, K. L., . . . Duhon, G. J. (2005). Treatment implementation following behavioral consultation in schools: A comparison of three follow-up strategies. School Psychology Review, 34, 87–106. Google Scholar | ISI | |
|
O’Connor, E. P., Freeman, E. W. (2012). District-level considerations in supporting and sustaining RtI implementation. Psychology in the Schools, 49, 297–310. doi:10.1002/pits.21598 Google Scholar | Crossref | ISI | |
|
Pennsylvania Training and Technical Assistance Network . (2010). Multi-tiered system of supports (MTSS-RtII). Retrieved from http://www.pattan.net/category/Educational%20Initiatives/Multi-Tiered%20Systems%20of%20Support%20%28MTSS-RtII%29 Google Scholar | |
|
Pluymert, K. (2014). Problem-solving foundations for school psychological services. In Harrison, P. L., Thomas, A. (Eds.), Best practices in school psychology: Data-based and collaborative decision making (pp. 25–40). Bethesda, MD: National Association of School Psychologists. Google Scholar | |
|
Riley-Tillman, T. C., Burns, M. K., Gibbons, K. (2012). RTI applications, Vol. 2: Assessment, analysis, and decision-making. New York, NY: Guilford Press. Google Scholar | |
|
Roach, A. T., Lawton, K., Elliott, S. N. (2014). Best practices in facilitating and evaluating the integrity of school-based interventions. In Harrison, P. L., Thomas, A. (Eds.), Best practices in school psychology: Data-based and collaborative decision making (pp. 133–146). Bethesda, MD: National Association of School Psychologists. Google Scholar | |
|
Ross, J. A., McDougall, D., Hogaboam-Gray, A., LeSage, A. (2003). A survey measuring elementary teachers’ implementation of standards-based mathematics teaching. Journal for Research in Mathematics Education, 34, 344–363. doi:10.2307/30034787 Google Scholar | Crossref | ISI | |
|
Sailor, W., Dunlap, G., Sugai, G., Horner, R. (2009). Handbook of positive behavior support. New York, NY: Springer. Google Scholar | Crossref | |
|
Sanetti, L. M., Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445–459. Google Scholar | ISI | |
|
Sansosti, F. J., Noltemeyer, A., Goss, S. (2010). Principals’ perceptions of the importance and availability of Response to Intervention practices within high school settings. School Psychology Review, 39, 286–295. Google Scholar | ISI | |
|
Schwartz, G. T. (1978). Estimating the dimensions of a model. Annals of Statistics, 6, 461–464. Google Scholar | Crossref | ISI | |
|
Snyder, P., Wolfe, B. (2008). The big three process components of effective professional development: Needs assessment, evaluation, and follow-up. In Winton, P. J., McCollum, J. A., Catlett, C. (Eds.), Practical approaches to early childhood professional development: Evidence, strategies, and resources (pp. 13–51). Washington, DC: Zero to Three. Google Scholar | |
|
Spear-Swerling, L., Cheesman, E. (2012). Teachers’ knowledge-base for implementing response-to-intervention models in reading. Reading and Writing: An Interdisciplinary Journal, 25, 1691–1723. doi:10.1007/s11145-011-9338-3 Google Scholar | Crossref | ISI | |
|
Spectrum K12 School Solutions . (2011). Response to intervention adoption survey 2011. Bellevue, WA: Global Scholar. Google Scholar | |
|
Stoiber, K. C. (2014). A comprehensive framework for multitiered systems of support in school psychology. In Harrison, P. L., Thomas, A. (Eds.), Best practices in school psychology: Data-based and collaborative decision making (pp. 41–70). Bethesda, MD: National Association of School Psychologists. Google Scholar | |
|
Sugai, G., Horner, R. H. (2009). Responsiveness-to-Intervention and school-wide positive behavior supports: Integration of multi-tiered system approaches. Exceptionality, 17, 223–237. doi:10.1080/09362830903235375 Google Scholar | Crossref | ISI | |
|
Telzrow, C. F., McNamara, K., Hollinger, C. L. (2000). Fidelity of problem-solving implementation and relationship to student performance. School Psychology Review, 29, 443–461. Google Scholar | ISI | |
|
Vujnovic, R. K., Fabiano, G. A., Morris, K. L., Norman, K., Hallmark, C., Hartley, C. (2014). Examining school psychologists’ and teachers’ application of approaches within a Response to Intervention framework. Exceptionality, 22, 129–140. doi:10.1080/09362835.2013.865530 Google Scholar | Crossref | ISI | |
|
Ysseldyke, J. E., Christensen, S. L. (1987). Evaluating students’ instructional environments. Remedial and Special Education, 8, 17–24. doi:10.1177/074193258700800305 Google Scholar | SAGE Journals | ISI | |
|
Ysseldyke, J. E., McLeod, S. (2007). Using technology tools to monitor response to intervention. In Jimerson, S., Burns, M. K., VanDerHeyden, A. M. (Eds.), Handbook of response to intervention: The science and practice of assessment and intervention (pp. 396–407). New York, NY: Springer. Google Scholar | Crossref | |
|
Zirkel, P. A., Thomas, A. B. (2010). State laws for RTI: An updated snapshot. Teaching Exceptional Children, 42(3), 56–63. doi:10.1177/004005991004200306 Google Scholar | SAGE Journals |
