Abstract
The present study examines an ecological model for intervention use to explain student vocabulary performance in a multi-tiered intervention setting. A teacher self-report measure composed of factors hypothesized to influence intervention use at multiple levels (i.e., individual, intervention, and system level) was administered to 54 teachers and 48 interventionists conducting vocabulary interventions with different levels of instructional intensity with 553 kindergarten students. The reliability and validity of the measure in the context of a specific multi-tiered intervention was explored. Of particular interest was the potential explanatory power of system-level factors, over and above intervention-specific measures of fidelity, to explain student performance in a multi-tiered context. Results indicate that the climate of the school system predicted student performance in the Tier 1 context, and intervention feasibility predicted student performance in Tier 2. However, the intervention-specific fidelity measure was not a significant predictor. This research provides supporting evidence for the use of ecological models of intervention implementation to capture factors that influence intervention use and performance in multi-tiered settings.
|
Asparouhov, T., Muthen, B. (2006). Robust chi-square difference testing with mean and variance adjusted test statistics. Mplus Web Notes, 10, 1–5. Google Scholar | |
|
Bean, R., Lillenstein, J. (2012). Response to intervention and the changing roles of schoolwide personnel. Reading Teacher, 65, 491–501. Google Scholar | Crossref | ISI | |
|
Beck, I. L., McKeown, M. G. (2004). Direct and rich vocabulary instruction. In Baumann, J. F., Kame’enui, E. J. (Eds.), Vocabulary instruction (pp. 13–27). New York, NY: Guilford Press. Google Scholar | |
|
Beck, I. L., McKeown, M. G., Kucan, L. (2002). Bringing words to life: Robust vocabulary instruction. New York, NY: Guilford Press. Google Scholar | |
|
Bentler, P. M. (1992). EQS structural equations program manual. Los Angeles, CA: BMDP. Google Scholar | |
|
Biemiller, A., Slonim, N. (2001). Estimating root word vocabulary growth in normative and advantaged populations. Journal of Educational Psychology, 93, 498–520. Google Scholar | Crossref | ISI | |
|
Briesch, A. M., Chafouleas, S. M., Neugebauer, S. R., Riley-Tillman, T. C. (2013). Assessing influences on intervention use: Revision of the Usage Rating Profile. Journal of School Psychology, 51, 81–96. Google Scholar | Crossref | Medline | ISI | |
|
Broughton, S. F., Hester, J. R. (1993). Effects of administrative and community support on teacher acceptance of classroom interventions. Journal of Educational and Psychological Consultation, 4, 169–177. Google Scholar | Crossref | |
|
Brown, T. A. (2006). Confirmatory factor analysis for applied research. New York, NY: Guilford Press. Google Scholar | |
|
Byrne, B. M. (2009). Structural equation modeling with AMOS: Basic concepts, applications, and programming. New York, NY: Taylor & Francis. Google Scholar | |
|
Chatterjee, S., Hadi, A. S. (2012). Regression analysis by example (5th ed.). Hoboken, NJ: John Wiley. Google Scholar | |
|
Coyne, M. D., McCoach, D. B., Loftus, S., Zipoli, R., Ruby, M., Crevecoeur, Y., Kapp, S. (2010). Direct & extended vocabulary instruction in kindergarten: Investigating transfer effects. Journal of Research on Educational Effectiveness, 3, 93–120. Google Scholar | Crossref | |
|
Coyne, M. D., McCoach, D. B., Ware, S., Rattan, S. (2015, March). Evaluating the efficacy of a supplemental kindergarten vocabulary intervention implemented within a tiered instructional framework. Paper presented at the Society for Research on Educational Effectiveness, Washington, DC. Google Scholar | |
|
Cuticelli, M., Coyne, M. D., Ware, S. M., Oldham, A., Loftus Rattan, S. (2015). Improving vocabulary skills of kindergarten students through a multi-tier instructional approach. Intervention in School and Clinic, 50, 150–156. Google Scholar | SAGE Journals | ISI | |
|
Dane, A., Schneider, B. (1998). Program integrity in primary and early secondary prevention: Are implementation effects out of control? Clinical Psychology Review, 18, 23–45. Google Scholar | Crossref | Medline | ISI | |
|
Dempster, A. P., Laird, N. M., Rubin, D. B. (1977). Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, 39, 1–38. Google Scholar | |
|
Dickenson, D., Caswell, L. (2007). Building support for language and early literacy in preschool classrooms through in-service professional development: Effects of the Literacy Environment Enrichment Program (LEEP). Early Childhood Research Quarterly, 22, 243–260. Google Scholar | Crossref | ISI | |
|
Dunn, D. M., Dunn, L. M. (2007). Peabody Picture Vocabulary Test: Manual. Bloomington, MN: NCS Pearson. Google Scholar | |
|
Durlak, J. A., Dupre, E. P. (2008). Implementation matters: A review of research on the influence of implementation on program outcomes and the factors affecting implementation. American Journal of Community Psychology, 41, 327–350. Google Scholar | Crossref | Medline | ISI | |
|
Finney, S. J., DiStefano, C. (2006). Non-normal and categorical data in structural equation modeling. In Hancock, G. R., Mueller, R. O. (Eds.), Structural equation modeling: A second course (pp. 269–314). Greenwich, CT: Information Age Publishing. Google Scholar | |
|
Fuchs, D., Fuchs, L. S., Vaughn, S. (Eds.). (2008). Response to intervention: A framework for reading educators. Newark, DE: International Reading Association. Google Scholar | |
|
Fuchs, D., Mock, D., Morgan, P., Young, C. (2003). Responsiveness-to-intervention: Definitions, evidence, and implications for learning disabilities construct. Learning Disabilities Research & Practice, 3, 157–171. Google Scholar | Crossref | |
|
Gersten, R., Compton, D., Connor, C. M., Dimino, J., Santoro, L., Linan-Thompson, S., Tilly, W. D. (2009). Assisting students struggling with reading: Response to intervention and multi-tier intervention in primary grades. Washington, DC: U.S. Department of Education Institute of Educational Sciences. Google Scholar | |
|
Hoff, E. (2006). How social contexts support and shape language development. Developmental Review, 26, 55–88. Google Scholar | Crossref | ISI | |
|
Individuals With Disabilities Education Act, 20 U.S.C. § 1400 (2004). Google Scholar | |
|
Kazdin, A. E. (1980). Acceptability of alternative treatments for deviant child behavior. Journal of Applied Behavior Analysis, 13, 259–273. Google Scholar | Crossref | Medline | ISI | |
|
Little, T. D. (2013). Longitudinal structural equation modeling. New York, NY: Guilford Press. Google Scholar | |
|
Nagy, W., Scott, J. (2000).Vocabulary processes. In Kamil, M., Mosenthal, P. B., Pearson, P. D., Barr, R. (Eds.), Handbook of reading research (Vol. 3, pp. 269–284). Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
National Center on Response to Intervention . (n.d.). Available from http://www.rti4success.org/ Google Scholar | |
|
Noell, G. H. (2008). Research examining the relationships among consultation process, treatment integrity, and outcomes. In Erchul, W. P., Sheridan, S. M. (Eds.), Handbook of research in school consultation: Empirical foundations for the field (pp. 315–334). Mahwah, NJ: Erlbaum. Google Scholar | |
|
Orne, C. M., Binik, Y. M. (1989). Consistency in adherence among regiment demands. Health Psychology, 8, 27–43. Google Scholar | Crossref | Medline | ISI | |
|
Perepletchikova, F., Kazdin, A. E. (2005). Treatment integrity and therapeutic change: Issues and research recommendations. Clinical Psychology: Science and Practice, 12, 365–383. Google Scholar | Crossref | ISI | |
|
Raudenbush, S. W., Bryk, A. S. (2002). Hierarchical linear models: Applications and data analysis methods. Chicago, IL: Scientific Software International. Google Scholar | |
|
Reimers, T. M., Wacker, D. P., Koeppl, G. (1987). Acceptability of behavioral treatments: A review of the literature. School Psychology Review, 16, 212–227. Google Scholar | ISI | |
|
Riemer, M., Rosof-Williams, J., Bickman, L. (2005). Theories related to changing clinician practice. Child and Adolescent Psychiatric Clinics of North America, 14, 241–254. Google Scholar | Crossref | Medline | ISI | |
|
Riley-Tillman, T. C., Chafouleas, S. M. (2003). Using interventions that exist in the natural environment to increase treatment integrity and social influence in consultation. Journal of Educational and Psychological Consultation, 14, 139–156. Google Scholar | Crossref | ISI | |
|
Sanetti, L. M. H., Kratochwill, T. R. (2009). Toward developing a science of treatment integrity: Introduction to the special series. School Psychology Review, 38, 445–459. Google Scholar | ISI | |
|
Semel, E., Wiig, E. H., Secord, W. A. (2003). Clinical Evaluation of Language Fundamentals–Fourth Edition (CELF-4). Toronto, Ontario, Canada: Harcourt Assessment. Google Scholar | |
|
Simmons, D. C., Coyne, M., Hagan-Burke, S., Kwok, O., Simmons, L., Johnson, C., . . . Crevecoeur, Y. (2011). Effects of supplemental reading interventions in authentic contexts: A comparison of kindergarteners’ response. Exceptional Children, 77, 207–228. Google Scholar | SAGE Journals | ISI | |
|
Stahl, K. A. D. (2011). Applying new visions of reading development in today’s classrooms. Reading Teacher, 65, 52–56. Google Scholar | ISI | |
|
Stanovich, K. E. (1986). Matthew effects in reading: Some consequences of individual differences in the acquisition of literacy. Reading Research Quarterly, 21, 360–407. Google Scholar | Crossref | ISI | |
|
Steiger, J. H., Lind, J. C. (1980, May). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA. Google Scholar | |
|
Sterling-Turner, H. E., Watson, T. S. (2002). An analog investigation of the relationship between treatment acceptability and treatment integrity. Journal of Behavioral Education, 11, 39–50. Google Scholar | Crossref | |
|
Tabachnick, B. G., Fidell, L. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson. Google Scholar | |
|
Williams, K. T. (2007). Expressive vocabulary test (2nd ed.): Manual. Minneapolis, MN: Pearson Assessments. Google Scholar | |
|
Williams, M. N., Grajales, C. A. G., Kurkiewicz, D. (2013). Assumptions of multiple regression: Correcting two misconceptions. Practical Assessment, Research & Evaluation, 18, 1–14. Google Scholar |

