![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The purpose of this article is to demonstrate application of a new framework, the validation framework (VF), to assist researchers in evaluating mixed research studies. Based on an earlier work by Dellinger and Leech, a description of the VF is delineated. Using the VF, three studies from education, health care, and counseling fields are evaluated. The three mixed research studies differed in design and implementation. Elements of the VF were examined and evaluated for each study, and a picture of the quality of each study was captured textually. In presenting the VF and its potential for practical application in evaluating mixed research studies, pragmatic researchers can use this tool to increase the quality of their evaluations of mixed research studies.
Keywords mixed research, mixed methods, validity, evaluation of research
|
Cherryholmes, C.H. ( 1988). Construct validity and the discourses of research. American Journal of Education, 96, 421-457. Google Scholar | Crossref | ISI | |
|
Cohen, L. , Manion, L. , & Morrison, K. ( 2007). Research methods in education (6th ed.). New York: Routledge. Google Scholar | |
|
Cook, T.D. , & Campbell, D.T. (1979). Quasi-experimentation: Design and analysis issues for field settings. Boston: Houghton Mifflin. Google Scholar | |
|
Cooper, H. ( 1998). Synthesizing research (3rd ed.). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Creswell, J.W. ( 2007). Qualitative inquiry and research design: Choosing among the five traditions (2nd ed.). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Creswell, J.W. ( 2008). Educational research: Planning, conducting, and evaluating quantitative and qualitative research (3rd ed.). Columbus, OH: Pearson. Google Scholar | |
|
Creswell, J.W. , Fetters, M.D. , & Ivankova, N.V. (2004). Designing a mixed methods study in primary care. Annals of Family Medicine, 2(1), 7-12. Google Scholar | Crossref | Medline | ISI | |
|
Creswell, J.W. , & Plano Clark, V.L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: SAGE. Google Scholar | |
|
Dellinger, A.B. ( 2005). Validity and the review of literature. Research in the Schools, 12(2), 41-54. Google Scholar | |
|
Dellinger, A.B. , & Leech, N.L. ( 2007). Towards a unified validation framework in mixed methods research. Journal of Mixed Methods Research, 1(4), 309-332. Google Scholar | SAGE Journals | ISI | |
|
Edwards, L.M. , & Lopez, S.J. ( 2006). Perceived family support, acculturation, and life satisfaction in Mexican American youth: A mixed-methods exploration. Journal of Counseling Psychology, 53, 279-287. Google Scholar | Crossref | ISI | |
| Gliner, J. A., Morgan, G. A., & Leech, N. L. (2009). Research methods in applied settings: An integrated approach to design and analysis (2nd ed.). New York: Taylor & Francis. Google Scholar | |
|
Guba, E.G. , & Lincoln, Y.S. ( 2005). Paradigmatic controversies, contradictions, and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), The SAGE handbook of qualitative research (3rd ed., pp. 191-215). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Howe, K.R. ( 1988). Against the quantitative-qualitative incompatibility thesis or dogmas die hard. Educational Researcher, 17(8), 10-16. Google Scholar | SAGE Journals | |
|
Johnson, R.B. , & Christensen, L. (2008) Educational research: Quantitative, qualitative and mixed approaches (3rd ed.). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Johnson, R.B. , & Onwuegbuzie, A.J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher , 33(7), 14-26. Google Scholar | SAGE Journals | |
|
Leech, N.L. , & Onwuegbuzie, A.J. (2007). Mixed methods in counseling research: Trends in the literature. Manuscript submitted for publication. Google Scholar | |
|
Maxwell, J.A. ( 1992). Understanding and validity in qualitative research. Harvard Educational Review, 62, 279-300. Google Scholar | Crossref | ISI | |
|
Messick, S. ( 1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: Macmillan . Google Scholar | |
|
Messick, S. ( 1995). Validity of psychological assessment: Validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741-749. Google Scholar | Crossref | ISI | |
|
Morgan, D.L. ( 2007). Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of Mixed Methods Research, 1(1), 48-76. Google Scholar | SAGE Journals | ISI | |
|
Newman, I. , & Benz, C.R. ( 1998). Qualitative-quantitative research methodology: Exploring the interactive continuum. Carbondale: Southern Illinois University Press. Google Scholar | |
|
Onwuegbuzie, A.J. , Jiao, Q.G. , & Collins, K.M.T. (2007). Mixed methods research: A new direction for the study of stress and coping. In. G. Gates (Vol. Ed.), Emerging thought and research on students, teacher, and administrator stress and coping: Vol. 4. Research on stress and coping in education (pp. 215-243). Greenway, CT: Information Age Publishing . Google Scholar | |
|
Onwuegbuzie, A.J. , & Johnson, R.B. ( 2006). The validity issue in mixed research. Research in the Schools, 13(1), 48-63. Google Scholar | |
|
Onwuegbuzie, A.J. , & Leech, N.L. ( 2005a). On becoming a pragmatic researcher: The importance of combining quantitative and qualitative research methodologies. International Journal of Social Research Methodology: Theory and Practice , 8, 375-387. Google Scholar | Crossref | |
|
Onwuegbuzie, A.J. , & Leech, N.L. ( 2005b). Taking the ‘‘Q’’ out of research: Teaching research methodology courses without the divide between quantitative and qualitative paradigms. Quality and Quantity: International Journal of Methodology, 39, 267-296. Google Scholar | Crossref | ISI | |
|
Perry, J.C. , DeWine, D.B. , Duffy, R.D. , & Vance, K.S. ( 2007). The academic self-efficacy of urban youth: A mixed-methods study of a school-to-work program. Journal of Career Development , 34, 103-126. Google Scholar | SAGE Journals | ISI | |
|
Powell, H. , Mihalas, S. , Onwuegbuzie, A.J. , Suldo, S. , & Daley, C.E. ( 2008). Mixed methods research in school psychology: A mixed methods investigation of trends in the literature. Psychology in the Schools, 45, 291-309. Google Scholar | Crossref | ISI | |
|
Rossman, G.B. , & Wilson, B.L. ( 1985). Numbers and words: Combining quantitative and qualitative methods in a single large-scale evaluation study. Evaluation Review, 9, 627-643. Google Scholar | SAGE Journals | ISI | |
|
Sussman, A.L. , Williams, R.L. , Leverence, R. , Gloyd, P.W. , & Crabtree, B.F. (2006) The art of complexity of primary care clinicians’ preventive counseling decisions: Obesity as a case study. Annals of Family Medicine, 4, 327-333. Google Scholar | Crossref | Medline | ISI | |
|
Tashakkori, A. , & Teddlie, C. ( 1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: SAGE. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. ( 2003). The past and future of mixed methods research: From data triangulation to mixed model designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 671-702). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. ( 2006, April). Validity issues in mixed methods research: Calling for an integrative framework. Paper presented at the annual meeting of the American Educational Research Association, San Francisco. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. ( 2008). Quality of inferences in mixed methods research. In M. Bergman (Ed.), Advances in mixed methods research: Theories and applications (pp. 101-119). London: SAGE. Google Scholar | |
|
Whittemore, R. , Chase, S.K. , & Mandle, C.L. ( 2001). Validity in qualitative research. Qualitative Health Research, 11, 522-537. Google Scholar | SAGE Journals | ISI |
