![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
The primary purpose of this article is to further discussions of validity in mixed methods research by introducing a validation framework to guide thinking about validity in this area. To justify the use of this framework, the authors discuss traditional terminology and validity criteria for quantitative and qualitative research, as well as present recently published validity terminology for mixed methods research. The authors discuss the rationale for their framework and how it unifies thinking about validity in mixed methods research. Finally, they discuss how the framework can be used.
|
Adcock, R. , & Collier, D. (2001). Measurement validity: A shared standard for qualitative and quantitative research. American Political Science Review , 95(3), 529-546. Google Scholar | Crossref | ISI | |
|
Angen, M.J. (2000). Evaluating interpretive inquiry: Reviewing the validity debate and opening the dialogue. Qualitative Health Research, 10(3), 378-395. Google Scholar | SAGE Journals | ISI | |
|
Beach, K.D. , Becker, B.J. , & Kennedy, M.M. (2006). Constructing conclusions. In C. F. Conrad & R. C. Serlin (Eds.), The Sage handbook for research in education (pp. 493-509). Thousand Oaks, CA: Sage. Google Scholar | |
|
Boote, D.N. , & Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation. Educational Researcher, 34, 3-15. Google Scholar | SAGE Journals | |
|
Campbell, D.T. (1957). Factors relevant to the validity of experiments in social settings. Psychological Bulletin, 54, 297-312. Google Scholar | Crossref | Medline | ISI | |
|
Campbell, D.T. (1963a). From description to experimentation: Interpreting trends as quasi-experiments. In C. W. Harris (Ed.), Problems in measuring change (pp. 212-242). Chicago: University of Chicago Press. Google Scholar | |
|
Campbell, D.T. (1963b). Social attitudes and other acquired behavioral dispositions. In S. Koch (Ed.), Psychology: A study of science: Investigations of man as socius (Vol. 6, pp. 94-172). New York: Rand McNally. Google Scholar | Crossref | |
|
Campbell, D.T. , & Stanley, J.C. (1963). Experimental and quasi-experimental designs for research. Chicago: Rand McNally . Google Scholar | |
|
Cherryholmes, C.H. (1988). Construct validity and the discourses of research . American Journal of Education, 96(3), 421-457. Google Scholar | Crossref | ISI | |
|
Cooper, H. (1998). Synthesizing research (3rd ed.). Thousand Oaks, CA: Sage . Google Scholar | |
|
Creswell, J.W. (2003). Research design: Qualitative, quantitative, and mixed methods approaches. Thousand Oaks, CA: Sage. Google Scholar | |
|
Creswell, J.W. , & Plano Clark, V.L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage. Google Scholar | |
|
Crocker, L. , & Algina, J. (1986). Introduction to classical & modern test theory . Fort Worth, TX: Harcourt Brace Jovanovich. Google Scholar | |
|
Cronbach, L.J. , & Meehl, P.E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281-302. Google Scholar | Crossref | Medline | ISI | |
|
Dellinger, A.B. (2005). Validity and the review of literature. Research in the Schools, 12(2), 41-54. Google Scholar | |
|
Denzin, N.K. (1989). The research act: A theoretical introduction to sociological methods (3rd ed.). Englewood Cliffs, NJ: Prentice Hall. Google Scholar | |
|
Denzin, N.K. (1994). Evaluating qualitative research in the poststructural moment: The lessons James Joyce teaches us. Qualitative Studies in Education, 7, 295-308. Google Scholar | Crossref | |
|
Denzin, N. K. , & Lincoln, Y. S. (Eds.). (2005). The Sage handbook of qualitative research (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Eisenhart, M.A. , & Howe, K.R. (1992). Validity in educational research. In M. D. LeCompte , W. L. Millroy , & J. Preissle (Eds.), The handbook of qualitative research in education (pp. 643-680). San Diego, CA: Academic Press. Google Scholar | |
|
Eisner, E.W. (1991). The enlightened eye: Qualitative inquiry and the enhancement of educational practice. Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Ercikan, K. , & Roth, W.M. (2006). What good is polarizing research into qualitative and quantitative? Educational Researcher, 35(5), 14-23. Google Scholar | SAGE Journals | |
|
Freeman, M. , deMarrais, K. , Preissle, J. , Roulston, K. , & St. Pierre, E.A. (2007). Standards of evidence in qualitative research: An incitement to discourse. Educational Researcher, 36(1), 25-32. Google Scholar | SAGE Journals | |
|
Gliner, J.A. , & Morgan, G.A. (2000). Research methods in applied settings: An integrated approach to design and analysis. Mahwah, NJ: Lawrence Erlbaum. Google Scholar | |
|
Goetz, J.P. , & LeCompte, M.D. (1984). Ethnography and the qualitative design in educational research. New York: Academic Press. Google Scholar | |
|
Goodwin, L.D. , & Leech, N.L. (2003). The meaning of validity in the new standards for educational and psychological testing: Implications for measurement courses . Measurement and Evaluation in Counseling and Development , 36, 181-191. Google Scholar | Crossref | ISI | |
|
Greenwood, D.J. , & Levin, M. (2005). Reform of the social sciences and of universities through action research. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (3rd ed., pp. 43-64). Thousand Oaks, CA: Sage. Google Scholar | |
|
Hubley, A.M. , & Zumbo, B.D. (1996). A dialectic on validity: Where we have been and where we are going. Journal of General Psychology, 123(3), 207-215. Google Scholar | Crossref | ISI | |
|
Johnson, R.B. , & Onwuegbuzie, A.J. (2004). Mixed methods research: A research paradigm whose time has come. Educational Researcher , 33(7), 14-26. Google Scholar | SAGE Journals | |
|
Jonson, J.L. , & Plake, B.S. (1998). A historical comparison of validity standards and validity practices. Educational and Psychological Measurement , 58(5), 736-753. Google Scholar | SAGE Journals | ISI | |
|
Krathwohl, D.R. (1993). Methods of educational and social science research: An integrated approach. New York: Longman. Google Scholar | |
|
Langer, E.J. (1989). Mindfulness. Reading, MA: Perseus. Google Scholar | |
|
Lather, P. (1986). Issues of validity in openly ideological research: Between a rock and a soft place. Interchange, 17, 63-84. Google Scholar | Crossref | |
|
Lather, P. (1993). Fertile obsession: Validity after poststructuralism . Sociological Quarterly, 34, 673-693. Google Scholar | Crossref | ISI | |
|
Lincoln, Y.S. , & Guba, E.G. (1985). Naturalistic inquiry. Beverly Hills, CA: Sage. Google Scholar | |
|
Lincoln, Y.S. , & Guba, E.G. (2005). Paradigmatic controversies, contradictions, and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (3rd ed., pp. 191-215). Thousand Oaks, CA: Sage. Google Scholar | |
|
Lord, C.G. , Ross, L. , & Lepper, M.R. (1979). Biased assimilation and attitude polarization: The effects of prior theories on subsequently considered evidence. Journal of Personality and Social Psychology, 37(11), 2098-2109. Google Scholar | Crossref | ISI | |
|
Markus, K.A. (1998). Science, measurement, and validity: Is completion of Samuel Messick's synthesis possible? Social Indicators Research, 45, 7-34. Google Scholar | Crossref | ISI | |
|
Mason, J. (2006). Mixing methods in a qualitatively driven way. Qualitative Research, 6(1), 9-25. Google Scholar | SAGE Journals | |
|
Maxwell, J.A. (1992). Understanding and validity in qualitative research . Harvard Educational Review, 62, 279-300. Google Scholar | Crossref | ISI | |
|
Maxwell, J.A. (2004a). Causal explanation, qualitative research, and scientific inquiry in education. Educational Researcher, 33, 3-11. Google Scholar | SAGE Journals | |
|
Maxwell, J.A. (2004b). Using qualitative methods for causal explanation . Field Methods, 16(3), 243-264. Google Scholar | SAGE Journals | |
|
Messick, S. (1989a). Meaning and values in test validation: The science and ethics of assessment. Educational Researcher, 18(2), 5-11. Google Scholar | SAGE Journals | |
|
Messick (1989b). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 13-103). New York: Macmillan. Google Scholar | |
|
Messick, S. (1995). Validity of psychological assessment: Validation of inferences from persons' responses and performances as scientific inquiry into score meaning. American Psychologist, 50(9), 741-749. Google Scholar | Crossref | ISI | |
|
Messick, S. (1998). Test validity: A matter of consequence. Social Indicators Research, 45, 35-44. Google Scholar | Crossref | ISI | |
|
Miles, M.B. , & Huberman, A.M. (1994). Qualitative data analysis: An expanded sourcebook (2nd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Miller, S. (2003). Impact of mixed methods and design on inference quality. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 423-455). Thousand Oaks, CA: Sage. Google Scholar | |
|
Moss, P.A. , & Schutz, A. (2001). Educational standards, assessment, and the search for consensus. American Educational Research Journal, 38(1), 37-70. Google Scholar | SAGE Journals | ISI | |
|
Neuman, W.L. (2004). Basics of social research: Qualitative and quantitative approaches. Boston: Pearson Education . Google Scholar | |
|
Newman, I. , & Benz, C.R. (1998). Qualitative-quantitative research methodology: Exploring the interactive continuum. Carbondale: Southern Illinois University Press. Google Scholar | |
|
Onwuegbuzie, A.J. (2003). Expanding the framework of internal and external validity in quantitative research. Research in the Schools , 10(1), 71-89. Google Scholar | |
|
Onwuegbuzie, A.J. , Collins, K.M.T. , Leech, N.L. , Dellinger, A.B. , & Jiao, Q.G. (in press). A meta framework for conducting and writing rigorous, comprehensive, and insightful literature reviews. In K.M.T. Collins , A. J. Onwuegbuzie , & Q. G. Jiao (Eds.). Toward a broader understanding of stress and coping: Mixed methods approaches. Greenwich, CT: Information Age. Google Scholar | |
|
Onwuegbuzie, A.J. , & Johnson, R.B. (2006). The validity issue in mixed research. Research in the Schools, 13(1), 48-63. Google Scholar | |
|
Onwuegbuzie, A.J. , & Leech, N.L. (2005). On becoming a pragmatic researcher: The importance of combining quantitative and qualitative research methodologies. International Journal of Social Research Methodology: Theory & Practice , 8(5), 375-387. Google Scholar | Crossref | |
|
Onwuegbuzie, A.J. , & Leech, N.L. (2007). Validity and qualitative research: An oxymoron ? Quality and Quantity: International Journal of Methodology , 41, 233-249. Google Scholar | Crossref | ISI | |
|
Osterlind, S.J. (2006). Modern measurement: Theory, principles, and applications of mental appraisal. Upper Saddle River, NJ: Pearson-Merrill Prentice Hall . Google Scholar | |
|
Pedhazur, E.J. , & Schmelkin, L.P. (1991). Measurement, design, and analysis: An integrated approach. Hillsdale, NJ: Lawrence Erlbaum. Google Scholar | |
|
Richardson, L. (1994). Writing: A method of inquiry. In N. K. Denzin & Y. L. Lincoln (Eds.), Handbook of qualitative research (2nd ed., pp. 516-529). Thousand Oaks, CA: Sage. Google Scholar | |
|
Richardson, L. (1997). Fields of play: Constructing an academic life . New Brunswick, NJ: Rutgers University Press. Google Scholar | |
|
Richardson, L. , & St. Pierre, E.A. (2005). Writing: A method of inquiry . In N. K. Denzin & Y. S. Lincoln (Eds.), The Sage handbook of qualitative research (3rd ed., pp. 959-978). Thousand Oaks, CA: Sage. Google Scholar | |
|
Sandelowski, M. , Volls, C.I. , & Barraso, J. (2006). Defining and designing mixed research synthesis studies. Research in the Schools, 13(1), 29-40. Google Scholar | Medline | |
|
Schwandt, T.A. (1996). Farewell to criteriology. Qualitative Inquiry, 2, 58-72. Google Scholar | SAGE Journals | |
|
Shadish, W.R. , Cook, T.D. , & Campbell, D.T. (2002). Experimental and quasi-experimental designs for generalized causal inference. Boston: Houghton Mifflin. Google Scholar | |
|
Steinke, I. (2004). Quality criteria in qualitative research. In U. Flick , E. von Kardorff , & I. Steinke (Eds.), A companion to qualitative research (pp. 184-190). London: Sage Ltd. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks, CA: Sage. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. (Eds.). (2003a). Handbook of mixed methods in social & behavioral research. Thousand Oaks, CA : Sage. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. (2003b). The past and future of mixed methods research: From data triangulation to mixed model designs. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 671-702). Thousand Oaks, CA: Sage. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. (2006, April). Validity issues in mixed methods research: Calling for an integrative framework. Paper presented at the annual meeting of the American Educational Research Association, San Francisco. Google Scholar | |
|
Tashakkori, A. , & Teddlie, C. (in press). Quality of inferences in mixed methods research. In M. Bergman. (Ed.) Advances in mixed methods research: Theories and applications. London : Sage Ltd. Google Scholar | |
|
Teddlie, C. , & Tashakkori, A. (2003). Major issues and controversies in the use of mixed methods in the social and behavioral sciences. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 3-50). Thousand Oaks, CA: Sage. Google Scholar | |
|
Webster's new universal unabridged dictionary (2nd ed.). (1983). New York: New World Dictionaries/Simon & Schuster. Google Scholar | |
|
Whittemore, R. , Chase, S.K. , & Mandle, C.L. (2001). Validity in qualitative research. Qualitative Health Research, 11(4), 522-537. Google Scholar | SAGE Journals | ISI | |
|
Wolcott, H. (1990). On seeking—and rejecting—validity in qualitative research. In E. Eisner & A. Peshkin (Eds.), Qualitative inquiry in education: The continuing debate (pp. 121-152). New York: Teachers College Press. Google Scholar |
