Abstract
This inquiry developed during the process of “quantitizing” qualitative data the authors had gathered for a mixed methods curriculum efficacy study. Rather than providing the intended rigor to their data coding process, their use of an intercoder reliability metric prompted their investigation of the multiplicity and messiness that, as they suggest here, are inherent to work that crosses the epistemological boundaries of academic fields and research paradigms. Even as the authors developed a deeper understanding of—and appreciation for—the nature of quantitative rigor, they moved toward a more deeply constructivist view of the research process itself. Ultimately, the authors abandoned the neat study of intercoder reliability that they had envisioned and moved toward the present dialogic report to reveal and examine their process.
|
Altheide, D. L., Johnson, J. M. (1994). Criteria for assessing interpretive validity in qualitative research. In Denzin, N. K., Lincoln, Y. S. (Eds.), Handbook of qualitative research (pp. 485-499). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Bateson, G. (2000). Experiments in thinking about observed ethnological material. In Steps to an ecology of mind: Collected essays on anthropology, psychiatry, evolution, and epistemology (pp. 73-87). Chicago, IL: The University of Chicago Press. (Original work published 1941). Google Scholar | |
|
Biesta, G. J. J., Burbules, N. C. (2003). Pragmatism and educational research. Lanham, MD: Rowman & Littlefield. Google Scholar | |
|
Bochner, A. P. (1997). It’s about time: Narrative and the divided self. Qualitative Inquiry, 3, 418-438. Google Scholar | SAGE Journals | |
|
Box, G. N. R., Draper, N. R. (1987). Empirical model-building and response surfaces. New York, NY: John Wiley. Google Scholar | |
|
Brannen, J. (2005). Mixing methods: The entry of qualitative and quantitative approaches into the research process. International Journal of Social Research Methodology, 8, 173-184. Google Scholar | Crossref | |
|
Chesler, M., Lewis, A. E., Crowfoot, J. E. (2005). Challenging racism in higher education: Promoting justice. Lanham, MD: Rowman & Littlefield. Google Scholar | |
|
Dellinger, A. B., Leech, N. L. (2007). Toward a unified validation framework in mixed methods research. Journal of Mixed Methods Research, 1(4), 309-332. Google Scholar | SAGE Journals | ISI | |
|
Denscombe, M. (2008). Communities of practice: A research paradigm for the mixed methods approach. Journal of Mixed Methods Research, 2(3), 270-283. Google Scholar | SAGE Journals | ISI | |
|
Dewey, J. (1977). Logical conditions of a scientific treatment of morality. In Boydston, J. A. (Ed.), John Dewey: The middle works, 1899-1924 (Vol. 3, pp. 3-39). Carbondale, IL: Southern Illinois University Press. (Original work published 1903) Google Scholar | Crossref | |
|
Dewey, J. (1984). The quest for certainty. In Boydston, J. A. (Ed.), John Dewey: The later works, 1925-1953 (Vol. 4, pp. 3-250). Carbondale, IL: Southern Illinois University Press. (Original work published 1929) Google Scholar | |
|
Dewey, J. (1986). Logic: The theory of inquiry. In Boydston, J. A. (Ed.), John Dewey: The later works, 1925-1953 (Vol. 12, pp. 1-528). Carbondale, IL: Southern Illinois University Press. (Original work published 1938) Google Scholar | |
|
Duncan, P. (2002). Decentering whiteness: Resisting whiteness in the Women’s Studies classroom. In TuSmith, B., Reddy, M. T. (Eds.), Racism in the college classroom: Pedagogy and politics (pp. 40-50). New Brunswick, NJ: Rutgers University Press. Google Scholar | |
|
Eisenhart, M. (2005). Hammers and saws for the improvement of educational research. Educational Theory, 55, 245-261. Google Scholar | |
|
Ettlinger, N. (2007). Precarity unbound. Alternatives, 32, 319-340. Google Scholar | SAGE Journals | ISI | |
|
Gadamer, H. G. (2004). Philosophical hermeneutics (Linge, D. E. , Trans. & Ed.). Berkeley: University of California Press. (Original work published 1976) Google Scholar | |
|
Green, A., Preston, J. (2005). Editorial: Speaking in tongues—Diversity in mixed methods research. International Journal of Social Research Methodology, 8, 167-171. Google Scholar | Crossref | |
|
Greene, J. C. (2005). The generative potential of mixed methods inquiry. International Journal of Research & Method in Education, 28, 207-211. Google Scholar | Crossref | |
|
Hak, T., Bernts, T. (1996). Coder training: Theoretical training or practical socialization? Qualitative Sociology, 19, 235-257. Google Scholar | Crossref | |
|
Hayes, A. F., Krippendorff, K. (2007). Answering the call for a standard reliability measure for coding data. Communication Methods and Measures, 1, 77-89. Google Scholar | Crossref | |
|
Holman Jones, S. (2005). Autoethnography: Making the personal political. In Denzin, N. K., Lincoln, Y. S. (Eds.), The Sage handbook of qualitative research (3rd ed., pp. 763-791). Thousand Oaks, CA: SAGE. Google Scholar | |
|
Howe, K. (2005). The question of education science. Educational Theory, 55, 307-321. Google Scholar | |
|
Krippendorff, K. (1980). Content analysis, an introduction to its methodology. Thousand Oaks, CA: SAGE. Google Scholar | |
|
Kuhn, T. S. (1977). The essential tension: Tradition and innovation in scientific research. In The essential tension: Selected studies in scientific tradition and change (pp. 225-239). Chicago, IL: The University of Chicago Press. Google Scholar | |
|
Kuhn, T. S. (1996). The structure of scientific revolutions (3rd ed.). Chicago, IL: The University of Chicago Press. (Original work published 1962) Google Scholar | Crossref | |
|
Lather, P. (2009). 2007 Kneller Lecture, AESA. Getting lost: Social science and/as philosophy. Educational Studies, 45, 342-357. Google Scholar | Crossref | |
|
Laverty, S. M. (2003). Hermeneutic phenomenology and phenomenology: A comparison of historical and methodological considerations. International Journal of Qualitative Methods, 2(3), 2-29. Google Scholar | SAGE Journals | |
|
Law, J. (2004). After method: Mess in social science research. New York, NY: Routledge. Google Scholar | |
|
Lee, J. W., Jones, P. S., Mineyama, Y., Zhang, X. E. (2002). Cultural differences in responses to a Likert scale. Research in Nursing & Health, 25, 295-306. Google Scholar | Crossref | Medline | ISI | |
|
Leech, N. L., Onwuegbuzie, A. J. (2009). A typology of mixed methods research designs. Quality & Quantity, 43, 265-275. Google Scholar | Crossref | ISI | |
|
Macbeth, D. (2001). On “reflexivity” in qualitative research: Two readings, and a third. Qualitative Inquiry, 7, 35-68. Google Scholar | SAGE Journals | |
|
Maynard, D. W., Schaeffer, N. C. (2000). Toward a sociology of scientific knowledge: Survey research and ethnomethodology’s asymmetric alternates. Social Studies of Science, 30, 323-370. Google Scholar | SAGE Journals | ISI | |
|
Morgan, D. L. (2007). Paradigms lost and pragmatism regained: Methodological implications of combining qualitative and quantitative methods. Journal of Mixed Methods Research, 1(1), 48-76. Google Scholar | SAGE Journals | ISI | |
|
Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: SAGE. Google Scholar | |
|
Pickett, S. T. A., Burch, W. R., Grove, J. M. (1999). Interdisciplinary research: Maintaining the constructive impulse in a culture of criticism. Ecosystems, 2, 302-307. Google Scholar | Crossref | ISI | |
|
Popp, J. A. (2007). Evolution’s first philosopher: John Dewey and the continuity of nature. Albany: State University of New York Press. Google Scholar | |
|
Sandelowski, M., Voils, C. I., Knafl, G. (2009). On quantitizing. Journal of Mixed Methods Research, 3(3), 208-222. Google Scholar | SAGE Journals | ISI | |
|
Schwandt, T. A. (2005). A diagnostic reading of scientifically based research for education. Educational Theory, 55, 285-305. Google Scholar | |
|
Sears, D. O., Fu, M., Henry, P. J., Bui, K. (2003). The origins and persistence of ethnic identity among the “new immigrant” groups. Social Psychology Quarterly, 66, 419-437. Google Scholar | Crossref | ISI | |
|
Sears, D. O., Savalei, V. (2006). The political color line in America: Many “peoples of color” or black exceptionalism? Political Psychology, 27, 895-924. Google Scholar | Crossref | ISI | |
|
Seltzer-Kelly, D. (2008). Deweyan Darwinism for the 21st century: Toward an educational method for critical democratic engagement in the era of the Institute of Education Sciences. Educational Theory, 58, 289-304. Google Scholar | Crossref | |
|
Seltzer-Kelly, D., Westwood, S. J., Peña-Guzman, D. M. (2010). Deweyan multicultural democracy, Rortian solidarity, and the popular arts: Krumping into presence. Studies in Philosophy and Education, 29, 441-457. Google Scholar | Crossref | ISI | |
|
Siltanen, J., Willis, A., Scobie, W. (2008). Separately together: Working reflexively as a team. International Journal of Social Research Methodology, 11, 45-61. Google Scholar | Crossref | ISI | |
|
Suchman, L. (1987). Plans and situated actions: The problem of human-machine communication. New York, NY: Cambridge University Press. Google Scholar | |
|
Tinsley, H. E. A., Weiss, D. J. (1975). Interrater reliability and agreement of subjective judgments. Journal of Counseling Psychology, 22, 358-376. Google Scholar | Crossref | ISI | |
|
Turner, M. G., Carpenter, S. R. (1999). Tips and traps in interdisciplinary research. Ecosystems, 2, 275-276. Google Scholar | Crossref | ISI | |
|
TuSmith, B., Reddy, M. T. (Eds.). (2002). Racism in the college classroom: Pedagogy and politics. New Brunswick, NJ: Rutgers University Press. Google Scholar | |
|
Wear, D. N. (1999). Challenges to interdisciplinary discourse. Ecosystems, 2, 299-301. Google Scholar | Crossref | ISI |

