![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
As part of a sequential exploratory mixed methods study, 9 months of ethnographically guided observations and interviews were used to develop a survey examining graduate engineering student retention. Findings from the ethnographic fieldwork yielded several themes, including international diversity, research group organization and climate, perception of value, and individual and group learning. In this article, the authors present the final themes from the ethnographic analysis and discuss how these data were configured into constructs and survey questions. The authors discuss the final survey, including validity and reliability analysis, and how constructs were developed to test hypotheses for future studies. The article concludes with implications for mixed methods researchers interested in using qualitative methods to create new surveys.
Keywords survey development, engineering, ethnography, graduate students, retention
References
Section:
|
Abedi, J., Benkin, E. (1987). The effects of students’ academic, financial, and demographic variables on time to the doctorate. Research in Higher Education, 27(1), 3-14. Google Scholar | Crossref | ISI | |
|
Altbach, P. G., Berdahl, R. O., Gumport, P. J. (1999). American higher education in the twenty-first century : social, political, and economic challenges. Baltimore: Johns Hopkins University Press. Google Scholar | |
|
Allen, K., Reed-Rhoads, T., Terry, R. A., Murphy, T. J., Stone, A. D. (2008). Coefficient alpha: An engineer’s interpretation of test reliability. Journal of Engineering Education, 97, 87-94. Google Scholar | Crossref | ISI | |
|
Anderson, M. S., Louis, K. S., Jason, E. (1994). Disciplinary and departmental effects on observations of faculty and graduate student misconduct. Journal of Higher Education, 65, 331-350. Google Scholar | Crossref | ISI | |
|
Anderson, M. S., Swazey, J. P. (1998). Reflections on the Graduate Student Experience: An Overview. New Directions for Higher Education, 1998(101), 3-13. Google Scholar | Crossref | |
|
Baird, L. L. (1993). Using research and theoretical models of graduate student progress. In Baird, L. L. (Ed.), Increasing graduate student retention and degree attainment (pp. 3-12). San Francisco, CA: Jossey-Bass. Google Scholar | Crossref | |
|
Bess, J. L. (1978). Anticipatory socialization of graduate students. Research in Higher Education, 8, 289-317. Google Scholar | Crossref | |
|
Bolger, N., Davis, A., Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54, 579-616. Google Scholar | Crossref | Medline | ISI | |
|
Bound, J., Turner, S., Walsh, P. (2009, March). Internationalization of U.S. doctorate education (National Bureau of Economic Research Working Paper Series, No. 14792). Cambridge, MA: National Bureau of Economic Research. Google Scholar | Crossref | |
|
Carnoy, M. (1998). The globalization of innovation, nationalist competition, and the internationalization of scientific training. Competition & Change, 3(1/2), 237. Google Scholar | SAGE Journals | |
|
Castro, F. G., Kellison, J. G., Boyd, S. J., Kopak, A. (2010). A methodology for conducting integrative mixed methods research and data analyses. Journal of Mixed Methods Research, 4(4), 342-360. Google Scholar | SAGE Journals | ISI | |
|
Charmaz, K. (2006). Constructing grounded theory, a practical guide to qualitative analysis. Thousand Oaks, CA: Sage. Google Scholar | |
|
Committee on Science Engineering and Public Policy . (2007). Rising above the gathering storm: Energizing and employing America for a brighter economic future. Washington, DC: National Academies Press. Google Scholar | |
|
Council of Graduate Schools . (2007). Ph.D. completion and attrition: Analysis of baseline demographic data from the Ph.D. completion project. Washington, DC: Author. Google Scholar | |
|
Council of Graduate Schools . (2009). Ph.D. completion and attrition: Findings from exit surveys of Ph.D. completers. Washington, DC: Author. Google Scholar | |
|
Crede, E., Borrego, M. (2010a, June). The effect of international diversity on graduate engineering education: A literature review. Paper presented at the 2010 American Society of Engineering Education Annual Conference and Exposition, Louisville, KY. Google Scholar | |
|
Crede, E., Borrego, M. (2010b, October). International diversity in graduate engineering education: Development of a multi institutional survey. Paper presented at the 2010 Frontiers in Education Conference, Arlington, VA. Google Scholar | Crossref | |
|
Crede, E., Borrego, M. (in press). Learning in graduate engineering research groups of various sizes. Journal of Engineering Education. Google Scholar | ISI | |
|
Creswell, J. W. (2009). Research design: Qualitative, quantitative, and mixed methods approaches (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Creswell, J. W., Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage. Google Scholar | |
|
Creswell, J. W., Plano Clark, V. L., Gutmann, M. L., Hanson, W. E. (2003). Advanced mixed methods research designs. In Tashakkori, A., Teddlie, C. (Eds.), Handbook of mixed methods research in social and behavioral research (pp. 209-240). Thousand Oaks, CA: Sage. Google Scholar | |
|
Cumming, J. (2010). Doctoral enterprise: a holistic conception of evolving practices and arrangements. Studies in Higher Education, 35(1), 25-39. Google Scholar | Crossref | ISI | |
|
Cuny, J., Aspray, W. (2002). Recruitment and retention of women graduate students in computer science and engineering: Results of a workshop organized by the computing research association. SIGCSE Bulletin, 34(2), 168-174. Google Scholar | Crossref | |
|
Deem, R., Brehony, K. J. (2000). Doctoral Students’ Access to Research Cultures-are some more unequal than others? Studies in Higher Education, 25(2), 149-165. Google Scholar | Crossref | ISI | |
|
Dellinger, A. B., Leech, N. L. (2007). Toward a unified validation framework in mixed methods research. Journal of Mixed Methods Research, 1(4), 309-332. Google Scholar | SAGE Journals | ISI | |
|
Elliott, K. M., Shin, D. (2002). Student satisfaction: An alternative approach to assessing this important concept. Journal of Higher Education Policy and Management, 24, 197-209. Google Scholar | Crossref | |
|
Emerson, R. M., Fretz, R. I., Shaw, L. L. (1995). Writing ethnographic fieldnotes. Chicago, IL: University of Chicago Press. Google Scholar | Crossref | |
|
Fetterman, D. M. (1998). Ethnography (2nd ed., Vol. 17). Thousand Oaks, CA: Sage. Google Scholar | |
|
Friedman, T. L. (2007). The world is flat (3rd ed.). New York, NY: Picador. Google Scholar | |
|
Fuller, T. D., Edwards, J. N., Vorakitphokatorn, S., Sermsri, S. (1993). Using focus groups to adapt survey instruments to new populations. In Morgan, D. L. (Ed.), Successful focus groups: Advancing the state of the art (pp. 89-104). Newbury Park, CA: Sage. Google Scholar | Crossref | |
|
Gardner, S. (2009). Student and faculty attributions of attrition in high and low-completing doctoral programs in the United States. Higher Education, 58, 97-112. doi:10.1007/s10734-008-9184-7 Google Scholar | Crossref | ISI | |
|
Girves, J. E., Wemmerus, V. (1988). Developing models of graduate student degree progress. Journal of Higher Education, 59, 163-189. Google Scholar | Crossref | ISI | |
|
Golde, C. M. (1998). Beginning Graduate School: Explaining First-Year Doctoral Attrition. New Directions for Higher Education, 1998(101), 55-64. Google Scholar | Crossref | |
|
Golde, C. M. (2005). The Role of the Department and Discipline in Doctoral Student Attrition: Lessons from Four Departments. The Journal of Higher Education, 76(6), 669-700. Google Scholar | Crossref | ISI | |
|
Golde, C. M., Walker, G. E. (Eds.). (2006). Envisioning the Future of Doctoral Education (First ed.). San Francisco: Jossey-Bass. Google Scholar | |
|
Gregg, W. E. (1972). Several factors affecting graduate student satisfaction. Journal of Higher Education, 43, 483-498. Google Scholar | Crossref | ISI | |
|
Grevholm, B., Persson, L.-E., Wall, P. (2005). A dynamic model for education of doctoral students and guidance of supervisors in research groups. Educational Studies in Mathematics, 60, 173-197. doi:10.1007/s10649-005-4497-2 Google Scholar | Crossref | |
|
Hennink, M. M. (2008). Language and communication in cross-cultural qualitative research. In Liamputtong, P. (Ed.), Doing cross-cultural research (Vol. 34, pp. 21-33). Dordrecht, Netherlands: Springer. Google Scholar | Crossref | |
|
Hermanowicz, J. C. (2002). The great interview: 25 strategies for studying people in bed. Qualitative Sociology, 25, 479-499. Google Scholar | Crossref | |
|
Kuh, G. D., Whitt, E. J. (1988). The invisible tapestry. Culture in American colleges and universities. Washington, DC: Association for the Study of Higher Education. Google Scholar | |
|
Lee, A. (2008). How are doctoral students supervised? Concepts of doctoral research supervision. Studies in Higher Education, 33(3), 267-281. Google Scholar | Crossref | ISI | |
|
Leech, N. L., Onwuegbuzie, A. J. (2010). Guidelines for conducting and reporting mixed research in counseling and beyond. Journal of Counseling & Development, 88, 61-70. Google Scholar | Crossref | ISI | |
|
Litzler, E., Lange, S. E., Brainard, S. G. (2005, April). Climate for graduate students in science and engineering departments. Paper presented at the 2005 American Society of Engineering Education Annual Conference and Exposition, Dekalb, IL. Google Scholar | |
|
Louis, K. S., Holdsworth, J. M., Anderson, M. S., Campbell, E. G. (2007). Becoming a scientist: The effects of work-group size and organizational climate. Journal of Higher Education, 78, 311-336. Google Scholar | Crossref | ISI | |
|
Lovitts, B. (1996, April). Who is responsible for graduate student attrition—The individual or the institution? Toward an explanation of the high and persistent rate of attrition. Paper presented at the Annual Meeting of the American Educational Research Association, New York, NY. Google Scholar | |
|
Lovitts, B. (2001). Leaving the ivory tower: The causes and consequences of departure from doctoral study. Lanham, MD: Rowman & Littlefield. Google Scholar | |
|
Malfroy, J. (2005). Doctoral supervision, workplace research and changing pedagogic practices. Higher Education Research & Development, 24(2), 165-178. Google Scholar | Crossref | |
|
Mertens, D. M. (2010). Transformative mixed methods research. Qualitative Inquiry, 16, 469-474. Google Scholar | SAGE Journals | ISI | |
|
Merton, R. K. (1957). Social theory and social structure. New York, NY: Free Press. Google Scholar | |
|
National Science Foundation . (2007). U.S. doctoral awards in science and engineering continue upward trend in 2006. Arlington, VA: Author. Google Scholar | |
|
National Science Foundation . (2010). Doctorate recipients from US universities. Arlington, VA: Author. Google Scholar | |
|
Nettles, M. T., Millett, C. M. (2006). Three magic letters: Getting to PhD. Baltimore, MD: Johns Hopkins University Press. Google Scholar | |
|
Onwuegbuzie, A. J., Bustamante, R. M., Nelson, J. A. (2010). Mixed research as a tool for developing quantitative instruments. Journal of Mixed Methods Research, 4(1), 56-78. Google Scholar | SAGE Journals | ISI | |
|
Patton, M. Q. (2002). Qualitative research & evaluation methods (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Pearson, M., Brew, A. (2002). Research Training and Supervision Development. Studies in Higher Education, 27(2), 135-150. Google Scholar | Crossref | ISI | |
|
Pruitt, F. J. (1978). The adaptation of African students to American society. International Journal of Intercultural Relations, 2, 90-118. Google Scholar | Crossref | |
|
Rossman, G. B., Rallis, S. F. (2003). Learning in the field, an introduction to qualitative research (2nd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Salomon, G., Perkins, D. N. (1998). Individual and social aspects of learning. Review of Research in Education, 23, 1-24. Google Scholar | SAGE Journals | ISI | |
|
Seidman, I. (2005). Interviewing for qualitative research: A guide for researchers in education and social sciences (3rd ed.). New York, NY: Teachers College Press. Google Scholar | |
|
Tashakkori, A., Teddlie, C. (Eds.). (2003). Handbook of mixed methods in social and behavioral research. Thousand Oaks, CA: Sage. Google Scholar | |
|
The Task Force on the Future of American Innovation . (2006, November). Measuring the moment: Innovation, national security, and economic competitiveness. Washington, DC: Author. Google Scholar | |
|
Turner, M. M. (2006). The research team concept, II: (Still) An approach to graduate training. Communication Research Reports, 23, 225-230. Google Scholar | Crossref | |
|
Van Maanen, J., Schein, E. H. (1979). Toward a theory of organizational socialization. In Staw, B., Cummings, L. L. (Eds.), Research in organizational behavior (Vol. 1, pp. 209-264). Greenwich, CT: JAI Press. Google Scholar | |
|
Ward, C., Kennedy, A. (1993). Where’s the “culture” in cross-cultural transition? Journal of Cross-Cultural Psychology, 24, 221-249. Google Scholar | SAGE Journals | ISI | |
|
Weidman, J. C., Stein, E. L. (2003). Socialization of doctoral students to academic norms. Research in Higher Education, 44, 641-656. Google Scholar | Crossref | ISI | |
|
Weidman, J. C., Twale, D. J., Stein, E. L. (2001). Socialization of graduate and professional students in higher education: A perilous passage? (Vol. 28). San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Yin, R. K. (2003). Case study research: Design and methods (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar |
