Abstract
This study investigated the relationships between graduate students' placement test scores for English as a second language (ESL) and three measures of academic performance (grade point average [GPA], faculty evaluations, and student self-assessments). Qualitative and quantitative data collection techniques (archival, questionnaires, and interviews) were used to collect data from 100 students and 55 faculty members. Although nonsignificant correlations were found between test scores and GPA, qualitative findings indicated that English skills are an important factor affecting students' course performance. Additional mixed methods analyses found that variations in students' views of academic success and their relevant background knowledge can help explain the overall insignificant relationship between ESL placement test scores and GPA. This mix of methods thus illuminated particular strands of the complex relationships between English proficiencies and graduate-level academic performance.
|
Ayers, J.B. , & Peters, R.M. (1977). Predictive validity of the Test of English as a Foreign Language for Asian graduate students in engineering, chemistry, or mathematics. Educational and Psychological Measurement , 37, 461-463. Google Scholar | SAGE Journals | ISI | |
|
Bazeley, P. (2003). Computerized data analysis for mixed methods research . In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 385-422). Thousand Oaks, CA: Sage. Google Scholar | |
|
Bellingham, L. (1993). The relationship of language proficiency to academic success for international students. New Zealand Journal of Educational Studies, 30, 229-232. Google Scholar | ISI | |
|
Brown, J.D. (2001). Using surveys in language programs. Cambridge, UK: Cambridge University Press. Google Scholar | |
|
Caracelli, V. , & Greene, J. (1993). Data analysis strategies for mixed-method evaluation designs. Educational Evaluation and Policy Analysis, 15, 195-207. Google Scholar | SAGE Journals | ISI | |
|
Cotton, F. , & Conrow, F. (1998). An investigation of the predictive validity of IELTS amongst a group of international students studying at the University of Tasmania (IELTS Research Reports 1998 Vol. 1). Google Scholar | |
|
Creswell, J.W. , Plano Clark, V.L. , Gutmann, M.L. , & Hanson, W.E. (2003). Advanced mixed methods research designs. In A. Taskakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 209-240). Thousand Oaks, CA: Sage. Google Scholar | |
|
Denham, P.A. , & Oner, J.A. (1992). IELTS research project. Validation study of listening sub-test (IDP/ IELTS commissioned report). Canberra, Australia: University of Canberra. Google Scholar | |
|
Erzberger, C. , & Kelle, U. (2003). Making inferences in mixed methods: The rules of integration. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social & behavioral research (pp. 457-488). Thousand Oaks, CA: Sage. Google Scholar | |
|
Fiocco, M. (1992). English proficiency levels of students from a non-English speaking background: A study of IELTS as an indicator of tertiary success. Unpublished research report, Curtin University of Technology, Perth, Australia. Google Scholar | |
|
Glass, G. , & Hopkins, K. (1996). Statistical methods in education and psychology . Boston: Allyn & Bacon. Google Scholar | |
|
Graham, J. (1987). English language proficiency and the prediction of academic success. TESOL Quarterly, 23, 505-521. Google Scholar | Crossref | ISI | |
|
Greene, J.C. , Benjamin, L. , & Goodyear, L. (2001). The merits of mixing methods in evaluation. Evaluation, 7(1), 25-44. Google Scholar | SAGE Journals | |
|
Greene, J.C. , Caracelli, V.J. , & Graham, W.F. (1989). Toward a conceptual framework for mixed-method evaluation designs. Educational Evaluation and Policy Analysis , 11, 255-274. Google Scholar | SAGE Journals | |
|
Hwang, K. , & Dizney, H.F. (1970). Predictive validity of the test of English as a foreign language for Chinese graduate students at an American university . Educational and Psychological Measurement, 30, 475-477. Google Scholar | SAGE Journals | ISI | |
|
Johnson, R.B. , Onwuegbuzie, A.J. , & Turner, L.A. (2007). Toward a definition of mixed methods research . Journal of Mixed Methods Research, 1(2), 112-133. Google Scholar | SAGE Journals | ISI | |
|
Jones, R. , & Michael, W. (1964). The predictive validity of a modified battery of tests in language skills for foreign students at an American university . Educational and Psychological Measurement, 14, 961-965. Google Scholar | SAGE Journals | ISI | |
|
Kerstjens, M. , & Nery, C. (2000). Predicative validity in the IELTS test: A study of the relationship between IELTS scores and students' subsequent academic performance (IELTS Research Reports 2002 Vol. 3). Google Scholar | |
|
Light, R.L. , Xu, M. , & Mossop, J. (1987). English proficiency and academic performance of international students. TESOL Quarterly, 21, 251-261. Google Scholar | Crossref | ISI | |
|
Lynch, B. , Hill, K. , & Storch, N. (1999). A comparison of IELTS and TOEFL as predictors of academic success (IELTS Research Reports 1999 Vol. 2). Google Scholar | |
|
Patton, M.Q. (2002). Qualitative research and evaluation methods (3rd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Pyo, K. ( 2001). Construct validation of an integrated-approach EAP placement test using multi-group structural equation modeling. Unpublished doctoral dissertation, University of Illinois at Urbana-Champaign. Google Scholar | |
|
Sharon, A.T. (1972). English proficiency, verbal aptitude, and foreign student success in American graduate school. Educational and Psychological Measurement, 32, 425-431. Google Scholar | SAGE Journals | ISI | |
|
Tashakkori, A. , & Teddlie, C. (Eds.). (2003). Handbook of mixed methods in social & behavioral research. Thousand Oaks, CA : Sage. Google Scholar | |
|
Upshur, J.A. (1967). English language tests and prediction of academic success. National Association of Teachers of English as a Second Language Studies and Papers, English Language Series, 13, 85-92. Google Scholar | |
|
Walters, A. (1996). A review of research into needs of English for academic purposes of relevance to the North American higher education context (Monograph Series 6). Princeton, NJ: Educational Testing Service. Google Scholar |

