![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Conventional wisdom holds that research-productive faculty are also the finest instructors. But, is this commonly held belief correct? In the current study, the notion that faculty scholarship exhibits a positive association with teaching evaluations is investigated. Reflecting the data structure of faculty nested within university, the current study uses hierarchical linear modeling, and finds that scholarship displays a positive correspondence with teaching evaluations, but only for male faculty publishing in elite or top-tier marketing journals. Although this linkage is only found under specific conditions, it stands in contrast to much of the extant literature, which reports little to no correlation between research and teaching evaluations. In addition, significant control variables and interactions, at both the faculty level (i.e., gender, faculty title) and university level (i.e., tuition, entry GPA, flagship university), are identified. In total, the findings suggest that while there is an association between elite publications and student evaluations, the primacy of research in the academy may, nonetheless, not always be in the best interest of students.
References
Section:
|
Aiken, L. S., West, S. G. (1991). Multiple regression: Testing and interpreting interactions. Newbury Park, CA: Sage. Google Scholar | |
|
Arnold, I. J. M. (2008). Course level and the relationship between research productivity and teaching effectiveness. Journal of Economic Education, 39, 307-321. Google Scholar | Crossref | ISI | |
|
Bacon, D. R., Bean, B. (2006). GPA in research studies: An invaluable but neglected opportunity. Journal of Marketing Education, 28, 35-42. Google Scholar | SAGE Journals | |
|
Bacon, D. R., Novotny, J. (2002). Exploring achievement striving as a moderator of the grading leniency effect. Journal of Marketing Education, 24, 4-14. Google Scholar | SAGE Journals | |
|
Bacon, D. R., Paul, P., Stewart, K. A., Mukhopadhyay, K. (2012). A new tool for identifying research standards and evaluating research performance. Journal of Marketing Education, 34, 194-208. Google Scholar | SAGE Journals | |
|
Burke, L. A., Rau, B. (2010). The research-teaching gap in management. Academy of Management Learning & Education, 9, 132-143. Google Scholar | Crossref | ISI | |
|
Clayson, D. E. (2009). Student evaluations of teaching: Are they related to what students learn? A meta-analysis and review of the literature. Journal of Marketing Education, 31, 16-30. Google Scholar | SAGE Journals | |
|
Clayson, D. E. (2014). What does RateMyProfessors.com actually rate? Assessment & Evaluation in Higher Education, 39, 678-698. Google Scholar | |
|
Clayson, D. E., Frost, T. F., Sheffet, M. J. (2006). Grades and the student evaluation of instruction: A test of the reciprocity effect. Academy of Management Learning & Education, 5, 52-65. Google Scholar | Crossref | ISI | |
|
Coladarci, T., Kornfield, I. (2007). RateMyProfessors.com versus formal in-class student evaluations of teaching. Practical Assessment, Research & Evaluation, 12(6), 1-15. Google Scholar | |
|
DeVellis, R. F. (2003). Scale development: Theory and application, Thousand Oaks, CA: Sage. Google Scholar | |
|
Disatnik, D., Sivan, L. (2014). The multicollinearity illusion in moderated regression analysis. Retrieved from http://ssrn.com/abstract=2283066 Google Scholar | |
|
Estelami, H. (2014). The effects of survey timing on student evaluation of teaching measures obtained using online surveys. Journal of Marketing Education. Advance online publication. doi:10.1177/0273475314552324 Google Scholar | SAGE Journals | |
|
Feldman, K. A. (1987). Research productivity and scholarly accomplishment of college teachers as related to their instructional effectiveness: A review and exploration. Research in Higher Education, 26, 227-298. Google Scholar | Crossref | |
|
Feldman, K. A. (1993). College students’ views of male and female college teachers: Part II. Research in Higher Education, 34, 151-191. Google Scholar | Crossref | ISI | |
|
Felton, J., Koper, P. T., Mitchell, J., Stinson, M. (2008). Attractiveness, easiness and other issues: Student evaluations of professors on RateMyProfessors.com. Assessment & Evaluation in Higher Education, 33, 45-61. Google Scholar | |
|
Felton, J., Mitchell, J., Stinson, M. (2004). Web-based student evaluations of professors: The relations between perceived quality, easiness and sexiness. Assessment & Evaluation in Higher Education, 29, 91-108. Google Scholar | Crossref | |
|
Field, J. R., Bergiel, B. J., Viosca, R. C. (2008). An exploratory study of student use and perceived accuracy of faculty evaluations on RateMyProfessors.com. Competition Forum, 6, 378-383. Google Scholar | |
|
Figlio, D. N., Schapiro, M. O., Soter, K. B. (2013). Are tenure track professors better teachers? (NBER Working Paper 19406). Retrieved from http://www.nber.org/papers/w19406 Google Scholar | |
|
Freeman, H. R. (1994). Student evaluations of college instructors: Effects of type of course taught, instructor gender and gender role, and student gender. Journal of Educational Psychology, 86, 627-630. Google Scholar | Crossref | ISI | |
|
Frost, P. J., Fukami, C. V. (1997). Teaching effectiveness in the organizational sciences: Recognizing and enhancing the scholarship of teaching. Academy of Management Journal, 40, 1271-1281. Google Scholar | Crossref | ISI | |
|
Gruber, T., Lowrie, A., Brodowsky, G. H., Reppel, A. E., Voss, R., Chowdhury, I. N. (2012). Investigating the influence of professor characteristics on student satisfaction and dissatisfaction: A comparative study. Journal of Marketing Education, 34, 165-178. Google Scholar | SAGE Journals | |
|
Hair, J. F., Black, W. C., Babin, B. J., Anderson, R. E. (2010). Multivariate data analysis (7th ed.). Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Hartman, K. B., Hunt, J. B. (2013). What RateMyProfessors.com reveals about how and why students evaluated their professors: A glimpse into the student mind-set. Marketing Education Review, 23, 151-161. Google Scholar | |
|
Hattie, J., Marsh, H. W. (1996). The relationship between research and teaching: A meta-analysis. Review of Educational Research, 66, 507-542. Google Scholar | SAGE Journals | ISI | |
|
Hunter, J. E., Hunter, R. F. (1984). Validity and utility of alternative predictors of job performance. Psychological Bulletin, 96, 72-98. Google Scholar | Crossref | ISI | |
|
Johnson, V. E. (2003). Grade inflation: A crisis in college education. New York, NY: Springer-Verlag. Google Scholar | |
|
Kenward, M. G., Roger, J. H. (1997). Small sample inference for fixed effects from restricted maximum likelihood. Biometrics, 53(September), 983-997. Google Scholar | Crossref | ISI | |
|
Kierstead, D., D’Agostino, P., Dill, H. (1988). Sex role stereotyping of college professors: Bias in students’ ratings of instructors. Journal of Educational Psychology, 80, 342-344. Google Scholar | Crossref | ISI | |
|
Langbein, L. I. (1994). The validity of student evaluations of teaching. Political Science and Politics, 27, 545-553. Google Scholar | Crossref | ISI | |
|
Lawson, R. A., Stephenson, E. F. (2005). Easiness, attractiveness, and faculty evaluations: Evidence from RateMyProfessors.com. Atlantic Economic Journal, 33, 485-486. Google Scholar | |
|
Luo, Y. (2001). Determinants of local responsiveness: Perspectives from foreign subsidiaries in an emerging market. Journal of Management, 27, 451-477. Google Scholar | SAGE Journals | ISI | |
|
Luscombe, B. (2013, March 18). Don’t hate her because she’s successful. TIME Magazine. http://ideas.time.com/2013/03/07/confidence-woman/ Google Scholar | |
|
Madden, T. J., Dillon, W. R., Leak, R. L. (2010). Students’ evaluation of teaching: Concerns of item diagnosticity. Journal of Marketing Education, 32, 264-274. Google Scholar | SAGE Journals | |
|
Marsh, H. W., Hattie, J. (2002). The relation between research productivity and teaching effectiveness: Complementary, antagonistic, or independent constructs? Journal of Higher Education, 73, 603-641. Google Scholar | Crossref | ISI | |
|
Marsh, H. W., Roche, L. A. (2000). Effects of grading leniency and low workload on students’ evaluations of teaching: Popular myth, bias, validity, or innocent bystanders? Journal of Educational Psychology, 92, 202-228. Google Scholar | Crossref | ISI | |
|
McDaniel, M. A., Schmidt, F. L., Hunter, J. E. (1988). Job experience correlates of job performance. Journal of Applied Psychology, 73, 327-330. Google Scholar | Crossref | ISI | |
|
McPherson, A. M., Jewell, R. T., Kim, M. (2009). What determines student evaluation scores? A random effects analysis of undergraduate economics classes. Eastern Economic Journal, 35, 37-51. Google Scholar | Crossref | |
|
Mitra, D., Golder, P. N. (2008). Does academic research help or hurt MBA programs? Journal of Marketing, 72(5), 31-49. Google Scholar | SAGE Journals | ISI | |
|
Nunnally, J. C. (1978). Psychometric theory (2nd ed.). New York, NY: McGraw-Hill. Google Scholar | |
|
Otto, J., Sanford, D. A., Ross, D. N. (2008). Does Ratemyprofessor.com really rate my professor? Assessment & Evaluation in Higher Education, 33, 355-368. Google Scholar | |
|
Podsakoff, P. M., MacKenzie, S. B., Lee, J. Y., Podsakoff, N. P. (2003). Common method biases in behavioral research: A critical review of the literature and recommended remedies. Journal of Applied Psychology, 88, 879-903. Google Scholar | Crossref | Medline | ISI | |
|
Polonsky, M. J., Juric, B., Mankelow, G. (2003). Attitudes about work practices, time allocation, and publication output: Profiles of U.S. marketing academics. Journal of Marketing Education, 25, 218-230. Google Scholar | SAGE Journals | |
|
Pounder, J. S. (2007). Is student evaluation of teaching worthwhile? An analytical framework for answering the question. Quality Assurance in Education, 15, 178-191. Google Scholar | Crossref | |
|
Quinones, M. A., Ford, J. K., Teachout, M. S. (1995). The relationship between work experience and job performance: A conceptual meta-analytic review. Personnel Psychology, 48, 887-910. Google Scholar | Crossref | ISI | |
|
Ragan, J. F., Walia, B. (2010). Research in economic education: Differences in student evaluations of principles and other economics courses and the allocation of faculty across courses. Journal of Economic Education, 41, 335-352. Google Scholar | Crossref | ISI | |
|
Raudenbush, S. W., Bryk, A. S. (2002), Hierarchical linear models applications and data analysis methods (2nd ed.). Thousand Oaks, CA: Sage. Google Scholar | |
|
Read, W. J., Rama, D. V., Raghunandan, K. (2001). The relationship between student evaluations of teaching and faculty evaluations. Journal of Education for Business, 76, 189-192. Google Scholar | Crossref | |
|
Riniolo, T. C., Johnson, K. C., Sherman, T. R., Misso, J. A. (2006). Hot or not: Do professors perceived as physically attractive receive higher student evaluations? Journal of General Psychology, 133, 19-35. Google Scholar | Crossref | Medline | ISI | |
|
Robertson, J., Bond, C. H. (2001). Experiences of the relation between teaching and research: What do academics value? Higher Education Research and Development, 20, 5-19. Google Scholar | Crossref | |
|
Sample, S. B. (1972). Inherent conflict between research and education. Educational Record, 53, 17-22. Google Scholar | |
|
Shepherd, C. D., Carley, S. S., Stuart, R. S. (2009). An exploratory investigation of the periodic performance evaluation processes for marketing faculty: A comparison of doctoral-granting and non-doctoral-granting universities. Journal of Marketing Education, 31, 143-153. Google Scholar | SAGE Journals | |
|
Silva, K. M., Silva, F. J., Quinn, M. A., Draper, J. N., Cover, K. R., Munoff, A. A. (2008). Rate My Professor: Online evaluations of psychology instructors. Teaching of Psychology, 35, 71-80. Google Scholar | SAGE Journals | ISI | |
|
Simpson, P. M., Siguaw, J. A. (2000). Student evaluations of teaching: An exploratory study of the faculty response. Journal of Marketing Education, 22, 199-213. Google Scholar | SAGE Journals | |
|
Singer, J. D. (1998). Using SAS PROC MIXED to fit multilevel models, hierarchical models, and individual growth models. Journal of Educational and Behavioral Statistics, 24, 323-355. Google Scholar | SAGE Journals | |
|
Snijders, T. A. B., Bosker, R. J. (1999). Multilevel analysis. Thousand Oaks, CA: Sage. Google Scholar | |
|
Steward, M. D., Lewis, B. R. (2010). A comprehensive analysis of marketing journal rankings. Journal of Marketing Education, 32, 75-92. Google Scholar | SAGE Journals | |
|
Timmerman, T. (2008). On the validity of RateMyProfessors.com. Journal of Education for Business, 84, 55-61. Google Scholar |
