![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Much has been written about the evaluation of faculty research productivity in promotion and tenure decisions, including many articles that seek to determine the rank of various marketing journals. Yet how faculty evaluators combine journal quality, quantity, and author contribution to form judgments of a scholar’s performance is unclear. A mathematical model of faculty judgment is presented that estimates a scholar’s research productivity that is surprisingly consistent with actual faculty evaluations. The model does not replace human judgment in evaluating a scholar’s research performance, but the model enhances clarity and objectivity in the evaluation process. The method is demonstrated with marketing faculty at one university.
Keywords performance evaluation, journal rankings, bootstrapping, conjoint
References
Section:
|
AACSB . (2011a). Accredited institutions. Retrieved from http://www.aacsb.edu/accreditation/AccreditedMembers.asp Google Scholar | |
|
AACSB . (2011b). Business accreditation standards. Retrieved from http://www.aacsb.edu/accreditation/business/standards/strategic_man/standard2.asp Google Scholar | |
|
Abernethy, A. M., Padgett, D. (2011). A decade of scholarship in marketing education. Journal of Marketing Education, 33, 326-336. Google Scholar | SAGE Journals | |
|
Aiman-Smith, L., Scullen, S. E., Barr, S. H. (2002). Conducting studies of decision making in organizational contexts: A tutorial for policy-capturing and other regression-based techniques. Organizational Research Methods, 5, 388-414. Google Scholar | SAGE Journals | ISI | |
|
Armstrong, J. S. (2001). Judgmental bootstrapping: Inferring experts’ rules for forecasting. In Armstrong, J. S. (Ed.), Principles of forecasting (pp. 171-192). Norwell, MA: Kluwer Academic. Google Scholar | Crossref | |
|
Bak, A., Vitell, S. J., Rose, G. M. (2000). Publications in major marketing journals: An analysis of scholars and marketing departments. Journal of Marketing Education, 22(2), 99-107. Google Scholar | SAGE Journals | |
|
Baumgartner, H., Pieters, R. (2003). The structural influence of marketing journals: A citation analysis of the discipline and its subareas over time. Journal of Marketing, 67(2), 123-139. Google Scholar | SAGE Journals | |
|
Beltramini, R. F., Schlacter, J. L., Kelly, C. (1985). Marketing faculty promotion and tenure policies and practices. Journal of Marketing Education, 7(2), 74-80. Google Scholar | SAGE Journals | |
|
Bergh, D. D., Perry, J., Hanke, R. (2006). Some predictors of SMJ article impact. Strategic Management Journal, 27, 81-100. Google Scholar | Crossref | ISI | |
|
Burnett, J. J., Amason, R. D., Cunningham, P. (1989). What makes marketing academicians successful? An assessment of teaching, publishing, and service. Journal of Marketing Education, 11(3), 7-11. Google Scholar | SAGE Journals | |
|
Coe, R. K., Weinstock, I. (1983). Evaluating journal publications of marketing professors: A second look. Journal of Marketing Education, 5(1), 37-42. Google Scholar | SAGE Journals | |
|
Darmon, R. Y., Rouzies, D. (1999). Internal validity of conjoint analysis under alternative measurement procedures. Journal of Business Research, 46(1), 67-81. Google Scholar | Crossref | |
|
Dawes, R. M. (1971). A case study of graduate admissions: Application of three principles of human decision making. American Psychologist, 26, 180-188. Google Scholar | Crossref | ISI | |
|
Dawes, R. M. (1979). The robust beauty of improper linear models in decision making. American Psychologist, 34, 571-582. Google Scholar | Crossref | ISI | |
|
Dawes, R. M., Corrigan, B. (1974). Linear models in decision making. Psychological Bulletin, 81, 95-106. Google Scholar | Crossref | ISI | |
|
Graham, M. E., Cable, D. M. (2001). Consideration of the incomplete block design for policy-capturing research. Organizational Research Methods, 4(1), 26-45. Google Scholar | SAGE Journals | ISI | |
|
Green, P. E. (1974, September). On the design of choice experiments involving multifactor alternatives. Journal of Consumer Research, 1, 61-68. Google Scholar | Crossref | ISI | |
|
Hobson, C. J., Gibson, F. W. (1983). Policy capturing as an approach to understanding and improving performance appraisal: A review of the literature. Academy of Management Review, 8, 640-649. Google Scholar | Medline | ISI | |
|
Huber, J. (1975). Boostrapping of data and decisions. Journal of Consumer Research, 2, 229-234. Google Scholar | Crossref | |
|
Hult, G. T. M., Reimann, M., Schilke, O. (2009). Worldwide faculty perceptions of marketing journals: Rankings, trends, comparisons, and segmentations. Global Edge Business Review, 3(2), 1-23. Google Scholar | |
|
Johnson, R. M. (1974, May). Trade-off analysis of consumer values. Journal of Marketing Research, 11, 121-127. Google Scholar | SAGE Journals | ISI | |
|
Karren, R. J., Barringer, M. W. (2002). A review and analysis of the policy-capturing methodology in organizational research: Guidelines for research and practice. Organizational Research Methods, 5, 337-361. Google Scholar | SAGE Journals | ISI | |
|
Locke, E. A., Latham, G. P. (2002). Building a practically useful theory of goal setting and task motivation. American Psychologist, 57, 705-717. Google Scholar | Crossref | Medline | ISI | |
|
Noble, C. H., Bentley, J. P., Campbell, D., Singh, J. J. (2010). In search of eminence: A personal brand-building perspective on the achievement of scholarly prominence in marketing. Journal of Marketing Education, 32, 314-327. Google Scholar | SAGE Journals | |
|
Polonsky, M. J. (2004). Journal rankings: Does one size fit all? Australasian Marketing Journal, 12(2), 64-66. Google Scholar | Crossref | |
|
Polonsky, M. J., Jones, G., Kearsley, M. J. (1999). Accessibility: An alternative method of ranking marketing journals? Journal of Marketing Education, 21, 181-193. Google Scholar | SAGE Journals | |
|
Seggie, S. H., Griffith, D. A. (2009). What does it take to get promoted in marketing academia? Understanding exceptional publication productivity in the leading marketing journals. Journal of Marketing, 73, 122-132. Google Scholar | SAGE Journals | ISI | |
|
Shepherd, C. D., Carley, S. S., Stuart, R. S. (2009). An exploratory investigation of the periodic performance evaluation processes for marketing faculty: A comparison of doctoral-granting and non-doctoral-granting universities. Journal of Marketing Education, 31, 143-153. Google Scholar | SAGE Journals | |
|
Shinn, S. (2008, January/February). Research re-examined. BizEd, 42-46. Google Scholar | |
|
Soutar, G. N., Murphy, J. (2009). Journal quality: A Google scholar analysis. Australasian Marketing Journal, 17, 150-153. Google Scholar | Crossref | |
|
Steward, M. D., Lewis, B. R. (2010). A comprehensive analysis of marketing journal rankings. Journal of Marketing Education, 32(1), 75-92. Google Scholar | SAGE Journals | |
|
Stewart, T. R. (2001). Improving reliability of judgmental forecasts. In Armstrong, J. S. (Ed.), Principles of forecasting (pp. 81-106). Norwell, MA: Kluwer Academic. Google Scholar | Crossref | |
|
Theoharakis, V., Hirst, A. (2002). Perceptual differences of marketing journals: A worldwide perspective. Marketing Letters, 13, 389-402. Google Scholar | Crossref | ISI | |
|
Tversky, A., Kahneman, D. (1974). Judgment under uncertainty: Heuristics and biases. Science, 185, 1124-1131. Google Scholar | Crossref | Medline | ISI | |
|
Urban, D. L., Wayland, J. P., McDermott, D. R. (1992). An empirical investigation of research standards for marketing faculty at AACSB-accredited business schools. Journal of Marketing Education, 14(2), 53-67. Google Scholar | SAGE Journals | |
|
Van Fleet, D. D., McWilliams, A., Siegel, D. S. (2000). A theoretical and empirical analysis of journal rankings: The case of formal lists. Journal of Management, 26, 839-861. Google Scholar | SAGE Journals | ISI | |
|
Wittink, D., Cattin, P. (1981, February). Alternative estimation methods for conjoint analysis: A Monte Carlo study. Journal of Marketing Research, 18, 101-106. Google Scholar | SAGE Journals | ISI | |
|
Yeh, M., Thomas, V., Weaver, T., Price, J. M. (2011). Who went where? Retrieved from http://docsig.org/WWW2011Final.pdf Google Scholar |
