![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Colleges of business must meet assurance of learning requirements to gain or maintain AACSB accreditation under the new standards adopted April 8, 2013. Team skills are among the most important skills desired by recruiters, yet employers and scholars perceive that team skills are frequently deficient in college graduates. This article describes how a set of free web-based tools available at www.CATME.org allows colleges to collect data to determine whether their students are developing good team skills and demonstrate achievement for accreditation reviews for learning goals related to team skills. The tools, which were developed to support teamwork in college classes, allow instructors to easily collect, interpret, and share data about students and teams. We show how colleges that use the CATME system in all courses requiring teamwork could analyze the data to demonstrate that their programs develop students’ team skills. The appendix provides 13 examples of learning goals colleges could use, along with a method to demonstrate achievement for each, and a sample measurable program target. These examples relate to team skills such as working with teammates of diverse backgrounds, contributing effectively to teams, displaying good interpersonal skills, being able to evaluate teamwork, and recognizing team processes and outcomes.
Keywords assurance of learning, accreditation, teamwork, team skills, peer evaluation
References
Section:
|
AACSB International . (2013). Eligibility procedures and accreditation standards for business accreditation (Adopted April 8, 2013). Retrieved from www.aacsb.edu Google Scholar | |
|
Alsop, R. (2002, September 9). Playing well with others. The Wall Street Journal, R11. Google Scholar | |
|
American Management Association . (2010). AMA 2010 Critical Skills Survey. Retrieved from http://www.p21.org/storage/documents/Critical%20Skills%20Survey%20Executive%20Summary.pdf Google Scholar | |
|
Bacon, D. R. (2003). A comparison of multiple-choice and short-answer questions in a marketing context. Journal of Marketing Education, 25, 31-36. Google Scholar | SAGE Journals | |
|
Bacon, D. R. (2005). The effect of group projects on content-related learning. Journal of Management Education, 29, 248-267. Google Scholar | SAGE Journals | |
|
Bacon, D. R., Stewart, K. A., Anderson, E. S. (2001). Methods of assigning players to teams: A review and novel approach. Simulation & Gaming, 32, 6-17. Google Scholar | SAGE Journals | |
|
Bacon, D. R., Stewart, K. A., Silver, W. S. (1999). Lessons from the best and worst student team experiences: How a teacher can make the difference. Journal of Management Education, 23, 467-488. Google Scholar | SAGE Journals | |
|
Baker, D. F. (2008). Peer assessment in small groups: A comparison of methods. Journal of Management Education, 33, 183-209. Google Scholar | SAGE Journals | |
|
Bamberger, P. A., Erev, I., Kimmel, M., Oref-Chen, T. (2005). Peer assessment, individual performance, and contribution to group processes: The impact of rater anonymity. Group & Organization Management, 30, 344-377. Google Scholar | SAGE Journals | ISI | |
|
Biemann, T., Cole, M. S., Voelpel, S. (2012). Within-group agreement: On the use (and misuse) of rwg and rwg(j) in leadership research and some best practice guidelines. Leadership Quarterly, 23, 66-80. Google Scholar | Crossref | ISI | |
|
Bliese, P. D. (1998). Group size, ICC values, and group-level correlations: A simulation. Organizational Research Methods, 1, 355-373. Google Scholar | SAGE Journals | ISI | |
|
Bliese, P. D. (2000). Within group agreement, non-independence and reliability: Implications for data and analysis. In Klein, K. J., Kozlowski, S. W. J. (Eds.), Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions (pp. 349-381). San Francisco: Jossey-Bass. Google Scholar | |
|
Boni, A. A., Weingart, L. R., Evenson, S. (2009). Innovation in an academic setting: Designing and leading a business through market-focused, interdisciplinary teams. Academy of Management Learning & Education, 8, 407-417. Google Scholar | Crossref | ISI | |
|
Brutus, S., Donia, M. B. (2010). Improving the effectiveness of students in groups with a centralized peer evaluation system. Academy of Management Learning & Education, 9, 652-662. Google Scholar | Crossref | ISI | |
|
Brutus, S., Donia, M. B., Ronen, S. (2013). Can business students learn to evaluate better? Evidence from repeated exposure to a peer evaluation system. Academy of Management Learning & Education, 12, 18-31. Google Scholar | Crossref | ISI | |
|
Bryant, S. M., Albring, S. M. (2006). Effective team building: Guidance for accounting educators. Issues in Accounting Education, 21, 241-265. Google Scholar | Crossref | |
|
Burdett, J. (2003). Making groups work: University students’ perceptions. International Education Journal, 4, 177-190. Google Scholar | |
|
Calloway School of Business and Accountancy of Wake Forest University . (2004, February). A report on recruiters’ perceptions of undergraduate business schools and students. Winston-Salem, NC: Author. Google Scholar | |
|
Carless, S. A., de Paola, C. (2000). The measurement of cohesion in work teams. Small Group Research, 31, 71-88. Google Scholar | SAGE Journals | ISI | |
|
Chapman, K. J., Meuter, M., Toy, D., Wright, L. (2006). Can’t we pick our own groups? The influence of group selection method on group dynamics and outcomes. Journal of Management Education, 30, 557-569. Google Scholar | SAGE Journals | |
|
Chapman, K. J., van Auken, S. (2001). Creating positive group project experiences: An examination of the role of the instructor on students’ perceptions of group projects. Journal of Marketing Education, 23, 117-127. Google Scholar | SAGE Journals | |
|
Chen, G., Donahue, L. M., Klimoski, R. J. (2004). Training undergraduates to work in organizational teams. Academy of Management Learning and Education, 3, 27-40. Google Scholar | Crossref | ISI | |
|
The Chronicle of Higher Education Almanac Issue (2009-10). 56(1), August 28, 2009. Google Scholar | |
|
Cottell, P. G., Millis, B. J. (1992). Cooperative learning in accounting. Journal of Accounting Education, 10, 95-111. Google Scholar | Crossref | |
|
Deeter-Schmelz, D. R., Kennedy, K. N., Ramsey, R. P. (2002). Enriching our understanding of student team effectiveness. Journal of Marketing Education, 24, 114-124. Google Scholar | SAGE Journals | |
|
Dillenbourg, P. (1999). What do you mean by collaborative learning? In Dillenbourg, P. (Ed.), Collaborative-learning: Cognitive and computational approaches (pp. 1-19). Oxford, England: Elsevier. Google Scholar | |
|
Dochy, F., Segers, M., Sluijsmans, D. (1999). The use of self-, peer and co-assessment in higher education: A review. Studies in Higher Education, 24, 331-350. Google Scholar | Crossref | ISI | |
|
Dominick, P. G., Reilly, R. R., McGourty, J. W. (1997). The effects of peer feedback on team member behavior. Group & Organization Management, 22, 508-520. Google Scholar | SAGE Journals | ISI | |
|
Druskat, V. U., Wolff, S. B. (1999). Effects and timing of developmental peer appraisals in self-managing work groups. Journal of Applied Psychology, 84, 58-74. Google Scholar | Crossref | Medline | ISI | |
|
Ehrlinger, J., Johnson, K., Banner, M., Dunning, D., Kruger, J. (2008). Why the unskilled are unaware: Further explorations of (absent) self-insight among the incompetent. Organizational Behavior and Human Decision Processes, 105, 98-121. Google Scholar | Crossref | Medline | ISI | |
|
Feichtner, S. B., Davis, E. A. (1984). Why some groups fail: A survey of students’ experiences with learning groups. Journal of Management Education, 9(4), 58-73. Google Scholar | SAGE Journals | |
|
Felder, R. M., Brent, R. (2001). Effective strategies for cooperative learning. Journal of Cooperation & Collaboration in College Teaching, 10, 69-75. Google Scholar | |
|
Fellenz, M. R. (2006). Toward fairness in assessing student groupwork: A protocol for peer evaluation of individual contributions. Journal of Management Education, 30, 570-591. Google Scholar | SAGE Journals | |
|
Gardiner, L. R., Corbitt, G., Adams, S. J. (2010). Program assessment: Getting to a practical how-to model. Journal of Education for Business, 85, 139-144. Google Scholar | Crossref | |
|
Gueldenzoph, L. E., May, G. L. (2002). Collaborative peer evaluation: Best practices for group member assessments. Business Communication Quarterly, 65, 9-20. Google Scholar | SAGE Journals | |
|
Hart Research Associates . (2006). How should colleges prepare students to succeed in today’s global economy? A survey of employers conducted on behalf of the Association of American Colleges and Universities. Washington, DC: Peter D. Hart Research Associates. Google Scholar | |
|
Hart Research Associates . (2010). Raising the bar: Employers’ views on college learning in the wake of the economic downturn. A survey of employers conducted on behalf of the Association of American Colleges and Universities. Washington, DC: Hart Research Associates. Google Scholar | |
|
Heidemeier, H., Moser, K. (2009). Self–other agreement in job performance ratings: A meta-analytic test of a process model. Journal of Applied Psychology, 94, 353-370. Google Scholar | Crossref | Medline | ISI | |
|
Hernandez, S. A. (2002). Team learning in a marketing principles course: Cooperative structures that facilitate active learning and higher level thinking. Journal of Marketing Education, 24, 73-85. Google Scholar | SAGE Journals | |
|
Hess, P. W. (2007). Enhancing leadership skill development by creating practice/feedback opportunities in the classroom. Journal of Management Education, 31, 195-213. Google Scholar | SAGE Journals | |
|
Hooijberg, R., Lane, N. (2009). Using multisource feedback coaching effectively in executive education. Academy of Management Learning & Education, 8, 483-493. Google Scholar | Crossref | ISI | |
|
Hughes, R. L., Jones, S. K. (2011). Developing and assessing college student teamwork skills. New Directions for Institutional Research, 2011(149), 53-64. Google Scholar | Crossref | |
|
Inderrieden, E. J., Allen, R. E., Keaveny, T. J. (2004). Managerial discretion in the use of self-ratings in an appraisal system: The antecedents and consequences. Journal of Managerial Issues, 16, 460-482. Google Scholar | |
|
Jassawalla, A., Sashittal, H., Malshe, A. (2009). Students’ perceptions of social loafing: It’s antecedents and consequences in undergraduate business classroom teams. Academy of Management Learning & Education, 8(1), 42-54. Google Scholar | Crossref | ISI | |
|
Jehn, K. A., Mannix, E. A. (2001). The dynamic nature of conflict: A longitudinal study of intragroup conflict and group performance. Academy of Management Journal, 44, 238-251. Google Scholar | Crossref | ISI | |
|
Johnson, D. W., Johnson, R. T., Smith, K. A. (2006). Active learning: Cooperation in the college classroom (3rd ed.). Edina, MN: Interaction Book. Google Scholar | |
|
Kaufman, D. B., Felder, R. M., Fuller, H. (2000). Accounting for individual effort in cooperative learning teams. Journal of Engineering Education, 8, 133-140. Google Scholar | Crossref | |
|
Kirk, D. J. (2005). Taking back the classroom: Tips for the college professor on becoming a more effective teacher. Des Moines, IA: Tiberius. Google Scholar | |
|
Klein, K. J., Kozlowski, S. W. J. (2000). Multilevel theory, research, and methods in organizations: Foundations, extensions, and new directions. San Francisco, CA: Jossey-Bass. Google Scholar | |
|
Kraiger, K. (2008). Transforming our models of learning and development: Web-based instruction as an enabler of third-generation instruction. Industrial and Organizational Psychology: Perspectives on Science and Practice, 1, 454-467. Google Scholar | Crossref | ISI | |
|
Kruger, J., Dunning, D. (1999). Unskilled and unaware of it: How difficulties in recognizing one’s own incompetence lead to inflated self-assessments. Journal of Personality and Social Psychology, 77, 1121-1134. Google Scholar | Crossref | Medline | ISI | |
|
Lancellotti, M. P., Boyd, T. (2008). The effects of team personality awareness exercises on team satisfaction and performance: The context of marketing course projects. Journal of Marketing Education, 30, 244-254. Google Scholar | SAGE Journals | |
|
Layton, R. A., Loughry, M. L., Ohland, M. W., Ricco, G. D. (2010). Design and validation of a web-based system for assigning members to teams using instructor-specified criteria. Advances in Engineering Education, 2(1), 1-28. Google Scholar | |
|
Loyd, D. L., Kern, M. C., Thompson, L. (2005). Classroom research: Bridging the ivory divide. Academy of Management Learning & Education, 4, 8-21. Google Scholar | Crossref | ISI | |
|
Loughry, M. L., Ohland, M. W., Moore, D. D. (2007). Development of a theory-based assessment of team member effectiveness. Educational and Psychological Measurement, 67, 505-524. Google Scholar | SAGE Journals | ISI | |
|
Loughry, M. L., Tosi, H. L. (2008). Performance implications of peer monitoring. Organization Science, 19, 876-890. Google Scholar | Crossref | ISI | |
|
MacDonald, H. A., Sulsky, L. M. (2009). Rating formats and rater training redux: A context-specific approach for enhancing the effectiveness of performance management. Canadian Journal of Behavioural Science, 41, 227-240. Google Scholar | Crossref | ISI | |
|
Marks, M. A., Mathieu, J. E., Zaccaro, S. J. (2001). A temporally based framework and taxonomy of team process. Academy of Management Review, 26, 356-376. Google Scholar | Crossref | ISI | |
|
Mayo, M., Kakarika, M., Pastor, J. C., Brutus, S. (2012). Aligning or inflating your leadership self-image? A longitudinal study of responses to peer feedback in MBA teams. Academy of Management Learning & Education, 11, 631-652. Google Scholar | Crossref | ISI | |
|
McCorkle, D. E., Reardon, J., Alexander, J. F., Kling, N. D., Harris, R. C., Iyer, R. V. (1999). Undergraduate marketing students, group projects, and teamwork: The good, the bad, and the ugly? Journal of Marketing Education, 21, 106-117. Google Scholar | SAGE Journals | |
|
Mero, N. P., Guidice, R. M., Brownlee, A. L. (2007). Accountability in a performance appraisal context: The effect of audience and form of accounting on rater response and behavior. Journal of Management, 33, 223-252. Google Scholar | SAGE Journals | ISI | |
|
Michaelsen, L. K., Knight, A. B., Fink, L. D. (Eds.). (2004). Team-based learning: A transformative use of small groups in college teaching. Sterling, VA: Stylus. Google Scholar | |
|
Millis, B. J., Cottell, P. G. (1998). Cooperative learning for higher education faculty. Phoenix, AZ: American Council on Education. Google Scholar | |
|
Moriarty, P., Buckley, F. (2003). Increasing team emotional intelligence through process. Journal of European Industrial Training, 27, 82-110. Google Scholar | Crossref | |
|
National Association of Colleges and Employers . (2011). Job outlook: The candidate skills/qualities employers want. Retrieved from http://www.naceweb.org/s10262011/candidate_skills_employer_qualities/ Google Scholar | |
|
Oakley, B., Felder, R. M., Brent, R., Elhajj, I. (2004). Turning student groups into effective teams. Journal of Student Centered Learning, 2, 9-34. Google Scholar | |
|
Ohland, M. W., Loughry, M. L., Layton, R. A., Lyons, R., Ferguson, D. M., Heyne, K., Driskell, T., Woehr, D. J., Pomeranz, H.R., Salas, E., Loignon, A.C., Sonesh, S. C. (2013). SMARTER Teamwork: System for Management, Assessment, Research, Training, Education, and Remediation for Teamwork. Proceedings of the 2013 American Society of Engineering Education Annual Conference & Exposition, Atlanta, GA. Google Scholar | |
|
Ohland, M. W., Loughry, M. L., Woehr, D. J., Finelli, C. J., Bullard, L. G., Felder, R. M., Schmucker, D. G. (2012). The comprehensive assessment of team member effectiveness: Development of a behaviorally anchored rating scale for self and peer evaluation. Academy of Management Learning & Education, 11, 609-630. Google Scholar | Crossref | ISI | |
|
Pfaff, E., Huddleston, P. (2003). Does it matter if I hate teamwork? What impacts student attitudes toward teamwork. Journal of Marketing Education, 25, 37-45. Google Scholar | SAGE Journals | |
|
Pope, N. K. L. (2005). The impact of stress in self- and peer assessment. Assessment & Evaluation in Higher Education, 30, 51-63. Google Scholar | Crossref | |
|
Raelin, J. (2006). Does action learning promote collaborative leadership? Academy of Management Learning and Education, 5, 152-168. Google Scholar | Crossref | ISI | |
|
Rosen, M. A., Salas, E., Pavlas, D., Jensen, R., Fu, D., Lampton, D. (2010). Demonstration-based training: A review of instructional features. Human Factors, 52, 596-609. Google Scholar | SAGE Journals | ISI | |
|
Saavedra, R., Kwun, S. K. (1993). Peer evaluation in self-managing work groups. Journal of Applied Psychology, 78, 450-462. Google Scholar | Crossref | ISI | |
|
Salas, E., Sims, D. E., Burke, C. S. (2005). Is there “big five” in teamwork? Small Group Research, 36, 555-599. Google Scholar | SAGE Journals | ISI | |
|
Salas, E., Cannon-Bowers, J. A. (2001). The science of training: A decade of progress. Annual Review of Psychology, 52, 471-499. Google Scholar | Crossref | Medline | ISI | |
|
Shankar, P. G., Seow, J. L. (2010). The association between students’ lone wolf tendencies and their perceptions, preferences, and performance outcomes in team projects. Journal of Accounting Education, 28, 75-84. Google Scholar | Crossref | |
|
Taggar, S., Brown, T. C. (2006). Interpersonal affect and peer rating bias in teams. Small Group Research, 37, 87-111. Google Scholar | SAGE Journals | ISI | |
|
Thomas, G., Martin, D., Pleasants, K. (2011). Using self- and peer-assessment to enhance students’ future-learning in higher education. Journal of University Teaching & Learning Practice, 8(1), Article 5. Google Scholar | |
|
Vance, E. (2007, February 2). College graduates lack key skills, report says. Chronicle of Higher Education, 53(22), A30. Google Scholar | |
|
Van der Vegt, G. S., Emans, B. J. M., Van de Vliert, E. (2001). Patterns of interdependence in work teams: A two-level investigation of the relations with job and team satisfaction. Personnel Psychology, 54, 51-69. Google Scholar | Crossref | ISI | |
|
Verzat, C., Byrne, J., Fayolle, A. (2009). Tangling with spaghetti: Pedagogical lessons from games. Academy of Management Learning and Education, 8, 356-369. Google Scholar | Crossref | ISI | |
|
Vik, G. N. (2001). Doing more to teach teamwork than telling students to sink or swim. Business Communication Quarterly, 64, 112-119. Google Scholar | SAGE Journals | |
|
The Wall Street Journal/Harris Interactive Survey . (2002, September 9). The rating criteria. The Wall Street Journal, p. R5. Google Scholar | |
|
Willcoxson, L. E. (2006). “It’s not fair!” Assessing the dynamics and resourcing of teamwork. Journal of Management Education, 30, 798-808. Google Scholar | SAGE Journals | |
|
Young, C. B., Henquinet, J. A. (2000). A conceptual framework for designing group projects. Journal of Education for Business, 76, 56-60. Google Scholar | Crossref | |
|
Zantow, K., Knowlton, D. S., Sharp, D. C. (2005). More than fun and games: Reconsidering the virtues of strategic management simulations. Academy of Management Learning and Education, 4, 451-458. Google Scholar | Crossref | ISI |
