Abstract
The role of emotion in moral judgment is currently a topic of much debate in moral psychology. One specific claim made by many researchers is that irrelevant feelings of disgust can amplify the severity of moral condemnation. Numerous researchers have found this effect, but there have also been several published failures to replicate it. Clarifying this issue would inform important theoretical debates among rival accounts of moral judgment. We meta-analyzed all available studies—published and unpublished—in which incidental disgust was manipulated prior to or concurrent with a moral judgment task (k = 50). We found evidence for a small amplification effect of disgust (d = 0.11), which is strongest for gustatory/olfactory modes of disgust induction. However, there is also some suggestion of publication bias in this literature, and when this is accounted for, the effect disappears entirely (d = −0.01). Moreover, prevalent confounds mean that the effect size that we estimate is best interpreted as an upper bound on the size of the amplification effect. On the basis of the results of this meta-analysis, we argue against strong claims about the causal role of affect in moral judgment and suggest a need for new, more rigorous research on this topic.
References
|
*Argo, T. N. (2013). Dirt, disorder, and deontology (Unpublished doctoral dissertation). The New School, New York, NY. Google Scholar | |
|
*Baron, J., Royzman, E. B., Goodwin, G. P. (2013). Is disgust a moralizing emotion? Exploring the sufficiency thesis. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA. Google Scholar | |
|
Bodenhausen, G. V. (1993). Emotions, arousal, and stereotypic judgments: A heuristic model of affect and stereotyping. In Mackie, D. M., Hamilton, D. L. (Eds.), Affect, cognition, and stereotyping: Interactive processes in group perception (pp. 13–37). San Diego, CA: Academic Press. Google Scholar | Crossref | |
|
Boyle, D. (Director). (1996). Trainspotting (Motion picture). London, United Kingdom: Channel Four Films. Google Scholar | |
|
*Cameron, C. D., Payne, B. K., Doris, J. M. (2013). Morality in high definition: Emotion differentiation calibrates the influence of incidental disgust on moral judgments. Journal of Experimental Social Psychology, 49, 719–725. Google Scholar | Crossref | |
|
Cannon, P. R., Schnall, S., White, M. (2011). Transgressions and expressions: Affective facial muscle activity predicts moral judgments. Social Psychological & Personality Science, 2, 325–331. Google Scholar | SAGE Journals | ISI | |
|
*Case, T. I., Oaten, M. J., Stevenson, R. J. (2012). Disgust and moral judgment. In Langdon, R., Mackenzie, C. (Eds.), Emotions, imagination, and moral reasoning (pp. 195–218). New York, NY: Psychology Press. Google Scholar | |
|
*Cerban, B., Helweg-Larsen, M. (2010). Judging smokers: How anger and disgust shape our moral beliefs. Unpublished manuscript, Dickinson College, Carlisle, PA. Google Scholar | |
|
Chapman, H. A., Anderson, A. K. (2011). Response to Royzman and Kurzban. Emotion Review, 3, 272–273. Google Scholar | SAGE Journals | |
|
Chapman, H. A., Anderson, A. K. (2014). Trait physical disgust is related to moral judgments outside of the purity domain. Emotion, 14, 341–348. Google Scholar | Crossref | Medline | ISI | |
|
Chapman, H. A., Kim, D. A., Susskind, J. M., Anderson, A. K. (2009). In bad taste: Evidence for the oral origins of moral disgust. Science, 323, 1222–1226. Google Scholar | Crossref | Medline | ISI | |
|
Cheng, J. S., Ottati, V. C., Price, E. D. (2013). The arousal model of moral condemnation. Journal of Experimental Social Psychology, 49, 1012–1018. Google Scholar | Crossref | ISI | |
|
Cohen, J. (1992). A power primer. Psychological Bulletin, 112, 155–159. Google Scholar | Crossref | Medline | ISI | |
|
*David, B., Olatunji, B. O. (2011). The effect of disgust conditioning and disgust sensitivity on appraisals of moral transgressions. Personality and Individual Differences, 50, 1142–1146. Google Scholar | Crossref | |
|
Duval, S. (2006). The trim and fill method. In Rothstein, H. R., Sutton, A. J., Borenstein, M. (Eds.), Publication bias in meta-analysis: Prevention, assessment, and adjustments (pp. 127–146). West Sussex, England: Jon Wiley & Sons. Google Scholar | Crossref | |
|
Duval, S., Tweedie, R. (2000). Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics, 56, 455–463. Google Scholar | Crossref | Medline | ISI | |
|
Egger, M., Smith, G. D., Schneider, M., Minder, C. (1997). Bias in meta-analysis detected by a simple, graphical test. British Medical Journal, 315, 629–634. Google Scholar | Crossref | Medline | |
|
Ekman, P., Friesen, W. V. (1975). Unmasking the face: A guide to recognizing emotions from facial cues. Englewood Cliffs, NJ: Prentice-Hall. Google Scholar | |
|
*Eskine, K. J. (2011). From perceptual symbols to abstraction and back again: The bitter truth about morality (Unpublished doctoral dissertation). City University of New York, New York. Google Scholar | |
|
*Eskine, K. J., Kacinik, N. A., Prinz, J. J. (2011). A bad taste in the mouth: Gustatory disgust influences moral judgments. Psychological Science, 22, 295–299. Google Scholar | SAGE Journals | |
|
Fine, C. (2006). Is the emotional dog wagging its tail, or chasing it? Philosophical Explorations, 9, 83–98. Google Scholar | Crossref | |
|
Gromet, D. M., Darley, J. M. (2011). Political ideology and reactions to crime victims: Preferences for restorative and punitive responses. Journal of Empirical Legal Studies, 8, 830–855. Google Scholar | Crossref | ISI | |
|
Haidt, J. (2001). The emotional dog and its rational tail: A social intuitionist approach to moral judgment. Psychological Review, 108, 814–834. Google Scholar | Crossref | Medline | ISI | |
|
Haidt, J., Graham, J. (2007). When morality opposes justice: Conservatives have moral intuitions that liberals may not recognize. Social Justice Research, 20, 98–116. Google Scholar | Crossref | |
|
Haidt, J., Koller, S. H., Dias, M. G. (1993). Affect, culture, and morality, or is it wrong to eat your dog? Journal of Personality and Social Psychology, 65, 613–628. Google Scholar | Crossref | Medline | ISI | |
|
*Harlé, K. M., Sanfey, A. G. (2010). Effects of approach and withdrawal motivation on interactive economic decisions. Cognition & Emotion, 24, 1456–1465. Google Scholar | Crossref | |
|
Hedges, L. V. (1981). Distribution theory for Glass’s estimator of effect size and related estimators. Journal of Educational Statistics, 6, 107–128. Google Scholar | SAGE Journals | |
|
*Horberg, E. J., Oveis, C., Keltner, D., Cohen, A. B. (2009). Disgust and the moralization of purity. Journal of Personality and Social Psychology, 97, 963–976. Google Scholar | Crossref | Medline | |
|
Hume, D. (2003). A treatise of human nature. Mineola, NY: Dover Publications. (Original work published 1739) Google Scholar | |
|
Hutcherson, C. A., Gross, J. J. (2011). The moral emotions: A social-functionalist account of anger, disgust, and contempt. Journal of Personality and Social Psychology, 100, 719–737. Google Scholar | Crossref | Medline | ISI | |
|
Inbar, Y., Pizarro, D. A., Bloom, P. (2009). Conservatives are more easily disgusted than liberals. Cognition & Emotion, 23, 714–725. Google Scholar | Crossref | ISI | |
|
*Johnson, D. J., Cheung, F., Donnellan, M. B. (2014). Does cleanliness influence moral judgments? A direct replication of Schnall, Benton, and Harvey (2008). Social Psychology, 45, 209–215. Google Scholar | Crossref | |
|
Jones, A., Fitness, J. (2008). Moral hypervigilance: The influence of disgust sensitivity in the moral domain. Emotion, 8, 613–627. Google Scholar | Crossref | Medline | ISI | |
|
Kohlberg, L. (1971). From is to ought: How to commit the naturalistic fallacy and get away with it in the study of moral development. In Mischel, T. (Ed.), Cognitive development and epistemology (pp. 151–235). New York, NY: Academic Press. Google Scholar | Crossref | |
|
Landy, J. F., Piazza, J. (2015). More than just morality: Disgust sensitivity is associated with a wide array of evaluative judgments. Manuscript submitted for publication. Google Scholar | |
|
*Lindeman, L. M. (2010). Embodied concept learning as a developmental pathway to social disgust (Unpublished doctoral dissertation). University of Wisconsin–Madison, Madison. Google Scholar | |
|
Lipsey, M. W., Wilson, D. B. (2001). Practical meta-analysis. Thousand Oaks, CA: Sage. Google Scholar | |
|
Loewenstein, G., Lerner, J. (2003). The role of affect in decision-making. In Davidson, R. J., Goldsmith, H. H., Scherer, K. R. (Eds.), Handbook of affective sciences (pp. 619–642). Oxford, England: Oxford University Press. Google Scholar | |
|
Miller, L. C., Murphy, R., Buss, A. H. (1981). Consciousness of body: Public and private. Journal of Personality and Social Psychology, 41, 397–406. Google Scholar | Crossref | |
|
Monin, B., Pizarro, D. A., Beer, J. S. (2007). Deciding versus reacting: Conceptions of moral judgment and the reason-affect debate. Review of General Psychology, 111, 99–111. Google Scholar | Crossref | |
|
*Moretti, L., Di Pellegrino, G. (2010). Disgust selectively modulates reciprocal fairness in economic interactions. Emotion, 10, 169–180. Google Scholar | Crossref | Medline | |
|
Morris, S. B., DeShon, R. P. (2002). Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. Psychological Methods, 7, 105–125. Google Scholar | Crossref | Medline | ISI | |
|
Nabi, R. L. (2002). The theoretical versus the lay meaning of disgust: Implications for emotion research. Cognition & Emotion, 16, 695–703. Google Scholar | Crossref | ISI | |
|
Oaten, M., Stevenson, R. J., Case, T. I. (2009). Disgust as a disease-avoidance mechanism. Psychological Bulletin, 135, 303–321. Google Scholar | Crossref | Medline | ISI | |
|
*O’Connor, C., Helweg-Larsen, M. (2011). The role of disgust in morality and perceptions of smoking. Unpublished manuscript, Dickinson College, Carlisle, PA. Google Scholar | |
|
*Ong, H. H., Mullette-Gillman, O. A., Kwok, K., Lim, J. (2014). Moral judgment modulation by disgust is bi-directionally moderated by individual sensitivity. Frontiers in Psychology, 5, Article 194. Google Scholar | |
|
*Piazza, J., Loughnan, S., Vauclair, C. M. (2010). [Effects of auditory and visual disgust cues on moral and non-moral judgments]. Unpublished raw data. Google Scholar | |
|
Pizarro, D. A., Inbar, Y., Helion, C. (2011). On disgust and moral judgment. Emotion Review, 3, 267–268. Google Scholar | SAGE Journals | ISI | |
|
Prinz, J. (2006). The emotional basis of moral judgments. Philosophical Explorations, 9, 29–43. Google Scholar | Crossref | |
|
Rosenthal, R., DiMatteo, M. R. (2001). Meta-analysis: Recent developments in quantitative methods for literature reviews. Annual Review of Psychology, 52, 59–82. Google Scholar | Crossref | Medline | ISI | |
|
Rozyman, E. (2014). Comment: Strohminger-McGinn: Deconstructing the moral amplification effect. Emotion Review, 6, 224–225. Google Scholar | SAGE Journals | |
|
Royzman, E. B., Atanasov, P., Landy, J. F., Parks, A., Gepty, A. (2014). CAD or MAD? Anger (not disgust) as the predominant response to pathogen-free violations of the divinity code. Emotion, 14, 892–907. Google Scholar | Crossref | Medline | ISI | |
|
Royzman, E. B., Goodwin, G. P., Leeman, R. F. (2011). When sentimental rules collide: “Norms with feelings” in the dilemmatic context. Cognition, 121, 104–114. Google Scholar | Crossref | |
|
Royzman, E. B., Kurzban, R. (2011a). Facial movements are not goosebumps: A response to Chapman and Anderson. Emotion Review, 3, 274–275. Google Scholar | SAGE Journals | |
|
Royzman, E. B., Kurzban, R. (2011b). Minding the metaphor: The elusive character of moral disgust. Emotion Review, 3, 269–271. Google Scholar | SAGE Journals | ISI | |
|
Royzman, E. B., Leeman, R. F., Baron, J. (2009). Unsentimental ethics: Towards a content-specific account of the moral-conventional distinction. Cognition, 112, 159–174. Google Scholar | Crossref | Medline | |
|
Royzman, E. B., Leeman, R. F., Sabini, J. (2008). “You make me sick”: Moral dyspepsia as a reaction to third-party sibling incest. Motivation and Emotion, 32, 100–108. Google Scholar | Crossref | ISI | |
|
Rozin, P., Haidt, J., Fincher, K. (2009). From oral to moral. Science, 323, 1179–1180. Google Scholar | Crossref | Medline | ISI | |
|
Rozin, P., Haidt, J., McCauley, C. R. (2008). Disgust. In Lewis, M., Haviland-Jones, J. M., Barrett, L. F. (Eds.), Handbook of emotions (3rd ed., pp. 757–776). New York, NY: Guilford Press. Google Scholar | |
|
Rozin, P., Lowery, L., Imada, S., Haidt, J. (1999). The CAD triad hypothesis: A mapping between three moral emotions (contempt, anger, disgust) and three moral codes (community, autonomy, divinity). Journal of Personality and Social Psychology, 76, 574–586. Google Scholar | Crossref | Medline | ISI | |
|
Russell, J. A., Fehr, B. (1994). Fuzzy concepts in a fuzzy hierarchy: Varieties of anger. Journal of Personality and Social Psychology, 67, 186–205. Google Scholar | Crossref | Medline | ISI | |
|
*Russell, P. S. (2009). Why is disgust a more unreasoned emotion than anger? An examination of the cognitive processes that accompany moral anger and disgust (Unpublished doctoral dissertation). University of Kent, Canterbury, Kent, England. Google Scholar | |
|
Russell, P. S., Giner-Sorolla, R. (2011). Moral anger, but not moral disgust, responds to intentionality. Emotion, 11, 233–240. Google Scholar | Crossref | Medline | ISI | |
|
Russell, P. S., Piazza, J., Giner-Sorolla, R. (2013). CAD revisited: Effects of the word moral on the moral relevance of disgust (and other emotions). Social Psychological & Personality Science, 4, 62–68. Google Scholar | |
|
Saltzstein, H. D., Kasachkoff, T. (2004). Haidt’s moral intuitionist theory: A psychological and philosophical critique. Review of General Psychology, 8, 273–282. Google Scholar | SAGE Journals | |
|
*Sato, A., Sugiura, Y. (2014). Dispositional mindfulness modulates automatic transference of disgust into moral judgment. Japanese Journal of Psychology, 84, 605–611. Google Scholar | Crossref | Medline | |
|
*Schnall, S., Benton, J., Harvey, S. (2008). With a clean conscience: Cleanliness reduces the severity of moral judgments. Psychological Science, 19, 1219–1222. Google Scholar | SAGE Journals | |
|
*Schnall, S., Haidt, J., Clore, G. L., Jordan, A. H. (2008). Disgust as embodied moral judgment. Personality and Social Psychology Bulletin, 34, 1096–1109. Google Scholar | SAGE Journals | |
|
Schwarz, N., Clore, G. L. (1983). Mood, misattribution, and judgments of well-being: Informative and directive functions of affective states. Journal of Personality and Social Psychology, 45, 513–523. Google Scholar | Crossref | ISI | |
|
Schwarz, N., Clore, G. L. (1988). How do I feel about it? The informative function of affective states. In Fiedler, K., Forgas, J. (Eds.), Affect, cognition, and social behavior (pp. 44–62). Toronto, Ontario, Canada: Hogrefe. Google Scholar | |
|
*Seidel, A., Prinz, J. (2013). Sound morality: Irritating and icky noises amplify judgments in divergent moral domains. Cognition, 127, 1–5. Google Scholar | Crossref | Medline | |
|
Simonsohn, U., Simmons, J., Nelson, L. (2014, December 3). [30] Trim-and-fill is full of it (bias) [Web log post]. Retrieved from http://datacolada.org/2014/12/03/30-trim-and-fill-is-full-of-it-bias-2 Google Scholar | |
|
*Singh, G. (2010). Effect of core and sociomoral disgust on moral judgments. Unpublished manuscript, California State University, Fresno, CA. Google Scholar | |
|
*Strohminger, N. (2012). The hedonics of disgust (Unpublished doctoral dissertation). University of Michigan, Ann Arbor, MI. Google Scholar | |
|
*Strohminger, N., Lewis, R. L., Schwarz, N. (2010). [Wrongness and humor of “ridiculous” moral violations]. Unpublished raw data. Google Scholar | |
|
Tetlock, P. E., Visser, P. S., Singh, R., Polifroni, M., Scott, A., Elson, S. B., . . . Rescober, P. (2007). People as intuitive prosecutors: The impact of social control goals on attributions of responsibility. Journal of Experimental Social Psychology, 43, 195–209. Google Scholar | Crossref | |
|
*Tobias, M., Helweg-Larsen, M. (2010). Judging fatness: The effects of emotion on moral judgment and moral judgment on emotion. Unpublished manuscript, Dickinson College, Carlisle, PA. Google Scholar | |
|
Travers, J. B., Norgren, R. (1986). Electromyographic analysis of the ingestion and rejection of sapid stimuli in the rat. Behavioral Neuroscience, 100, 544–555. Google Scholar | Crossref | Medline | |
|
Turiel, E. (1983). The development of social knowledge: Morality and convention. Cambridge, England: Cambridge University Press. Google Scholar | |
|
Tybur, J. M., Lieberman, D., Griskevicius, V. (2009). Microbes, mating, and morality: Individual differences in three functional domains of disgust. Journal of Personality and Social Psychology, 97, 103–122. Google Scholar | Crossref | Medline | ISI | |
|
Tybur, J. M., Lieberman, D., Kurzban, R., DeScioli, P. (2013). Disgust: Evolved function and structure. Psychological Review, 120, 65–84. Google Scholar | Crossref | Medline | ISI | |
|
Tybur, J. M., Merriman, L. A., Caldwell Hooper, A. E., McDonald, M. M., Navarrete, C. D. (2010). Extending the behavioral immune system to political psychology: Are political conservatism and disgust sensitivity really related? Evolutionary Psychology, 8, 599–616. Google Scholar | SAGE Journals | ISI | |
|
*Ugazio, G., Lamm, C., Singer, T. (2012). The role of emotions for moral judgments depends on the type of emotion and moral scenario. Emotion, 12, 579–590. Google Scholar | Crossref | Medline | |
|
*Van Dillen, L. F., van der Wal, R. C., van den Bos, K. (2012). On the role of attention and emotion in morality: Attentional control modulates unrelated disgust in moral judgments. Personality and Social Psychology Bulletin, 38, 1222–1231. Google Scholar | SAGE Journals | |
|
*Vernon, D., D’Amico, C., Glazer, K., Helweg-Larsen, M. (2012). The effect of disgust on moral judgment in Americans and Indians: Assessing the CAD hypothesis. Unpublished manuscript, Dickinson College, Carlisle, PA. Google Scholar | |
|
*Wagner, B. C. (2012). The effects of disgust on social judgment: A thought-validation perspective (Unpublished doctoral dissertation). The Ohio State University, Columbus. Google Scholar | |
|
*Wheatley, T., Haidt, J. (2005). Hypnotic disgust makes moral judgments more severe. Psychological Science, 16, 780–784. Google Scholar | SAGE Journals | |
|
*Zhong, C. B., Strejcek, B., Sivanathan, N. (2010). A clean self can render harsh moral judgment. Journal of Experimental Social Psychology, 46, 859–862. Google Scholar | Crossref | |
|
*Zickgraf, H., Kim, Y., Rozin, P. (2012). Physical cleanliness and moral decision-making: The effect of Private Body Consciousness. Unpublished manuscript, University of Pennsylvania, Philadelphia, PA. Google Scholar |
