Out, damned spot: Can the “Macbeth Effect” be replicated?
https://doi.org/10.1080/01973533.2013.856792Abstract
In a much-publicized paper, Zhong and Liljenquist (2006) reported evidence that feelings of moral cleanliness are grounded in feelings of physical cleanliness: a threat to people’s moral purity leads them to seek, literally, to cleanse themselves. In an attempt to replicate and build upon these findings, we conducted a pilot study in which we unexpectedly failed to replicate the original results from the second study of Zhong and Liljenquist’s report. To investigate the source of this issue, we conducted a series of direct replications of Study 2 as reported in Zhong and Liljenquist (2006). We used the authors’ original materials and methods; we investigated samples that were more representative of the general population than in the original experiments; we investigated samples from different countries and cultures; and we substantially increased the power of our statistical tests. Nevertheless, we still failed to replicate Zhong and Liljenquist’s initial reported findings. Our research suggests that more work is needed to clarify the scope and robustness of the original results.
References (32)
- Anderson, M. L. (2010). Neural reuse: A fundamental organizational principle of the brain. Behavioral and Brain Sciences, 33, 245.
- Bargh, J. A., & Chartrand, T. L. (2000). The mind in the middle: A practical guide to priming and automaticity research. In H. T. Reis & C. M. Judd (Eds.), Handbook of research methods in social and per- sonality psychology (pp. 253-285). New York, NY: Cambridge University Press.
- Buhrmester, M., Kwang, T., & Gosling, S. D. (2011). Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data? Perspectives on Psychological Science, 6, 3-5.
- Chapman, H., & Anderson, M. L. (2013). Things rank and gross in nature: A review and synthesis of moral disgust. Psychological Bulletin, 139, 300-327.
- Earp, B. D. (2011). Do I have more free will than you do? An unex- pected asymmetry in intuitions about personal freedom. New School Psychology Bulletin, 9, 34-40.
- Earp, B. D., Jarudi, I., Hamlin, J. K., & Madva, E. N. (2008). Unexpected failure to replicate Zhong & Liljenquist (2006): Results from a pilot study. Unpublished manuscript, Department of Psychology, Yale University, New Haven, CT.
- Earp, B. D., Dill, B., Harris, J., Ackerman, J., & Bargh, J. A. (2010). Incidental exposure to no-smoking signs primes craving for ciga- rettes: An ironic effect of unconscious semantic processing? Yale Review of Undergraduate Research in Psychology, 2, 12-23.
- Eskine, K. J. (2013). Wholesome foods and wholesome morals? Organic foods reduce prosocial behavior and harshen moral judgments. Social Psychological and Personality Science, 4, 251-254.
- Faul, F., Erdfelder, E., Buchner, A., & Lang, A. G. (2009). Statistical power analyses using G*Power 3.1: Tests for correlation and regres- sion analyses. Behavior Research Methods, 41, 1149-1160.
- Fayard, J. V., Bassi, A. K., Bernstein, D. M., & Roberts, B. W. (2009). Is cleanliness next to godliness? Dispelling old wives' tales: Failure to replicate Zhong and Liljenquist (2006). Journal of Articles in Support of the Null Hypothesis, 6, 21-30.
- Francis, G. (2012). Publication bias and the failure of replication in experimental psychology. Psychonomic Bulletin & Review, 19, 975-991.
- Gámez, E., Diaz, J., & Marrero, H. (2011). The uncertain universality of the Macbeth Effect with a Spanish sample. Spanish Journal of Psychology, 14, 156-162.
- Gollwitzer, M., & Melzer A. (2012). Macbeth and the joystick: Evidence for moral cleansing after playing a violent video game. Journal of Experimental Social Psychology, 48, 1356-1360.
- Graham, J., & Haidt, J. (2010). Beyond beliefs: Religions bind individu- als into moral communities. Personality and Social Psychology Review, 14, 140-150.
- Haidt, J., & Graham, J. (2007). When morality justice: Conservatives have moral intuitions that liberals may not recognize. Social Justice Research, 20, 98-116.
- Harris, C. R., Coburn N., Rohrer D., & Pashler H. (2013). Two failures to replicate high-performance-goal priming effects. PLoS ONE 8: e72467. doi:10.1371/journal.pone.0072467
- Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world. Behavioral and Brain Sciences, 33, 61-83.
- Hoy, S. (1995). Chasing dirt: The American pursuit of cleanliness. Oxford, UK: Oxford University Press.
- Inbar, Y., Pizarro, D., Iyer, R., & Haidt, J. (2011). Disgust sensitivity, political conservatism, and voting. Social Psychological and Personality Science, 3, 537-544. doi:10.1177/1948550611429024
- Kepes, S., Banks, G. C., McDaniel, M., & Whetzel, D. L. (2012). Publication bias in the organizational sciences. Organizational Research Methods, 15, 624-662.
- Lee, S. W., & Schwarz, N. (2010). Dirty hands and dirty mouths: Embodiment of the moral-purity metaphor is specific to the motor modality involved in moral transgression. Psychological Science, 21, 1423-1425.
- Lee, S. W., & Schwarz, N. (2011). Wiping the slate clean: Psychological consequences of physical cleansing. Current Directions in Psychological Science, 20, 307-311.
- Nussbaum, M. C. (2004). Hiding from humanity: Shame, disgust, and the law. Princeton, NJ: Princeton University Press.
- Pashler, H., Coburn, N., & Harris, C. R. (2012). Priming of social dis- tance? Failure to replicate effects on social and food judg- ments. PLoS ONE 7: e42510. doi:10.1371/journal.pone.0042510
- Reuven, O., Liberman, N., & Dar, R. (2013). The effect of physical cleaning on threatened morality in individuals with obsessive- compulsive disorder. Clinical Psychological Science. doi:10.1177/ 2167702613485565
- Rosenthal, R. (1979). The file drawer problem and tolerance for null results. Psychological Bulletin, 86, 638.
- Rozin, P., Haidt, J., & McCauley, C. (2000). Disgust. In M. Lewis & J. Haviland-Jones (Eds.), Handbook of emotions (pp. 637-653). New York, NY: Guilford.
- Scargle, J. D. (2000). Publication bias: The "file-drawer" problem in scientific inference. Journal of Scientific Exploration, 14, 91-106.
- Schnall, S., Benton, J., & Harvey, S. (2008). With a clean conscience: Cleanliness reduces the severity of moral judgments. Psychological Science, 19, 1219-1222.
- Shweder, R., Much, N., Mahapatra, M., & Park, L. (1990). The "big three" of morality (autonomy, community, and divinity) and the "big three" explanations of suffering. In A. Brandt & P. Rozin (Eds.), Morality and health (pp. 119-169). New York, NY: Routledge.
- Shweder, R. A., Mahapatra, M., & Miller, J. G. (1987). Culture and moral development. In J. Kagan & S. Lamb (Eds.), The emergence of morality in young children (pp. 1-83). Chicago, IL: University of Chicago Press.
- Zhong, C., & Liljenquist, K. (2006). Washing away your sins: Threatened morality and physical cleansing. Science, 313, 1451-1452.