Abstract
It is common for researchers discovering a significant interaction of a measured variable X with a manipulated variable Z to examine simple effects of Z at different levels of X. These “spotlight” tests are often misunderstood even in the simplest cases, and it appears that consumer researchers are unsure how to extend them to more complex designs. The authors explain the general principles of spotlight tests, show that they rely on familiar regression techniques, and provide a tutorial demonstrating how to apply these tests across an array of experimental designs. Rather than following the common practice of reporting spotlight tests at one standard deviation above and below the mean of X, it is recommended that when X has focal values, researchers should report spotlight tests at those focal values. When X does not have focal values, it is recommended that researchers report ranges of significance using a version of Johnson and Neyman's test the authors term a “floodlight.”
References
| Aiken, Leona S. , and Stephen, G. West (1991), Multiple Regression: Testing and Interpreting Interactions. Newbury Park, CA: Sage Publications. Google Scholar | |
| Blanton, Hart , and Jaccard, James (2006), “Arbitrary Metrics in Psychology,” American Psychologist, 61 (1), 27–41. Google Scholar | Crossref | Medline | |
| Churchill, Gilbert A. (1979), “A Paradigm for Developing Better Measures of Marketing Constructs,” Journal of Marketing Research, 16 (February), 64–73. Google Scholar | SAGE Journals | |
| Edwards, Jeffrey R. , and James, W. Berry (2010), “The Presence of Something or the Absence of Nothing: Increasing Theoretical Precision in Management Research,” Organizational Research Methods, 13 (4), 668–89. Google Scholar | SAGE Journals | |
| Fernbach, Philip M. , Steven, A. Sloman , Louis, Robert St. , and Julia, N. Schube (2012), “Explanation Fiends and Foes: How Mechanistic Detail Determines Understanding and Preference,” Journal of Consumer Research, 40, (published electronically December 14), [DOI:10.1086/667782]. Google Scholar | |
| Frederick, Shane (2005), “Cognitive Reflection and Decision Making,” Journal of Economic Perspectives, 19 (4), 25–42. Google Scholar | Crossref | |
| Hayes, Andrew F. (2012), “PROCESS: A Versatile Computational Tool for Observed Variable Mediation, Moderation, and Conditional Process Modeling,” white paper, The Ohio State University, (accessed January 18, 2013), [available at http://www.afhayes.com/public/process2012.pdf]. Google Scholar | |
| Hayes, Andrew F. , and Matthes, Jörg (2009), “Computational Procedures for Probing Interactions in OLS and Logistic Regression: SPSS and SAS Implementations,” Behavior Research Methods, 41 (3), 924–36. Google Scholar | Crossref | Medline | |
| Irwin, Julie R. , and Gary, H. McClelland (2001), “Misleading Heuristics and Moderated Multiple Regression Models,” Journal of Marketing Research, 38 (February), 100–109. Google Scholar | SAGE Journals | |
| Irwin, Julie R. (2003), “Negative Effects of Dichotomizing Continuous Predictor Variables,” Journal of Marketing Research, 40 (August), 366–71. Google Scholar | SAGE Journals | |
| Jaccard, James , Guilamo-Ramos, Vincent , Johansson, Margaret , and Bouris, Alida (2006), “Multiple Regression Analyses in Clinical Child and Adolescent Psychology,” Journal of Clinical Child & Adolescent Psychology, 35 (3), 456–79. Google Scholar | Crossref | Medline | |
| Jaccard, James , Turrisi, Robert , and Choi, K. Wan (1990), Interaction Effects in Multiple Regression. Thousand Oaks, CA: Sage Publications. Google Scholar | |
| Johnson, Palmer O. , and Neyman, Jerzy (1936), “Tests of Certain Linear Hypotheses and Their Application to Some Educational Problems,” Statistical Research Memoirs, 1, 57–93. Google Scholar | |
| Judd, Charles M. , Gary, H. McClelland , and Carey, S. Ryan (2009), Data Analysis: A Model Comparison Approach, 2d ed. New York: Routledge. Google Scholar | |
| Keppel, Geoffrey , and Thomas, D. Wickens (2004), Design and Analysis: A Researcher's Handbook. New York: Pearson. Google Scholar | |
| Leclerc, France , and John, D.C. Little (1997), “Can Advertising Copy Make FSI Coupons More Effective?” Journal of Consumer Research, 34 (4), 473–84. Google Scholar | Abstract | |
| MacCallum, Robert C. , Zhang, Shaobo , Kristopher, J. Preacher , and Derek, D. Rucker (2002), “On the Practice of Dichotomization of Quantitative Variables,” Psychological Methods, 7 (1), 19–40. Google Scholar | Crossref | Medline | |
| Maxwell, Scott E. , and Harold, D. Delaney (1993), “Bivariate Median Splits and Spurious Statistical Significance,” Psychological Bulletin, 113 (1), 181–90. Google Scholar | Crossref | |
| McClelland, Gary , and John, G. Lynch (2012), “Power Considerations in Simple Effects Tests in Moderated Regression,” working paper, University of Colorado Boulder. Google Scholar | |
| McFerran, Brent , Darren, W. Dahl , Gavan, J. Fitzsimons , and Andrea, C. Morales (2010), “I'll Have What She's Having: Effects of Social Influence and Body Type on the Food Choices of Others,” Journal of Consumer Research, 36 (6), 915–29. Google Scholar | Crossref | |
| Mohr, Gina S. , Donald, R. Lichtenstein , and Janiszewski, Chris (2012), “The Effect of Marketer-Suggested Serving Size on Consumer Responses: The Unintended Consequences of Consumer Attention to Calorie Information,” Journal of Marketing, 76 (January), 59–75. Google Scholar | SAGE Journals | |
| Nickerson, Carol , Schwarz, Norbert , Diener, Ed , and Kahneman, Daniel (2003), “Zeroing in on the Dark Side of the American Dream: A Closer Look at the Negative Consequences of the Goal for Financial Success,” Psychological Science, 14 (6), 531–36. Google Scholar | SAGE Journals | |
| Potthoff, Richard F. (1964), “On the Johnson–Neyman Technique and Some Extensions Thereof,” Psychometrika, 29 (3), 241–56. Google Scholar | Crossref | |
| Preacher, Kristopher J. , Patrick, J. Curran , and Daniel, J. Bauer (2006), “Computational Tools for Probing Interactions in Multiple Linear Regression, Multilevel Modeling, and Latent Curve Analysis,” Journal of Educational and Behavioral Statistics, 31 (3), 437–48. Google Scholar | SAGE Journals | |
| Rogosa, David (1980), “Comparing Nonparallel Regression Lines,” Psychological Bulletin, 88 (2), 307–321. Google Scholar | Crossref | |
| Rogosa, David (1981), “On the Relation Between the Johnson–Neyman Region of Significance and the Statistical Test of Nonparallel Within-Group Regressions,” Educational and Psychological Measurement, 41 (1), 73–84. Google Scholar | SAGE Journals | |
| Spiller, Stephen A. (2011), “Opportunity Cost Consideration,” Journal of Consumer Research, 38 (4), 595–610. Google Scholar | Crossref | |
| Vargha, András , Rudas, Tamás , Harold, D. Delaney , and Scott, E. Maxwell (1996), “Dichotomization, Partial Correlation, and Conditional Independence,” Journal of Educational and Behavioral Statistics, 21 (3), 264–82. Google Scholar | SAGE Journals |
