Abstract
When a researcher suspects that the marginal effect of on varies with , a common approach is to plot at different values of along with a pointwise confidence interval generated using the procedure described in Brambor, Clark, and Golder to assess the magnitude and statistical significance of the relationship. Our article makes three contributions. First, we demonstrate that the Brambor, Clark, and Golder approach produces statistically significant findings when at a rate that can be many times larger or smaller than the nominal false positive rate of the test. Second, we introduce the interactionTest software package for R to implement procedures that allow easy control of the false positive rate. Finally, we illustrate our findings by replicating an empirical analysis of the relationship between ethnic heterogeneity and the number of political parties from Comparative Political Studies.
References
|
Abdi, H. (2007). The Bonferonni and Sidak corrections for multiple comparisons. In Salkind, N. (Ed.), Encyclopedia of measurement and statistics (pp. 103-106). Thousand Oaks, CA: Sage. Google Scholar | |
|
Ai, C., Norton, E. C. (2003). Interaction terms in logit and probit models. Economics Letters, 80, 123-129. Google Scholar | Crossref | ISI | |
|
Amorim Neto, O., Cox, G. W. (2007). Electoral institutions, cleavage structures, and the number of parties. American Journal of Political Science, 41, 149-174. Google Scholar | Crossref | |
|
Benjamini, Y., Hochberg, Y. (1995). Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society. Series B (Methodological), 57, 289-300. Google Scholar | Crossref | |
|
Berry, W. D., DeMeritt, J. H. R., Esarey, J. (2010). Testing for interaction in binary logit and probit models: Is a product term essential? American Journal of Political Science, 54, 248-266. Google Scholar | Crossref | ISI | |
|
Berry, W. D., Golder, M., Milton, D. (2012). Improving tests of theories positing interaction. Journal of Politics, 74, 653-671. Google Scholar | Crossref | ISI | |
|
Brambor, T., Clark, W. R., Golder, M. (2006). Understanding interaction models: Improving empirical analyses. Political Analysis, 14, 63-82. Google Scholar | Crossref | ISI | |
|
Braumoeller, B. F. (2004). Hypothesis testing and multiplicative interaction terms. International Organization, 58, 807-820. Google Scholar | Crossref | ISI | |
|
Canty, A., Ripley, B. (2017). boot: Bootstrap R (S-Plus) Functions (R Package Version 1.3-19). Google Scholar | |
|
Clark, W. R., Golder, M. (2006). Rehabilitating Duverger’s theory. Comparative Political Studies, 39, 679-708. Google Scholar | SAGE Journals | ISI | |
|
Hochberg, Y. (1988). A sharper Bonferroni procedure for multiple tests of significance. Biometrika, 75, 800-802. Google Scholar | Crossref | ISI | |
|
Holm, S. (1979). A simple sequentially rejective multiple test procedure. Scandinavian Journal of Statistics, 6, 65-70. Google Scholar | ISI | |
|
Kam, C. D., Franzese, R. J. (2007). Modeling and interpreting interactive hypotheses in regression analysis. Ann Arbor: University of Michigan Press. Google Scholar | |
|
King, G., Tomz, M., Wittenberg, J. (2000). Making the most of statistical analyses: Improving interpretation and presentation. American Journal of Political Science, 44, 347-361. Google Scholar | Crossref | ISI | |
|
Kutner, M., Nachtsheim, C. J., Neter, J., Li, W. (2004). Applied linear statistical models (4th ed.). New York, NY: McGraw-Hill. Google Scholar | |
|
Lehmann, E. L. (1957a). A theory of some multiple decision problems, I. The Annals of Mathematical Statistics, 28, 1-25. Google Scholar | Crossref | |
|
Lehmann, E. L. (1957b). A theory of some multiple decision problems, II. The Annals of Mathematical Statistics, 28, 547-572. Google Scholar | Crossref | |
|
Rainey, C. (2014). Arguing for a negligible effect. American Journal of Political Science, 58, 1083-1091. Google Scholar | Crossref | ISI | |
|
R Core Team . (2017). R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing. Available from https://www.R-project.org/ Google Scholar | |
|
Rom, D. M. (1990). A sequentially rejective test procedure based on a modified Bonferroni inequality. Biometrika, 77, 663-665. Google Scholar | Crossref | ISI | |
|
Schultz, K. A. (1999). Do democratic institutions constrain or inform? Contrasting two institutional perspectives on democracy and war. International Organization, 53, 233-266. Google Scholar | Crossref | ISI | |
|
Shaffer, J. P. (1995). Multiple hypothesis testing. Annual Review of Psychology, 46, 561-584. Google Scholar | Crossref | ISI | |
|
Sidak, Z. (1967). Rectangular confidence regions for the means of multivariate normal distributions. Journal of the American Statistical Association, 62, 626-633. Google Scholar | ISI | |
|
Spahn, B., Franco, A. (2015). A false discovery framework for mitigating publication bias. Retrieved from https://wustl.app.box.com/s/7hrwt5qhi0gxsq6w34ri5cczsk3a6z75/file/119378926919 Google Scholar | |
|
Tierney, L., Rossini, A. J., Li, N., Sevcikova, H. (2015). Snow: Simple Network of Workstations (R Package Version 0.4-1). Retrieved from https://CRAN.R-project.org/package=snow Google Scholar |
