Abstract
Qualitative and multimethod scholars face a wide and often confusing array of alternatives for case selection using the results of a prior regression analysis. Methodologists have recommended alternatives including selection of typical cases, deviant cases, extreme cases on the independent variable, extreme cases on the dependent variable, influential cases, most similar cases, most different cases, pathway cases, and randomly sampled cases, among others. Yet this literature leaves it substantially unclear which of these approaches is best for any particular goal. Via statistical modeling and simulation, I argue that the rarely considered approach of selecting cases with extreme values on the main independent variable, as well as the more commonly discussed deviant case design, are the best alternatives for a broad range of discovery-related goals. By contrast, the widely discussed and advocated typical case, extreme-on-Y, and most similar cases approaches to case selection are much less valuable than scholars in the qualitative and multimethods research traditions have recognized to date.
References
|
Baccini, Leonardo, Urpelainen, Johannes. 2014. “International Institutions and Domestic Politics: Can Preferential Trading Agreements Help Leaders Promote Economic Reform?” Journal of Politics 76:195–214. Google Scholar | Crossref | ISI | |
|
Belsley, D. A., Kuh, E., Welsch, R. E.. 1980. Regression Diagnostics: Identifying Influential Data and Sources of Collinearity. New York: Wiley. Google Scholar | Crossref | |
|
Bennett, Andrew, Elman, Colin. 2006. “Qualitative Research: Recent Developments in Case Study Methods.” Annual Review of Political Science 9:455–76. Google Scholar | Crossref | ISI | |
|
Bowles, Samuel, Gintis, Herbert. 2002. “The Inheritance of Inequality.” Journal of Economic Perspectives 16:3–30. Google Scholar | Crossref | ISI | |
|
Bowman, Kirk, Lehoucq, Fabrice, Mahoney, James. 2005. “Measuring Political Democracy: Case Expertise, Data Adequacy, and Central America.” Comparative Political Studies 38:939–70. Google Scholar | SAGE Journals | ISI | |
|
Cameron, A. Colin, Trivedi, Pravin K.. 2005. Microeconometrics: Methods and Applications. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Chadha, S. S. 2002. “Fractional Programming with Absolute-value Functions.” European Journal of Operational Research 141:233–38. Google Scholar | Crossref | ISI | |
|
Collier, David, Brady, Henry E., Seawright, Jason. 2004. “Sources of Leverage in Causal Inference: Toward an Alternative View of Methodology.” Pp. 229–66 in Rethinking Social Inquiry: Diverse Tools, Shared Standards, edited by Brady, Henry E., Collier, David. Lanham, MD: Rowman and Littlefield. Google Scholar | |
|
Collier, David, Mahoney, James. 1996. “Insights and Pitfalls: Selection Bias in Qualitative Research.” World Politics 49:56–91. Google Scholar | Crossref | ISI | |
|
Cook, R. Dennis, Weisberg, Sanford. 1982. Residuals and Influence in Regression. New York: Chapman and Hall. Google Scholar | |
|
Coppedge, Michael . 1999. “Thickening Thin Concepts and Theories: Combining Large N and Small in Comparative Politics.” Comparative Politics 31:465–76. Google Scholar | Crossref | ISI | |
|
Dunning, Thad . 2012. Natural Experiments in the Social Sciences: A Design-based Approach. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Fearon, James D., Laitin, David D.. 2008. “Integrating Qualitative and Quantitative Methods.” Pp. 300–18 in The Oxford Handbook of Political Methodology, edited by Brady, Henry E., Box-Steffensmeier, Janet, Collier, David. New York: Oxford University Press. Google Scholar | |
|
Flyvbjerg, Bent . 2006. “Five Misunderstandings about Case-study Research.” Qualitative Inquiry 12:219–45. Google Scholar | SAGE Journals | ISI | |
|
Freedman, David A. 2009. Statistical Models: Theory and Practice. Rev. ed. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
George, Alexander L., Bennett, Andrew. 2004. Case Studies and Theory Development in the Social Sciences. Cambridge, MA: MIT Press. Google Scholar | |
|
Gerring, John . 2004. “What Is a Case Study and What Is it Good For?” American Political Science Review 98:341–54. Google Scholar | Crossref | ISI | |
|
Gerring, John . 2007a. “Is There a (Viable) Crucial-case Method?” Comparative Political Studies 40:231–53. Google Scholar | SAGE Journals | ISI | |
|
Gerring, John . 2007b. “The Mechanismic Worldview: Thinking Inside the Box.” British Journal of Political Science 38:161–79. Google Scholar | ISI | |
|
Glynn, Adam N., Ichino, Nahomi. 2015. “Using Qualitative Information to Improve Causal Inference.” American Journal of Political Science 59:1055-71. Google Scholar | |
|
Greene, William H. 2000. Econometric Analysis. 4th ed. Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Huber, John D., Stephens, Evelyne Huber. 2012. Democracy and the Left: Social Policy and Inequality in Latin America. Chicago: University of Chicago. Google Scholar | Crossref | |
|
Imai, Kosuke, Keele, Luke, Yamamoto, Teppei. 2010. “Identification, Inference and Sensitivity Analysis for Causal Mediation Effects.” Statistical Science 25:51–71. Google Scholar | Crossref | ISI | |
|
King, Gary, Keohane, Robert O., Verba, Sidney. 1994. Designing Social Inquiry: Scientific Inference in Qualitative Research. Princeton, NJ: Princeton University Press. Google Scholar | |
|
Kreuzer, Marcus . 2010. “Historical Knowledge and Quantitative Analysis: The Case of the Origins of Proportional Representation.” American Political Science Review 104:369–92. Google Scholar | Crossref | ISI | |
|
Lieberman, Evan S. 2003. Race and Regionalism in the Politics of Taxation in Brazil and South Africa. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Lieberman, Evan S. 2005. “Nested Analysis as a Mixed-method Strategy for Comparative Research.” American Political Science Review 99:435–52. Google Scholar | Crossref | ISI | |
|
Lijphart, Arend . 1971. “Comparative Politics and the Comparative Method.” American Political Science Review 65:682–93. Google Scholar | Crossref | ISI | |
|
Lijphart, Arend . 1975. “II. The Comparable-cases Strategy in Comparative Research.” Comparative Political Studies 8:158–77. Google Scholar | SAGE Journals | ISI | |
|
Morgan, Stephen L., Winship, Christopher. 2007. Counterfactuals and Causal Inference: Methods and Principles for Social Research. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Peterson, Susan . 1995. “How Democracies Differ: Public Opinion, State Structure, and the Lessons of the Fashoda Crisis.” Security Studies 5:3–37. Google Scholar | Crossref | |
|
Plumper, Thomas, Troeger, Vera E., Neumayer, Eric. 2010. “Case Selection and Causal Inference in Qualitative Research.” Unpublished Manuscript. Google Scholar | |
|
Poteete, Amy R., Janssen, Marco A., Ostrom, Elinor. 2010. Working Together: Collective Action, the Commons, and Multiple Methods in Practice. Princeton, NJ: Princeton University Press. Google Scholar | Crossref | |
|
Ragin, Charles C. 1987. The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies. Berkeley: University of California. Google Scholar | |
|
Ragin, Charles C. 2000. Fuzzy-set Social Science. Chicago: University of Chicago. Google Scholar | |
|
Ragin, Charles C. 2004. “Turning the Tables: How Case-oriented Research Challenges Variable-oriented Research.” Pp. 123–38 in Rethinking Social Inquiry: Diverse Tools, Shared Standards, edited by Brady, Henry E., Collier, David. Lanham, MD: Rowman and Littlefield. Google Scholar | |
|
Rogowski, Ronald . 2004. “How Inference in the Social (but Not the Physical) Sciences Neglects Theoretical Anomaly.” Pp. 76–83 in Rethinking Social Inquiry: Diverse Tools, Shared Standards, edited by Brady, Henry E., Collier, David. Lanham, MD: Rowman and Littlefield. Google Scholar | |
|
Rubin, Donald B. 2006. Matched Sampling for Causal Effects. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Rueschemeyer, Dietrich, Stephens, Evelyne Huber, Stephens, John D.. 1992. Capitalist Development and Democracy. Chicago: University of Chicago Press. Google Scholar | |
|
Schweller, Randall L. 1992. “Domestic Structure and Preventative War: Are Democracies More Pacific?” World Politics 44:235–69. Google Scholar | Crossref | ISI | |
|
Seawright, Jason . 2012. Party-system Collapse: The Roots of Crisis in Peru and Venezuela. Stanford, CA: Stanford University Press. Google Scholar | Crossref | |
|
Seawright, Jason, Gerring, John. 2008. “Case Selection Techniques in Case Study Research: A Menu of Qualitative and Quantitative Options.” Political Research Quarterly 61:294–308. Google Scholar | SAGE Journals | ISI | |
|
Shanno, David F., Weil, Roman L.. 1971. “Technical Note—“Linear” Programming with Absolute-value Functionals.” Operations Research 19:120–24. Google Scholar | Crossref | ISI | |
|
Small, Mario Luis . 2011. “How to Conduct a Mixed Methods Study: Recent Trends in a Rapidly Growing Literature.” Annual Review of Sociology 37:57–86. Google Scholar | Crossref | ISI | |
|
Ziblatt, Daniel . 2009. “Shaping Democratic Practice and the Causes of Electoral Fraud: The Case of Nineteenth-century Germany.” American Political Science Review 103:1–21. Google Scholar | Crossref | ISI |
