![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
What factors affect a scientist’s choice of research problem? Qualitative research in the history and sociology of science suggests that this choice is patterned by an “essential tension” between productive tradition and risky innovation. We examine this tension through Bourdieu’s field theory of science, and we explore it empirically by analyzing millions of biomedical abstracts from MEDLINE. We represent the evolving state of chemical knowledge with networks extracted from these abstracts. We then develop a typology of research strategies on these networks. Scientists can introduce novel chemicals and chemical relationships (innovation) or delve deeper into known ones (tradition). They can consolidate knowledge clusters or bridge them. The aggregate distribution of published strategies remains remarkably stable. High-risk innovation strategies are rare and reflect a growing focus on established knowledge. An innovative publication is more likely to achieve high impact than a conservative one, but the additional reward does not compensate for the risk of failing to publish. By studying prizewinners in biomedicine and chemistry, we show that occasional gambles for extraordinary impact are a compelling explanation for observed levels of risky innovation. Our analysis of the essential tension identifies institutional forces that sustain tradition and suggests policy interventions to foster innovation.
References
|
Abbott, Andrew D. 1999. Department & Discipline: Chicago Sociology at One Hundred. Chicago: University of Chicago Press. Google Scholar | |
|
Abbott, Andrew D. 2001. Chaos of Disciplines. Chicago: University of Chicago Press. Google Scholar | |
|
Albert, Mathieu, Kleinman, Daniel Lee. 2011. “Bringing Pierre Bourdieu to Science and Technology Studies.” Minerva 49(3):263–73. Google Scholar | Crossref | ISI | |
|
Austerweil, Joseph L., Abbott, Joshua T., Griffiths, Thomas L. 2012. “Human Memory Search as a Random Walk in a Semantic Network.” Pp. 3041–49 in Advances in Neural Information Processing Systems 25, edited by Pereira, F., Burges, C. J. C., Bottou, L., Weinberger, K. Q. Curran Associates, Inc. Google Scholar | |
|
Azoulay, Pierre, Ding, Waverly, Stuart, Toby. 2009. “The Impact of Academic Patenting on the Rate, Quality and Direction of (Public) Research Output.” Journal of Industrial Economics 57(4):637–76. Google Scholar | Crossref | ISI | |
|
Azoulay, Pierre, Graff Zivin, Joshua S., Manso, Gustavo. 2011. “Incentives and Creativity: Evidence from the Academic Life Sciences.” RAND Journal of Economics 42(3):527–54. Google Scholar | Crossref | |
|
Azoulay, Pierre, Stuart, Toby, Wang, Yanbo. 2013. “Matthew: Effect or Fable?” Management Science 60(1):92–109. Google Scholar | Crossref | |
|
Baldi, Stéphane . 1998. “Normative versus Social Constructivist Processes in the Allocation of Citations: A Network-Analytic Model.” American Sociological Review 63(6):829–46. Google Scholar | Crossref | ISI | |
|
Barabási, Albert-László, Albert, Réka. 1999. “Emergence of Scaling in Random Networks.” Science 286(5439):509–512. Google Scholar | Crossref | Medline | ISI | |
|
Bateman, Thomas S., Hess, Andrew M. 2015. “Different Personal Propensities among Scientists Relate to Deeper vs. Broader Knowledge Contributions.” Proceedings of the National Academy of Sciences 112(12):3653–58. Google Scholar | Medline | |
|
Berman, Elizabeth Popp . 2008. “Why Did Universities Start Patenting? Institution-Building and the Road to the Bayh-Dole Act.” Social Studies of Science 38(6):835–71. Google Scholar | SAGE Journals | ISI | |
|
Berman, Elizabeth Popp . 2012. “Explaining the Move toward the Market in US Academic Science: How Institutional Logics Can Change without Institutional Entrepreneurs.” Theory and Society 41(3):261–99. Google Scholar | Crossref | ISI | |
|
Bourdieu, Pierre . 1975. “The Specificity of the Scientific Field and the Social Conditions for the Progress of Reason.” Social Science Information 14(6):19–47. Google Scholar | SAGE Journals | |
|
Bourdieu, Pierre . 1984. Distinction: A Social Critique of the Judgement of Taste. New York: Routledge. Google Scholar | |
|
Bourdieu, Pierre . 1986. “The Forms of Capital.” Pp. 241–58 in Handbook of Theory and Research for the Sociology of Education, edited by Richardson, J. New York: Greenwood. Google Scholar | |
|
Bourdieu, Pierre . 1990. The Logic of Practice. Stanford, CA: Stanford University Press. Google Scholar | |
|
Bourdieu, Pierre . 1991. “The Peculiar History of Scientific Reason.” Sociological Forum 6(1):3–26. Google Scholar | Crossref | ISI | |
|
Bourdieu, Pierre . 2004. Science of Science and Reflexivity. Chicago: University of Chicago Press. Google Scholar | |
|
Bruggeman, Jeroen, Traag, V. A., Uitermark, Justus. 2012. “Detecting Communities through Network Data.” American Sociological Review 77(6):1050–63. Google Scholar | SAGE Journals | |
|
Busch, Lawrence, Lacy, William B., Sachs, Carolyn. 1983. “Perceived Criteria for Research Problem Choice in the Agricultural Sciences: A Research Note.” Social Forces 62(1):190–200. Google Scholar | |
|
Callon, Michel, Law, John, Rip, Arie. 1986. Mapping the Dynamics of Science and Technology: Sociology of Science in the Real World. Basingstoke, UK: Macmillan. Google Scholar | Crossref | |
|
Camic, Charles . 2011. “Bourdieu’s Cleft Sociology of Science.” Minerva 49(3):275–93. Google Scholar | Crossref | ISI | |
|
Camic, Charles . 2013. “Bourdieu’s Two Sociologies of Knowledge.” Pp. 183–214 in Bourdieu and Historical Analysis, edited by Gorski, P. S. Durham, NC: Duke University Press. Google Scholar | |
|
Chen, Chaomei, Chen, Yue, Horowitz, Mark, Hou, Haiyan, Liu, Zeyuan, Pellegrino, Donald. 2009. “Towards an Explanatory and Computational Theory of Scientific Discovery.” Journal of Informetrics 3(3):191–209. Google Scholar | Crossref | |
|
Cokol, Murat, Iossifov, Ivan, Weinreb, Chani, Rzhetsky, Andrey. 2005. “Emergent Behavior of Growing Knowledge about Molecular Interactions.” Nature Biotechnology 23(10):1243–47. Google Scholar | Crossref | Medline | |
|
Cokol, Murat, Rodriguez-Esteban, Raul, Rzhetsky, Andrey. 2007. “A Recipe for High Impact.” Genome Biology 8(5):406. Google Scholar | Crossref | Medline | |
|
Cover, Thomas M., Thomas, Joy A. 1991. Elements of Information Theory. New York: Wiley. Google Scholar | Crossref | |
|
Cowen, Tyler . 2011. The Great Stagnation: How America Ate All The Low-Hanging Fruit of Modern History, Got Sick, and Will (Eventually) Feel Better. New York: Dutton Adult. Google Scholar | |
|
Cronin, Blaise, Atkins, Helen Barsky, eds. 2000. The Web of Knowledge: A Festschrift in Honor of Eugene Garfield. Medford, NJ: Information Today. Google Scholar | |
|
Davis, Lee, Larsen, Maria Theresa, Lotz, Peter. 2011. “Scientists’ Perspectives Concerning the Effects of University Patenting on the Conduct of Academic Research in the Life Sciences.” Journal of Technology Transfer 36(1):14–37. Google Scholar | Crossref | |
|
Diamond, Arthur M. 1994. “The Determinants of a Scientist’s Choice of Research Projects.” Pp. 167–210 in Scientific Failure, edited by Horowitz, T., Janis, A. I. Lanham, MD: Rowman & Littlefield. Google Scholar | |
|
Ding, Waverly W., Murray, Fiona, Stuart, Toby E. 2006. “Gender Differences in Patenting in the Academic Life Sciences.” Science 313(5787):665–67. Google Scholar | Crossref | Medline | |
|
Evans, James A. 2010a. “Industry Collaboration, Scientific Sharing and the Dissemination of Knowledge.” Social Studies of Science 40(5):757–91. Google Scholar | SAGE Journals | ISI | |
|
Evans, James A. 2010b. “Industry Induces Academic Science to Know Less about More.” American Journal of Sociology 116(2):389 –452. Google Scholar | Crossref | ISI | |
|
Evans, James A., Foster, Jacob G. 2011. “Metaknowledge.” Science 331(6018):721–25. Google Scholar | Crossref | Medline | ISI | |
|
Evans, James A., Rzhetsky, Andrey. 2011. “Advancing Science through Mining Libraries, Ontologies, and Communities.” Journal of Biological Chemistry 286(27):23659–66. Google Scholar | Crossref | Medline | |
|
Fleming, Lee . 2001. “Recombinant Uncertainty in Technological Search.” Management Science 47(1):117–32. Google Scholar | Crossref | ISI | |
|
Fleming, Lee, Mingo, Santiago, Chen, David. 2007. “Collaborative Brokerage, Generative Creativity, and Creative Success.” Administrative Science Quarterly 52(3):443–75. Google Scholar | SAGE Journals | ISI | |
|
Fleming, Lee, Sorenson, Olav. 2004. “Science as a Map in Technological Search.” Strategic Management Journal 25(8–9):909–28. Google Scholar | Crossref | ISI | |
|
Foote, Richard . 2007. “Mathematics and Complex Systems.” Science 318(5849):410–12. Google Scholar | Crossref | Medline | |
|
Frickel, Scott, Gross, Neil. 2005. “A General Theory of Scientific/Intellectual Movements.” American Sociological Review 70(2):204–232. Google Scholar | SAGE Journals | ISI | |
|
Funk, Russell J., Owen-Smith, Jason. 2012. “A Dynamic Network Approach to Breakthrough Innovation.” arXiv:1212.3559 [physics], December (http://arxiv.org/abs/1212.3559). Google Scholar | |
|
Gertner, Jon . 2012. The Idea Factory: Bell Labs and the Great Age of American Innovation. New York: Penguin. Google Scholar | |
|
Gibbons, Michael, Limoges, Camille, Nowotny, Helga, Schwartzman, Simon, Scott, Peter, Trow, Martin. 1994. The New Production of Knowledge: The Dynamics of Science and Research in Contemporary Societies. Thousand Oaks, CA: Sage. Google Scholar | |
|
Gieryn, Thomas F. 1978. “Problem Retention and Problem Change in Science.” Sociological Inquiry 48(3–4):96–115. Google Scholar | Crossref | |
|
Goodman, Leo A. 1965. “On Simultaneous Confidence Intervals for Multinomial Proportions.” Technometrics 7(2):247–54. Google Scholar | Crossref | |
|
Griffiths, Thomas L., Steyvers, Mark, Firl, Alana. 2007. “Google and the Mind: Predicting Fluency with PageRank.” Psychological Science 18(12):1069–76. Google Scholar | SAGE Journals | |
|
Guetzkow, Joshua, Lamont, Michèle, Mallard, Grégoire. 2004. “What Is Originality in the Humanities and the Social Sciences?” American Sociological Review 69(2):190–212. Google Scholar | SAGE Journals | ISI | |
|
Guimerà, Roger, Uzzi, Brian, Spiro, Jarrett, Nunes Amaral, Luís A. 2005. “Team Assembly Mechanisms Determine Collaboration Network Structure and Team Performance.” Science 308(5722):697–702. Google Scholar | Crossref | Medline | |
|
Hargadon, Andrew, Sutton, Robert I. 1997. “Technology Brokering and Innovation in a Product Development Firm.” Administrative Science Quarterly 42(4):716–49. Google Scholar | Crossref | ISI | |
|
Hausman, Jerry, Hall, Bronwyn H., Griliches, Zvi. 1984. “Econometric-Models for Count Data with an Application to the Patents–R&D Relationship.” Econometrica 52(4):909–938. Google Scholar | Crossref | |
|
Hebb, Donald O. 1949. The Organization of Behavior. New York: Wiley & Sons. Google Scholar | |
|
Hedström, Peter . 2005. Dissecting the Social: On the Principles of Analytical Sociology. Cambridge, UK: Cambridge University Press. Google Scholar | Crossref | |
|
Ioannidis, John P. A. 2005a. “Why Most Published Research Findings Are False.” PLoS Med 2(8):e124. Google Scholar | Crossref | Medline | ISI | |
|
Ioannidis, John P. A. 2005b. “Contradicted and Initially Stronger Effects in Highly Cited Research.” Journal of the American Medical Association 294(2):218–28. Google Scholar | Crossref | Medline | |
|
Kevles, Daniel J. 1978. The Physicists: The History of a Scientific Community in Modern America, 1st ed. New York: Knopf. Google Scholar | |
|
Kim, Kyung-Man . 2009. “What Would a Bourdieuan Sociology of Scientific Truth Look Like?” Social Science Information 48(1):57–79. Google Scholar | SAGE Journals | ISI | |
|
Kleinberg, Jon, Oren, Sigal. 2011. “Mechanisms for (Mis)Allocating Scientific Credit.” Pp. 529–38 in Proceedings of the Forty-Third Annual ACM Symposium on Theory of Computing. New York: ACM. Google Scholar | Crossref | |
|
Knorr-Cetina, Karin . 1999. Epistemic Cultures: How the Sciences Make Knowledge. Cambridge, MA: Harvard University Press. Google Scholar | |
|
Kuhn, Thomas S. [1959] 1977. “The Essential Tension: Tradition and Innovation in Scientific Research.” Pp. 162–74 in The Third (1959) University of Utah Research Conference on the Identification of Scientific Talent, edited by Taylor, C.W. Salt Lake City: University of Utah Press. Reprint, pp. 225–39 in The Essential Tension: Selected Studies in Scientific Tradition and Change. Chicago: University of Chicago Press. Google Scholar | |
|
Kuhn, Thomas S. 1962. The Structure of Scientific Revolutions. Chicago: University of Chicago Press. Google Scholar | |
|
Lamont, Michèle . 2009. How Professors Think: Inside the Curious World of Academic Judgment. Cambridge, MA: Harvard University Press. Google Scholar | Crossref | |
|
Lancichinetti, Andrea, Fortunato, Santo. 2009. “Community Detection Algorithms: A Comparative Analysis.” Physical Review E 80(5):056117. Google Scholar | Crossref | |
|
Latour, Bruno . 1987. Science in Action: How to Follow Scientists and Engineers through Society. Cambridge, MA: Harvard University Press. Google Scholar | |
|
Lawrence, Paul R., Lorsch, Jay William. 1969. Organization and Environment: Managing Differentiation and Integration. Homewood, IL: R. D. Irwin. Google Scholar | |
|
Leahey, Erin, Beckman, Christine, Stanko, Taryn. 2013. “Prominent but Less Productive: The Impact of Interdisciplinarity on Scientists’ Research.” Working paper. Google Scholar | |
|
Leahey, Erin, Moody, James. 2014. “Sociological Innovation through Subfield Integration.” Social Currents 1(3):228–56. Google Scholar | SAGE Journals | |
|
Malmgren, R. Dean, Ottino, Julio M., Nunes Amaral, Luís A. 2010. “The Role of Mentorship in Protege Performance.” Nature 465(7298):622–26. Google Scholar | Crossref | Medline | |
|
March, James G. 1991. “Exploration and Exploitation in Organizational Learning.” Organization Science 2(1):71–87. Google Scholar | Crossref | ISI | |
|
Menczer, Filippo . 2004. “Evolution of Document Networks.” Proceedings of the National Academy of Sciences USA 101(Suppl. 1, April):5261–65. Google Scholar | Crossref | Medline | |
|
Merton, Robert K. 1938. “Science, Technology and Society in Seventeenth Century England.” Osiris: Studies on the History and Philosophy of Science, and on the History of Learning and Culture 4(1938):362–632. Google Scholar | |
|
Merton, Robert K. 1942. “Science and Technology in a Democratic Order.” Journal of Legal and Political Sociology 1(1):115–26. Google Scholar | |
|
Merton, Robert K. 1949. Social Theory and Social Structure: Toward the Codification of Theory and Research. Glencoe, IL: Free Press. Google Scholar | |
|
Merton, Robert K. 1957. “Priorities in Scientific Discovery: A Chapter in the Sociology of Science.” American Sociological Review 22(6):635–59. Google Scholar | Crossref | ISI | |
|
Merton, Robert K. 1968. “The Matthew Effect in Science.” Science 159(3810):56–63. Google Scholar | Crossref | Medline | ISI | |
|
Merton, Robert K. 1973. The Sociology of Science: Theoretical and Empirical Investigations. Chicago: University of Chicago Press. Google Scholar | |
|
Merton, Robert K. 1988. “The Matthew Effect in Science, II: Cumulative Advantage and the Symbolism of Intellectual Property.” Isis 79(299):606–623. Google Scholar | Crossref | |
|
Merton, Robert K., Barber, Elinor. 2011. The Travels and Adventures of Serendipity: A Study in Sociological Semantics and the Sociology of Science. Princeton, NJ: Princeton University Press. Google Scholar | |
|
Moses, Hamilton, Dorsey, E. Ray, Matheson, David H. M., Thier, Samuel O. 2005. “Financial Anatomy of Biomedical Research.” Journal of the American Medical Association 294(11):1333–42. Google Scholar | Crossref | Medline | |
|
Mowery, David C., Nelson, Richard R., Sampat, Bhaven N., Ziedonis, Arvids A. 2001. “The Growth of Patenting and Licensing by U.S. Universities: An Assessment of the Effects of the Bayh-Dole Act of 1980.” Research Policy 30(1):99–119. Google Scholar | Crossref | ISI | |
|
Murray, Fiona, Stern, Scott. 2007. “Do Formal Intellectual Property Rights Hinder the Free Flow of Scientific Knowledge? An Empirical Test of the Anti-Commons Hypothesis.” Journal of Economic Behavior & Organization 63(4):648–87. Google Scholar | Crossref | |
|
Newell, Allen, Simon, Herbert Alexander. 1972. Human Problem Solving. Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Newman, M. E. J. 2003. “The Structure and Function of Complex Networks.” SIAM Review 45(2):167–256. Google Scholar | Crossref | ISI | |
|
Nowotny, Helga, Scott, Peter, Gibbons, Michael. 1994. The New Production of Knowledge: The Production of Science and Research in Contemporary Societies. London, UK: Sage Publications. Google Scholar | |
|
Onnela, J.-P., Saramäki, J., Hyvönen, J., Szabó, G., Lazer, D., Kaski, K., Kertész, J., Barabási, A.-L. 2007. “Structure and Tie Strengths in Mobile Communication Networks.” Proceedings of the National Academy of Sciences 104(18):7332–36. Google Scholar | Crossref | Medline | |
|
Panofsky, Aaron L. 2011. “Field Analysis and Interdisciplinary Science: Scientific Capital Exchange in Behavior Genetics.” Minerva 49(3):295–316. Google Scholar | Crossref | ISI | |
|
Polanyi, Michael . 1969. Knowing and Being: Essays by Michael Polanyi, edited by M. Grene. Chicago: University of Chicago Press. Google Scholar | |
|
Powell, Walter W., Owen-Smith, Jason. 1998. “Universities and the Market for Intellectual Property in the Life Sciences.” Journal of Policy Analysis and Management 17(2):253–77. Google Scholar | Crossref | ISI | |
|
Quesenberry, C. P., Hurst, D. C. 1964. “Large Sample Simultaneous Confidence Intervals for Multinomial Proportions.” Technometrics 6(2):191–95. Google Scholar | Crossref | |
|
Rosenthal, Robert . 1979. “The File Drawer Problem and Tolerance for Null Results.” Psychological Bulletin 86(3):638–41. Google Scholar | Crossref | ISI | |
|
Rossman, Gabriel, Schilke, Oliver. 2014. “Close, But No Cigar: The Bimodal Rewards to Prize-Seeking.” American Sociological Review 79(1):86–108. Google Scholar | SAGE Journals | ISI | |
|
Rosvall, Martin, Axelsson, D., Bergstrom, Carl T. 2009. “The Map Equation.” European Physical Journal Special Topics 178(1):13–23. Google Scholar | Crossref | |
|
Rosvall, Martin, Bergstrom, Carl T. 2008. “Maps of Random Walks on Complex Networks Reveal Community Structure.” Proceedings of the National Academy of Sciences, USA 105(4):1118–23. Google Scholar | Crossref | Medline | ISI | |
|
Rosvall, Martin, Bergstrom, Carl T. 2010. “Mapping Change in Large Networks.” PLoS ONE 5(1):e8695. Google Scholar | Crossref | Medline | |
|
Shapin, Steven . 1995. “Here and Everywhere: Sociology of Scientific Knowledge.” Annual Review of Sociology 21(January):289–321. Google Scholar | Crossref | |
|
Shi, Feng, Foster, Jacob G., Evans, James A. 2015. “Weaving the Fabric of Science: Dynamic Network Models of Science’s Unfolding Structure.” Social Networks 43(October):73–85. Google Scholar | Crossref | |
|
Shwed, Uri, Bearman, Peter S. 2010. “The Temporal Structure of Scientific Consensus Formation.” American Sociological Review 75(6):817–40. Google Scholar | SAGE Journals | ISI | |
|
Smalheiser, Neil R., Torvik, Vetle I. 2009. “Author Name Disambiguation.” Annual Review of Information Science and Technology 43(1):1–43. Google Scholar | Crossref | |
|
Stuart, Toby E., Ding, Waverly W. 2006. “When Do Scientists Become Entrepreneurs? The Social Structural Antecedents of Commercial Activity in the Academic Life Sciences.” American Journal of Sociology 112(1):97–144. Google Scholar | Crossref | Medline | ISI | |
|
Swanson, Don R. 1990. “Medical Literature as a Potential Source of New Knowledge.” Bulletin of the Medical Library Association 78(1):29–37. Google Scholar | Medline | |
|
Thursby, Jerry G., Thursby, Marie C. 2011. “Has the Bayh-Dole Act Compromised Basic Research?” Research Policy 40(8):1077–83. Google Scholar | Crossref | ISI | |
|
Uzzi, Brian, Mukherjee, Satyam, Stringer, Michael, Jones, Ben. 2013. “Atypical Combinations and Scientific Impact.” Science 342(6157):468–72. Google Scholar | Crossref | Medline | |
|
Vallas, Steven Peter, Kleinman, Daniel Lee. 2008. “Contradiction, Convergence and the Knowledge Economy: The Confluence of Academic and Commercial Biotechnology.” Socio-Economic Review 6(2):283–311. Google Scholar | Crossref | |
|
Washburn, Jennifer . 2005. University, Inc.: The Corporate Corruption of American Higher Education. New York: Basic Books. Google Scholar | |
|
Weisberg, Michael, Muldoon, Ryan. 2009. “Epistemic Landscapes and the Division of Cognitive Labor.” Philosophy of Science 76(2):225–52. Google Scholar | Crossref | |
|
Whitley, Richard . 2000. The Intellectual and Social Organization of the Sciences. Oxford, UK: Oxford University Press. Google Scholar | |
|
Woolf, Steven H. 2008. “The Meaning of Translational Research and Why It Matters.” Journal of the American Medical Association 299(2):211–13. Google Scholar | Crossref | Medline | ISI | |
|
Wright, Brian D. 1983. “The Economics of Invention Incentives: Patents, Prizes, and Research Contracts.” American Economic Review 73(4):691–707. Google Scholar | |
|
Wuchty, Stefan, Jones, Benjamin F., Uzzi, Brian. 2007. “The Increasing Dominance of Teams in Production of Knowledge.” Science 316(5827):1036–39. Google Scholar | Crossref | Medline | ISI | |
|
Yao, Lixia, Li, Ying, Ghosh, Soumitra, Evans, James A., Rzhetsky, Andrey. Forthcoming. “Health ROI as a Measure of Misalignment of Biomedical Needs and Resources.” Nature Biotechnology. Google Scholar | |
|
Zemlyak, Ilona, Manley, Nathan, Sapolsky, Robert, Gozes, Illana. 2007. “NAP Protects Hippocampal Neurons against Multiple Toxins.” Peptides 28(10):2004–8. Google Scholar | Crossref | Medline | |
|
Zuckerman, Harriet . 1978. “Theory Choice and Problem Choice in Science.” Sociological Inquiry 48(3–4):65–95. Google Scholar | Crossref |
