![[PDF]](/pb-assets/Icons/adobe-pdf-icon-1498649896243.png){kind=icon}
Abstract
Models for understanding and holding systems accountable have long rested upon ideals and logics of transparency. Being able to see a system is sometimes equated with being able to know how it works and govern it—a pattern that recurs in recent work about transparency and computational systems. But can “black boxes’ ever be opened, and if so, would that ever be sufficient? In this article, we critically interrogate the ideal of transparency, trace some of its roots in scientific and sociotechnical epistemological cultures, and present 10 limitations to its application. We specifically focus on the inadequacy of transparency for understanding and governing algorithmic systems and sketch an alternative typology of algorithmic accountability grounded in constructive engagements with the limitations of transparency ideals.
References
|
Abbott, A (1988) The System of Professions: An Essay on the Division of Expert Labor. Chicago, IL: University of Chicago Press. Google Scholar | Crossref | |
|
Albu, OB, Flyverbom, M (2016) Organizational transparency: conceptualizations, conditions, and consequences. Business & Society. Epub ahead of print 13 July. DOI: 10.1177/0007650316659851. Google Scholar | SAGE Journals | |
|
Ananny, M (2016) Toward an ethics of algorithms: convening, observation, probability, and timeliness. Science, Technology & Human Values 41(1): 93–117. DOI: 10.1177/0162243915606523 Google Scholar | SAGE Journals | ISI | |
|
Anderson, CW (2013) Towards a sociology of computational and algorithmic journalism. New Media & Society 15(7): 1005–1021. DOI: 10.1177/1461444812465137 Google Scholar | SAGE Journals | ISI | |
|
Arnoldi, J (2015) Computer algorithms, market manipulation and the institutionalization of high frequency trading. Theory, Culture & Society 33: 29–52. Google Scholar | SAGE Journals | |
|
Bacon, M (2012) Pragmatism. Cambridge: Polity Press. Google Scholar | |
|
Baecker, R (1998) Sorting out sorting: a case study of software visualization for teaching computer science. In: Stasko, J (ed.) Software Visualization Programming as a Multimedia Experience. Cambridge, MA: The MIT Press, pp. 369–381. Google Scholar | |
|
Ball, C (2009) What is transparency? Public Integrity 11(4): 293–308. Google Scholar | Crossref | |
|
Barany, MJ, MacKenzie, D (2014) Chalk: materials and concepts in mathematics research. In: Coopmans, C, Vertesi, J, Lynch, M. (eds) Representation in Scientific Practice Revisited. Cambridge, MA: The MIT Press, pp. 107–130. Google Scholar | Crossref | |
|
Bateson, G (2000) Steps to an Ecology of Mind: Collected Essays in Anthropology, Psychiatry, Evolution, and Epistemology. Chicago, IL: University of Chicago Press. Google Scholar | |
|
Birchall, C (2011) Introduction to “secrecy and transparency”: the politics of opacity and openness. Theory, Culture & Society 28(7–8): 7–25. Google Scholar | SAGE Journals | ISI | |
|
Birchall, C (2014) Radical transparency? Cultural Studies ↔ Critical Methodologies 14(1): 77–88. Google Scholar | SAGE Journals | |
|
Bratich, J (2016) Occult(ing) transparency: an epilogue. International Journal of Communication Systems 10: 178–181. Google Scholar | |
|
Brill, J (2015) Scalable approaches to transparency and accountability in decisionmaking algorithms: remarks at the NYU conference on algorithms and accountability. Federal Trade Commission, 28 February. Available at: https://www.ftc.gov/system/files/documents/public_statements/629681/150228nyualgorithms.pdf Google Scholar | |
|
Brown, MH (1998) A taxonomy of algorithm animation displays. In: Stasko, J (ed.) Software Visualization Programming as a Multimedia Experience. Cambridge, MA: The MIT Press, pp. 35–42. Google Scholar | |
|
Browne, S (2015) Dark Matters: On the Surveillance of Blackness. Durham, NC: Duke University Press. Google Scholar | Crossref | |
|
Burrell, J (2016) How the machine “thinks”: understanding opacity in machine learning algorithms. Big Data & Society 3(1). DOI: 10.1177/2053951715622512 Google Scholar | SAGE Journals | |
|
Carusi, A, Hoel, AS (2014) Toward a new ontology of scientific vision. In: Coopmans, C, Vertesi, J, Lynch, M. (eds) Representation in Scientific Practice Revisited. Cambridge, MA: The MIT Press, pp. 201–221. Google Scholar | Crossref | |
|
Christensen, LT, Cheney, G (2015) Peering into transparency: challenging ideals, proxies, and organizational practices. Communication Theory 25(1): 70–90. Google Scholar | Crossref | ISI | |
|
Coddington, M (2012) Defending a paradigm by patrolling a boundary: two global newspapers’ approach to WikiLeaks. Journalism & Mass Communication Quarterly 89(3): 377–396. Google Scholar | SAGE Journals | ISI | |
|
Coleman, G (2013) Coding Freedom: The Ethics and Aesthetics of Hacking. Princeton, NJ: Princeton University Press. Google Scholar | Crossref | |
|
Coopmans, C, Vertesi, J, Lynch, M. (2014) Introduction. In: Coopmans, C, Vertesi, J, Lynch, M. (eds) Representation in Scientific Practice Revisited. Cambridge, MA: The MIT Press, pp. 1–12. Google Scholar | Crossref | |
|
Crain, M (2018) The limits of transparency: data brokers and commodification. New Media & Society 20(1): 88–104. Google Scholar | SAGE Journals | ISI | |
|
Crain, W (2000) Theories and Development: Concepts and Applications. Upper Saddle River, NJ: Prentice Hall. Google Scholar | |
|
Crary, J (1990) Techniques of the Observer. Cambridge, MA: The MIT Press. Google Scholar | |
|
Crawford, K (2016) Can an algorithm be agonistic? Ten scenes from life in calculated publics. Science, Technology & Human Values 41(1): 77–92. Google Scholar | SAGE Journals | ISI | |
|
da Vinci, L (2015) Notebooks of Leonardo Da Vinci (trans. Richter, JP ). Istanbul: eKitap Projesi. Google Scholar | |
|
Daston, L (1992) Objectivity and the escape from perspective. Social Studies of Science 22(4): 597–618. Google Scholar | SAGE Journals | ISI | |
|
Daston, L, Galison, P (2007) Objectivity. Brooklyn, NY: Zone Books. Google Scholar | |
|
Datta, A, Tschantz, MC, Datta, A (2015) Automated experiments on ad privacy settings. Proceedings on Privacy Enhancing Technologies 1: 92–112. Google Scholar | Crossref | |
|
David, M (2015) The correspondence theory of truth. Stanford Encyclopedia of Philosophy, 28 May Available at: http://plato.stanford.edu/entries/truth-correspondence/ Google Scholar | |
|
De Rijcke, S, Beaulieu, A (2014) Networked neuroscience: brain scans and visual knowing at the intersection of atlases and databases. In: Coopmans, C, Vertesi, J, Lynch, M. (eds) Representation in Scientific Practice Revisited. Cambridge, MA: The MIT Press, pp. 131–152. Google Scholar | Crossref | |
|
Dewey, J (1997) Experience and Education. New York: Free Press. Google Scholar | |
|
Diakopoulos, N (2016) Accountability in algorithmic decision making. Communications of the ACM 59(2): 56–62. Google Scholar | Crossref | ISI | |
|
DiSalvo, C (2012) Adversarial Design. Cambridge, MA: The MIT Press. Google Scholar | Crossref | |
|
Dougherty, C (2015) Google photos mistakenly labels black people “gorillas.” The New York Times, 1 July. Available at: http://bits.blogs.nytimes.com/2015/07/01/google-photos-mistakenly-labels-black-people-gorillas/ Google Scholar | |
|
Driscoll, K, Walker, S (2014) Working within a black box: transparency in the collection and production of big Twitter data. International Journal of Communication Systems 8: 1745–1764. Google Scholar | |
|
Eslami, M, Rickman, A, Vaccaro, K. (2015) “I always assumed that I wasn’t really that close to [her]”: reasoning about invisible algorithms in the news feed. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems, Seoul, Republic of Korea, 18–23 April. Google Scholar | Crossref | |
|
Flyverbom, M (2016) Transparency: mediation and the management of visibilities. International Journal of Communication Systems 10: 110–122. Google Scholar | |
|
Fox, J (2007) The uncertain relationship between transparency and accountability. Development in Practice 17(4–5): 663–671. Google Scholar | Crossref | |
|
Fung, A, Graham, M, Weil, D (2008) Full Disclosure: The Perils and Promise of Transparency. Cambridge: Cambridge University Press. Google Scholar | |
|
Gillespie, T (2014) The relevance of algorithms. In: Gillespie, T, Boczkowski, P, Foot, KA (eds) Media Technologies: Essays on Communication, Materiality, and Society. Cambridge, MA: The MIT Press, pp. 167–194. Google Scholar | Crossref | |
|
Glasser, TL (1989) Three views on accountability. In: Dennis, EE, Gillmor, DM, Glasser, TL (eds) Media Freedom and Accountability. New York: Praeger. Google Scholar | |
|
Goodwin, C (1994) Professional vision. American Anthropologist 96(3): 606–633. Google Scholar | Crossref | ISI | |
|
Greenwald, G (2014) No Place to Hide. New York: Metropolitan Books. Google Scholar | |
|
Hallinan, B, Striphas, T (2014) Recommended for you: the Netflix Prize and the production of algorithmic culture. New Media & Society 18: 117–137. Google Scholar | SAGE Journals | ISI | |
|
Hansen, HK, Flyverbom, M (2015) The politics of transparency and the calibration of knowledge in the digital age. Organization 22(6): 872–889. Google Scholar | SAGE Journals | ISI | |
|
Heald, D (2006) Varieties of transparency. Proceedings of the British Academy 135: 25–43. Google Scholar | |
|
Heemsbergen, L (2016) From radical transparency to radical disclosure: reconfiguring (in)voluntary transparency through the management of visibilities. International Journal of Communication Systems 10: 138–151. Google Scholar | |
|
Hilgartner, S (2000) Science on Stage: Expert Advice as Public Drama. Stanford, CA: Stanford University Press. Google Scholar | |
|
Hood, C (2006) Transparency in historical perspective. In: Hood, C, Heald, D (eds) Transparency: The Key to Better Governance? Oxford: Oxford University Press, pp. 1–23. Google Scholar | Crossref | |
|
James, W (1997) What pragmatism means. In: Menand, L (ed.) Pragmatism: A Reader. New York: Random House, pp. 93–111. Google Scholar | |
|
Kelty, C (2008) Two Bits: The Cultural Significance of Free Software. Durham, NC: Duke University Press. Google Scholar | Crossref | |
|
Kushner, S (2013) The freelance translation machine: algorithmic culture and the invisible industry. New Media & Society 15: 1241–1258. Google Scholar | SAGE Journals | ISI | |
|
Leigh, D, Harding, L (2011) WikiLeaks: Inside Julian Assange’s War on Secrecy. New York: Public Affairs. Google Scholar | |
|
Levy, KEC (2015) The contexts of control: information, power, and truck-driving work. Information Society 31(2): 160–174. Google Scholar | Crossref | |
|
Levy, KEC, Johns, DM (2016) When open data is a Trojan Horse: the weaponization of transparency in science and governance. Big Data & Society 3(1). http://bds.sagepub.com/content/3/1/2053951715621568 Google Scholar | |
|
Lynch, M, Woolgar, S (1988) Introduction: sociological orientations to representational practice in science. Human Studies 11(2): 99–116. Google Scholar | ISI | |
|
Mackenzie, A (2015) The production of prediction: what does machine learning want? European Journal of Cultural Studies 18(4–5): 429–445. Google Scholar | SAGE Journals | ISI | |
|
Mackenzie, D (2008) An Engine, Not a Camera: How Financial Models Shape Markets. Cambridge, MA: The MIT Press. Google Scholar | |
|
Michaels, D (2008) Doubt Is Their Product: How Industry’s Assault on Science Threatens Your Health. Oxford: Oxford University Press. Google Scholar | |
|
Minsky, M (2007) The Emotion Machine: Commonsense Thinking, Artificial Intelligence, and the Future of the Human Mind. New York: Simon & Schuster. Google Scholar | |
|
Misak, C (ed.) (2007) New Pragmatists. Oxford: Oxford University Press. Google Scholar | |
|
Napoli, PM (2014) Automated media: an institutional theory perspective on algorithmic media production and consumption. Communication Theory 24(3): 340–360. Google Scholar | Crossref | ISI | |
|
Neyland, D, Möllers, N (2016) Algorithmic IF … THEN rules and the conditions and consequences of power. Information, Communication & Society, 20 (1): 45–62. Google Scholar | Crossref | |
|
Papert, S (1980) Mindstorms: Children, Computers, and Powerful Ideas. New York: Basic Books. Google Scholar | |
|
Pasquale, F (2015) The Black Box Society: The Secret Algorithms That Control Money and Information. Cambridge, MA: Harvard University Press. Google Scholar | Crossref | |
|
Phillips, JWP (2011) Secrecy and transparency: an interview with Samuel Weber. Theory, Culture & Society 28(7–8): 158–172. Google Scholar | SAGE Journals | ISI | |
|
Resnick, M, Berg, R, Eisenberg, M (2000) Beyond black boxes: bringing transparency and aesthetics back to scientific investigation. Journal of the Learning Sciences 9(1): 7–30. Google Scholar | Crossref | ISI | |
|
Schnackenberg, AK, Tomlinson, EC (2014) Organizational transparency: a new perspective on managing trust in organization-stakeholder relationships. Journal of Management 42: 1784–1810. Google Scholar | SAGE Journals | |
|
Schrock, AR (2016) Civic hacking as data activism and advocacy: a history from publicity to open government data. New Media & Society 18: 581–599. Google Scholar | SAGE Journals | ISI | |
|
Schudson, M (2015) The Rise of the Right to Know. Cambridge, MA: Belknap Publishing. Google Scholar | Crossref | |
|
Squires, CR (2002) Rethinking the black public sphere: an alternative vocabulary for multiple public spheres. Communication Theory 12(4): 446–468. Google Scholar | Crossref | ISI | |
|
Stiny, G (1980) Kindergarten grammars: designing with Froebel’s building gifts. Environment and Planning B 7(4): 409–462. Google Scholar | SAGE Journals | ISI | |
|
Stohl, C, Stohl, M, Leonardi, PM (2016) Managing opacity: information visibility and the paradox of transparency in the digital age. International Journal of Communication Systems 10: 123–137. Google Scholar | |
|
Striphas, T (2015) Algorithmic culture. European Journal of Cultural Studies 18(4–5): 395–412. Google Scholar | SAGE Journals | ISI | |
|
Tkacz, N (2015) Wikipedia and the Politics of Openness. Chicago, IL: University of Chicago Press. Google Scholar | |
|
Turner, F (2006) From Counterculture to Cyberculture: Stewart Brand, the Whole Earth Network, and the Rise of Digital Utopianism. Chicago, IL: University of Chicago Press. Google Scholar | Crossref | |
|
Turner, F (2013) The Democratic Surround. Chicago, IL: University of Chicago Press. Google Scholar | Crossref | |
|
Vertesi, J (2014) Drawing as: distinctions and disambiguation in digital images of Mars. In: Coopmans, C, Vertesi, J, Lynch, M. (eds) Representation in Scientific Practice Revisited. Cambridge, MA: The MIT Press, pp. 15–36. Google Scholar | Crossref | |
|
Wade, L (2010) HP software doesn’t see black people. Sociological Images, 5 January. Available at: https://thesocietypages.org/socimages/2010/01/05/hp-software-doesnt-see-black-people/ Google Scholar | |
|
Ward, SC (1996) Reconfiguring Truth. New York: Rowman & Littlefield. Google Scholar | |
|
Zara, C (2015) FTC chief technologist Ashkan Soltani on algorithmic transparency and the fight against biased bots. International Business Times, 9 April. Available at: http://www.ibtimes.com/ftc-chief-technologist-ashkan-soltani-algorithmic-transparency-fight-against-biased-1876177 Google Scholar |
