When a robot is social: Spatial arrangements and multimodal semiotic engagement in the practice of social robotics

First Published October 5, 2011 Research Article Find in PubMed

Social roboticists design their robots to function as social agents in interaction with humans and other robots. Although we do not deny that the robot’s design features are crucial for attaining this aim, we point to the relevance of spatial organization and coordination between the robot and the humans who interact with it. We recover these interactions through an observational study of a social robotics laboratory and examine them by applying a multimodal interactional analysis to two moments of robotics practice. We describe the vital role of roboticists and of the group of preverbal infants, who are involved in a robot’s design activity, and we argue that the robot’s social character is intrinsically related to the subtleties of human interactional moves in laboratories of social robotics. This human involvement in the robot’s social agency is not simply controlled by individual will. Instead, the human–machine couplings are demanded by the situational dynamics in which the robot is lodged.

Adam, A (1998) Artificial Knowing: Gender and the Thinking Machine. London: Routledge.
Google Scholar
Alač, M (2009) Moving android: On social robots and body-in-interaction. Social Studies of Science 39(4): 491528.
Google Scholar | SAGE Journals | ISI
AP (2008) Study: Dogs, robots cheer elderly. Associated Press (3 March). Available at: www.foxnews.com/story/0,2933,334529,00.html (accessed 2 June 2011).
Google Scholar
Bailey, JS, Wolf, MM, Philips, EL (1970) Home-based reinforcement and the modification of pre-delinquents’ classroom behavior. Journal of Applied Behavioral Analysis 3(3): 223233.
Google Scholar | Crossref | Medline | ISI
Banks, MR, Willoughby, LM, Banks, WA (2008) Animal-assisted therapy and loneliness in nursing homes: Use of robotic vs. living dogs. Journal of the American Medical Directors Association 9(3): 173177.
Google Scholar | Crossref | Medline | ISI
Baron-Cohen, S (1991) Precursors to a theory of mind: Understanding attention in others. In: Whiten, A (ed.) Natural Theories of Mind: Evolution, Development and Simulation of Everyday Mindreading. Oxford: Blackwell, 233251.
Google Scholar
Bogatyrev, P (2001 [1923]) Czech puppet theatre and Russian folk theatre. In: Bell, J (ed.) Puppets, Masks, and Performing Objects. Cambridge, MA: MIT Press.
Google Scholar
Breazeal, C (2002) Designing Sociable Robots. Cambridge, MA: MIT Press.
Google Scholar
Brooks, R, Breazeal, C, Marjanovic, M, Scassellati, B, Williamson, M (1998) The cog project: Building a humanoid robot. In: Nehaniv, C (ed.) Computation for Metaphors, Analogy and Agents. Berlin: Springer-Verlag, 813.
Google Scholar
Butterworth, G (1991) The ontogeny and phylogeny of joint visual attention. In: Whitten, A (ed.) Natural Theories of Mind: Evolution, Development, and Simulation of Everyday Mindreading. Oxford: Basil Blackwell, 223232.
Google Scholar
Cicourel, A (1987) Interpretation of communicative context: Examples from medical encounters. Social Psychology Quarterly 50: 217226.
Google Scholar | Crossref | ISI
Crist, E (1996) Darwin’s anthropomorphism: An argument for animal–human continuity. Advances in Human Ecology 5: 3383.
Google Scholar
Crocker, TP (1998) Wittgenstein’s practices and Peirce’s habits: Agreement in human activity. History of Philosophy Quarterly 15(4): 175193.
Google Scholar
Cromwell, S (2002) Two-way mirrors reflect new teaching model. Education World. Available at: www.educationworld.com/a_admin/admin/admin272.shtml (accessed 1 June 2011).
Google Scholar
Dautenhahn, K (1995) Getting to know each other: Artificial social intelligence for autonomous robots. Robotics and Autonomous Systems 16: 333356.
Google Scholar | Crossref | ISI
Dautenhahn, K (2007) Socially intelligent robots: Dimensions of human robot interaction. Philosophical Transactions of the Royal Society 362: 679704.
Google Scholar | Crossref | Medline | ISI
DiSalvo, CF, Gemperle, F, Forlizzi and Kiesler, S (2002) All robots are not equal: The design and perception of humanoid robot heads. Conference on Designing Interactive Systems, 25–28 June, London.
Google Scholar | Crossref
Eco, U (1976) A Theory of Semiotics. Bloomington, IN: Indiana University Press.
Google Scholar | Crossref
Garfinkel, H (1984 [1967]) Studies in Ethomethodology. Cambridge, UK: Polity Press; Englewood Cliffs, NJ, 1967.
Google Scholar
Goffman, E (1971) Relations in Public: Microstudies of the Public Order. New York: Basic Books.
Google Scholar
Goode, D (1994) A World Without Words. Philadelphia: Temple University Press.
Google Scholar
Goode, D (2007) Playing with my Dog Katie: An Ethnomethodological Study of Dog–Human Interaction. West Lafayette, Indiana: Purdue University Press.
Google Scholar
Goodwin, C (1994) Recording human interaction in natural settings. Pragmatica 3: 181209.
Google Scholar | Crossref
Goodwin, C (2000) Practices of seeing, visual analysis: An ethnomethodological approach. In: van Leeuwen, T, Jewitt, C (eds) Handbook of Visual Analysis. London: Sage Publications, 157182.
Google Scholar
Haraway, D (2003) The Companion Species Manifesto: Dogs, People, and Significant Otherness. Chicago: Prickly Paradigm Press.
Google Scholar
Haraway, D (2008) When Species Meet. Minnesota: University of Minnesota Press.
Google Scholar
Hearne, V (1986) Adam’s Task: Calling Animals by Name. New York: Knopf.
Google Scholar
Heath, C (1997) The analysis of activities in face to face interaction using video. In: Silverman, D (ed.) Qualitative Research: Theory, Method and Practice. London: Sage Publications, 183200.
Google Scholar
Heath, C, Hindmarsh, J (2002) Analyzing interaction video ethnography and situated conduct. In: May, T (ed.) Qualitative Research in Action. London: Sage Publications, 99121.
Google Scholar
Hindmarsh, J, Heath, C (2000) Embodied reference: A study of deixis in workplace interaction. Journal of Pragmatics 32: 18551878.
Google Scholar | Crossref | ISI
Hirschauer, S (1991) The manufacture of bodies in surgery. Social Studies of Science 21(2): 279319.
Google Scholar | SAGE Journals | ISI
Høstaker, R (2005) Latour – Semiotics and science studies. Science Studies 18(2): 525.
Google Scholar
Hutchins, E (1996) Cognition in the Wild. Cambridge, MA: MIT Press.
Google Scholar | Crossref
Ishiguro, H (2007) Scientific issues concerning androids. International Journal of Robotics Research 26(1): 105117.
Google Scholar | SAGE Journals | ISI
Jefferson, G (2004) Glossary of transcript symbols with an introduction. In: Lerner, GH (ed.) Conversation Analysis: Studies from the First Generation. New York: John Benjamins, 1331.
Google Scholar | Crossref
Kanda, T, Hirano, T, Eaton, D, Ishiguro, H (2004) Interactive robots as social partners and peer tutors for children: A field trial. Human–Computer Interaction 19(1): 6184.
Google Scholar | Crossref | ISI
Kent, R, O’Leary, D, Dietz, A, Diament, C (1979) Comparison of observational recordings in vivo, via mirror, and via television. Journal of Applied Behavioral Analysis 12(4): 517522.
Google Scholar | Crossref | Medline | ISI
Kidwell, M, Zimmerman, D (2007) Joint attention in action. Pragmatics 39(3): 592611.
Google Scholar | Crossref | ISI
Kidwell, M, Zimmerman, D (2006) ‘Observability’ in the interactions of very young children. Communication Monographs 73(1): 128.
Google Scholar | Crossref | ISI
Laub Coser, R (1961) Insulation from observability and types of social conformity. American Sociological Review 26: 787795.
Google Scholar | ISI
Latour, B (1983) Give me a laboratory and I will raise the world. In: Knorr-Cetina, K, Mulkay, M (eds) Science Observed. London: Sage Publications, 141170.
Google Scholar
LeBaron, C (2007) Formulating the triangle of doom. Gesture 7(1): 97118.
Google Scholar | Crossref
Lenoir, T (1994) Was that last turn a right turn? The semiotic turn and A.J. Greimas. Configurations 2: 119136.
Google Scholar | Crossref
Lynch, M (1985) Art and Artifact in Laboratory Science: A Study of Shop Work and Shop Talk in a Research Laboratory. London: Routledge & Kegan Paul.
Google Scholar
Lynch, M (1991) Laboratory space and the technological complex: An investigation of topical contextures. Science in Context 4(1): 81109.
Google Scholar | Crossref
Lynch, M (1993) Scientific Practice and Ordinary Action: Ethnomethodology and Social Studies of Science. New York: Cambridge University Press.
Google Scholar
MacDorman, K, Ishiguro, H (2006) The uncanny advantage of using androids in social and cognitive science research. Interaction Studies 7(3): 297337.
Google Scholar | Crossref | ISI
Marantz-Henig, R (2007) The real transformers. New York Times, 29 July.
Google Scholar
MedHeadlines (2008) Robot dogs as good as the real thing at alleviating loneliness. MedHeadlines, 29 February. Available at: http://medheadlines.com/2008/02/29/robot-dogs-as-good-as-the-real-thing-at-alleviating-loneliness/ (accessed 14 June 2011).
Google Scholar
Mondada, L (2007) Multimodal resources for turn-taking: Pointing and the emergence of possible next speakers. Discourse Studies 9(2): 195226.
Google Scholar | SAGE Journals | ISI
Mori, M (1970) Bukimi No Tani [The uncanny valley]. Energy 7(4): 3335.
Google Scholar
Movellan, JR, Tanaka, F, Taylor, C, Ruvolo, P, Eckhardt, M (2007) The RUBI Project: A Progress Report. Proceedings of the 2nd ACM/IEEE International Conference of Human-Robot Interaction. Washington DC, 9–11 March. New York: ACM.
Google Scholar | Crossref
New York Daily News (2008) Time to walk the robot? Dogs may be replaced as man’s best friend. New York Daily News, 29 February. Available at www.nydailynews.com/news/us_world/2008/02/29/2008-02-29_time_to_walk_the_robot_dogs_may_be_repla.html (accessed 14 June 2011).
Google Scholar
Ochs, E, Gonzales, P, Jacoby, S (1996) ‘When I come down I’m in a domain state’: Talk, gesture, and graphic representation in the interpretative activity of physicists. In: Ochs, E, Schegloff, E, Thomson, S (eds) Interaction and Grammar. Cambridge: Cambridge University Press, 328369.
Google Scholar | Crossref
Otero, N, Nehaniv, C, Sverre Syrdal, D, Dautenhahn, K (2006) Naturally occurring gestures in a human-robot teaching scenario. Proceeding of the 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN06). University of Hertfordshire, 6–8 September. Hatfield, UK, IEEE Press: 533540.
Google Scholar | Crossref
Peirce, CS (1867) On a new list of categories. Proceedings of the American Academy of Arts and Sciences 7: 287298. Reprinted in PeirceC.S. (1931–1958).
Google Scholar | Crossref
Peirce, CS (1931–1958) Collected Papers, 8 volumes (Weiss, P, Burks, A, Hartshorne, C, eds). Cambridge: Harvard University Press.
Google Scholar
Pollner, M, Goode, D (1990) Ethnomethodology and person-centering practices. Person-Centered Review 5(2): 203220.
Google Scholar
Pollner, M, McDonald-Wikler, L (1985) The social construction of unreality: A case of a family’s attribution of competence to a severely retarded child. Family Process 24: 241254.
Google Scholar | Crossref | Medline | ISI
Prentice, R (2007) Drilling surgeons: The social lessons of embodied surgical learning. Science, Technology, & Human Values 32(5): 534553.
Google Scholar | SAGE Journals | ISI
Queiroz, J, Merrell, F (2006) Semiosis and pragmatism: Toward a dynamic concept of meaning. Sign System Studies 34(1): 3766.
Google Scholar
Ransdell, J (1989) Peirce est-il un phénoménologue? Ètudes Phénoménologiques 9–10: 5175.
Google Scholar
Riskin, J (2003) The defecating duck, or, the ambiguous origins of artificial life. Critical Inquiry 29(4): 599633.
Google Scholar | Crossref | ISI
Rosensohn, W (1974) The Phenomenology of Charles S. Peirce. Amsterdam: B.R. Grüner.
Google Scholar
Sakamoto, D, Kanda, T, Ono, T, Kamashima, M, Imai, M, Ishiguro, H (2005) Cooperative embodied communication emerged by interactive humanoid robots. International Journal of Human–Computer Studies 62(2): 247265.
Google Scholar | Crossref | ISI
Savage-Rumbaugh, S, Shanker, SG, Taylor, TJ (1998) Apes, Language, and the Human Mind. New York: Oxford University Press.
Google Scholar
Scassellati, B (2005) How social robots will help us to diagnose, treat, and understand autism. 12th International Symposium of Robotics Research (ISRR). San Francisco, CA, October.
Google Scholar
Schegloff, EA (1984) On some gestures relation to talk. In: Atkinson, JM, Heritage, J (eds) Structures of Social Action: Studies in Conversation Analysis. Cambridge: Cambridge University Press, 266296.
Google Scholar
Science Daily (2008) Doggie robot eases loneliness in nursing home residents as well as real dog, study finds. Science Daily, 26 February. Available at: www.sciencedaily.com/releases/2008/02/080225213636.htm (accessed 14 June 2011).
Google Scholar
Shapin, S (1988) The house of experiment in seventeenth-century England. Isis 79: 373404.
Google Scholar | Crossref | ISI
Shapin, S, Schaffer, S (1985) Leviathan and the Air-Pump: Hobbes, Boyle, and the Experimental Life. Princeton, NJ: Princeton University Press.
Google Scholar
Streeck, J (2009) Gesturecraft: The Manufacture of Meaning. Amsterdam: John Benjamins.
Google Scholar | Crossref
Suchman, L (1987) Plans and Situated Actions: The Problem of Human–Machine Communication. New York: Cambridge University Press.
Google Scholar
Suchman, L (1988) Representing practice in cognitive science. Human Studies 11: 305325.
Google Scholar | Crossref | ISI
Suchman, L (2000) Embodied practices of engineering work. Mind, Culture and Activity 7(1/2): 418.
Google Scholar | Crossref
Suchman, L (2007) Human–Machine Reconfigurations: Plans and Situated Actions, second expanded edition. New York: Cambridge University Press.
Google Scholar
Suchman, L, Trigg, RH (1993) Artificial intelligence as craftwork. In: Chaiklin, S, Lave, J (eds) Understanding Practice: Perspectives on Activity and Context. Cambridge: Cambridge University Press, 144178.
Google Scholar | Crossref
Tanaka, F, Cicourel, A, Movellan, J (2007) Socialization between toddlers and robots at an early childhood education center. Proceedings of the National Academy of Science 104(46): 1795417958.
Google Scholar | Crossref | Medline | ISI
Tanaka, F, Movellan, JR (2006) Behavior analysis of children’s touch on a small humanoid robot: Long-term observation at a daily classroom over three months. Proceeding of The 15th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN06), University of Hertfordshire, 6–8 September. Hatfield, UK, IEEE Press: 753756.
Google Scholar | Crossref
Tanenbaum, J (2008) Robot dog therapy. Science Central, 30 May. Available at: www.sciencentral.com/video/2008/05/30/robot-dog-therapy/ (accessed 14 June 2011).
Google Scholar
The Hindu (2008) Robots, dogs equally reduce loneliness. The Hindu, 2 March. Available at: www.hindu.com/2008/03/02/stories/2008030253652200.htm (accessed 14 June 2011).
Google Scholar
Tillis, S (1992) Toward and Aesthetics of the Puppet: Puppetry as a Theatrical Art. Westport, CT: Greenwood Press.
Google Scholar
Tomasello, M (2003) Constructing a Language. Cambridge, MA: Harvard University Press.
Google Scholar
Turkle, S (2011) Alone Together: Why We Expect More from Technology and Less from Each Other. New York: Basic Books.
Google Scholar
Turnbull, D (2000) Masons, Tricksters and Cartographers. New York: Routledge.
Google Scholar | Crossref
Weizenbaum, J (1976) Computer Power and Human Reason: From Judgment To Calculation. San Francisco: W.H. Freeman.
Google Scholar
Wellman, HM (1993) Early understanding of mind: The normal case. In: Baron-Cohen, S, Tager-Flusberg, H, Cohen, D (eds) Understanding Other Minds: Perspectives from Autism. Oxford: Oxford University Press, 1039.
Google Scholar
Wittgenstein, L (1953) Philosophical Investigations. Oxford: Basil Blackwell.
Google Scholar

Access content

To read the fulltext, please use one of the options below to sign in or purchase access.
  • Access Options

    My Account

    Welcome
    You do not have access to this content.

    Chinese Institutions / 中国用户

    Click the button below for the full-text content

    请点击以下获取该全文

    Institutional Access

    does not have access to this content.

    Purchase Content

    24 hours online access to download content

    Research off-campus without worrying about access issues. Find out about Lean Library here


Purchase

SSS-article-ppv for $37.50
Single Issue 24 hour E-access for $507.77

Cookies Notification

This site uses cookies. By continuing to browse the site you are agreeing to our use of cookies. Find out more.
Top