Process-Tracing Methods in Decision Making: On Growing Up in the 70s
Abstract
Decision research has experienced a shift from simple algebraic theories of choice to an appreciation of mental processes underlying choice. A variety of process-tracing methods has helped researchers test these process explanations. Here, we provide a survey of these methods, including specific examples for subject reports, movement-based measures, peripheral psychophysiology, and neural techniques. We show how these methods can inform phenomena as varied as attention, emotion, strategy use, and understanding neural correlates. Two important future developments are identified: broadening the number of explicit tests of proposed processes through formal modeling and determining standards and best practices for data collection.
Get full access to this article
View all access and purchase options for this article.
Recommended Reading
Ashby N. J., Johnson J. G., Krajbich I., Wedel M. (2016). Applications and innovations of eye-movement research in judgment and decision making. Journal of Behavioral Decision Making, 29, 96–102. Lead article in a special issue on eye-tracking research in judgement and decision making providing many examples from theory to application.
Schulte-Mecklenbeck M., Kühberger A., Johnson J. G. (2018). A handbook of process tracing methods. New York, NY: Taylor & Francis. Comprehensive overview of 13 process-tracing techniques used in judgment and decision making.
Stewart N., Hermens F., Matthews W. J. (2016). Eye movements in risky choice. Journal of Behavioral Decision Making, 29, 116–136. Bridging the gap between the recording attention and models like decision field theory, decision by sampling, or parallel constraints satisfaction.
References
Beatty J. (1982). Task-evoked pupillary responses, processing load, and the structure of processing resources. Psychological Bulletin, 91, 276.
Bechara A., Damasio A. R. (2005). The somatic marker hypothesis: A neural theory of economic decision. Games and Economic Behavior, 52, 336–372.
Bernoulli D. (1738). Specimen theoriae novae de mensura sortis. Econometrica, 22, 23–36.
Bulling A., Gellersen H. (2010). Toward mobile eye-based human-computer interaction. IEEE Pervasive Computing, 9(4), 8–12.
Burk D., Ingram J. N., Franklin D. W., Shadlen M. N., Wolpert D. M. (2014). Motor effort alters changes of mind in sensorimotor decision making. PLoS ONE, 9(3), e92681.
Busemeyer J. R., Johnson J. G. (2004). Computational models of decision making. In Koehler D. J., Harvey N. (Eds.), Blackwell handbook of judgment and decision making (pp. 133–154). Oxford, UK: Blackwell Publishing.
Cerf M., Thiruvengadam N., Mormann F., Kraskov A., Quiroga R. Q., Koch C., Fried I. (2010). On-line, voluntary control of human temporal lobe neurons. Nature, 467, 1104–1108.
Costa-Gomes M. A., Crawford V. P., Broseta B. (2001). Cognition and behavior in normal-formal games: An experimental study. Econometrica, 69, 1193–1235.
Crone E. A., Somsen R. J., Beek B. V., Van Der Molen M. W. (2004). Heart rate and skin conductance analysis of antecendents and consequences of decision making. Psychophysiology, 41, 531–540.
Csikszentmihalyi M., Larson R. (2014). Validity and reliability of the experience-sampling method. In Csikszentmihalyi M., Larson R. (Eds.), Flow and the foundations of positive psychology (pp. 35–54). Dordrecht, The Netherlands: Springer.
Ericsson K. A., Simon H. A. (1992). Protocol analysis. Cambridge, MA: The MIT Press.
Fiedler S., Schulte-Mecklenbeck M., Renkewitz F., Orquin J. (2017). Reporting eye-tracking results effectively: The i-guidelines. Manuscript in preparation.
Figner B., Knoch D., Johnson E. J., Krosch A. R., Lisanby S. H., Fehr E., Weber E. U. (2010). Lateral prefrontal cortex and self-control in intertemporal choice. Nature Neuroscience, 13, 538–539.
Forstmann B. U., Ratcliff R., Wagenmakers E. J. (2016). Sequential sampling models in cognitive neuroscience: Advantages, applications, and extensions. Annual Review of Psychology, 67, 641–666.
Freeman J. B., Ambady N. (2010). MouseTracker: Software for studying real-time mental processing using a computer mouse-tracking method. Behavior Research Methods, 42, 226–241.
Giorgetta C., Grecucci A., Bonini N., Coricelli G., Demarchi G., Braun C., Sanfey A. G. (2013). Waves of regret: A meg study of emotion and decision-making. Neuropsychologia, 51, 38–51.
Goldstein D. G., Suri S., McAfee R. P., Ekstrand-Abueg M., Diaz F. (2014). The economic and cognitive costs of annoying display advertisements. Journal of Marketing Research, 51, 742–752.
Holmqvist K., Nyström M., Andersson R., Dewhurst R., Jarodzka H., Van de, Weijer J. (2011). Eye tracking: A comprehensive guide to methods and measures. Oxford, UK: Oxford University Press.
Johnson E. J., Ratcliff R. (2014). Computational and process models of decision making in psychology and behavioral economic. In Glimcher P. W., Fehr E. (Eds.), Neuroeconomics: Decision making and the brain (2nd ed., pp. 35–47). New York, NY: Academic Press.
Johnson E. J., Schulte-Mecklenbeck M., Willemsen M. C. (2008). Process models deserve process data: Comment on Brandstätter, Gigerenzer, and Hertwig (2006). Psychological Review, 115, 263–272.
Just M. A., Carpenter P. A. (1980). A theory of reading: From eye fixations to comprehension. Psychological Review, 87, 329–354.
Kahneman D., Tversky A. (1979). Prospect theory: An analysis of decision under risk. Econometrica, 47, 263–291.
Krajbich I., Armel C., Rangel A. (2010). Visual fixations and the computation and comparison of value in simple choice. Nature Neuroscience, 13, 1292–1298.
Krieglmeyer R., Deutsch R., De Houwer J., De Raedt R. (2010). Being moved valence activates approach-avoidance behavior independently of evaluation and approach-avoidance intentions. Psychological Science, 21, 607–613.
Lejarraga T., Schulte-Mecklenbeck M., Smedema D. (2016). The pyeTribe: Simultaneous eyetracking for economic games. Behavior Research Methods, 1–11.
Lin L. C., Yu W. Y. (2015). A think-aloud study of strategy use by EFL college readers reading Chinese and English texts. Journal of Research in Reading, 38, 286–306.
Liu Z., Mao J., Wang C., Ai Q., Liu Y., Nie J. Y. (2017). Enhancing click models with mouse movement information. Information Retrieval Journal, 20, 53–80.
Lundberg U., Dohns I. E., Melin B., Sandsjö L., Palmerud G., Kadefors R., . . . Parr D. (1999). Psychophysiological stress responses, muscle tension, and neck and shoulder pain among supermarket cashiers. Journal of Occupational Health Psychology, 4, 245–255.
Morgenstern O., von Neumann J. (1944). Theory of games and economic behavior. Princeton, NJ: Princeton University Press.
Peters J., Büchel C. (2011). The neural mechanisms of inter-temporal decision-making: Understanding variability. Trends in Cognitive Sciences, 15, 227–239.
Polonio L., Di Guida S., Coricelli G. (2015). Strategic sophistication and attention in games: An eye-tracking study. Games and Economic Behavior, 94, 80–96.
Porter S., ten Brinke L., Baker A., Wallace B. (2011). Would I lie to you? “Leakage” in deceptive facial expressions relates to psychopathy and emotional intelligence. Personality and Individual Differences, 51, 133–137.
Ratcliff R. (1978). A theory of memory retrieval. Psychological Review, 85, 59–108.
Ranyard R., Svenson O. (2011). Verbal data and decision process analysis. In Schulte-Mecklenbeck M., Kühberger A., Ranyard R. (Eds.), A handbook of process tracing methods for decision research (pp. 115–138). Oxford, UK: Psychology Press.
Rubinstein A. (2003). Economics and psychology? The case of hyperbolic discounting. International Economic Review, 44, 1207–1216.
Russo J. E. (2011). Eye fixations as a process trace. In Schulte-Mecklenbeck M., Kühberger A., Ranyard R. (Eds.), A handbook of process tracing methods for decision research (pp. 43–64). Oxford, UK: Psychology Press.
Schuller B., Rigoll G., Lang M. (2003, April). Hidden Markov model-based speech emotion recognition. In 2003 IEEE International Conference on Acoustics, speech, and signal processing (ICASSP’03) (Vol. 2, pp. II–1). Baltimore, MD: IEEE.
Simon H. A., Newell A. (1972). Human problem solving: The state of the theory in 1970. American Psychologist, 26(2), 145–159.
Spivey M. J., Dale R. (2006). Continuous dynamics in real-time cognition. Current Directions in Psychological Science, 15, 207–211.
Stewart N., Hermens F., Matthews W. J. (2016). Eye movements in risky choice. Journal of Behavioral Decision Making, 29, 116–136.
Stöckli S., Schulte-Mecklenbeck M., Borer S., Samson A. C. (2017). Validation of iMotions emotional facial expression analysis with the AFFDEX and FACET module. Behavior Research Methods. Manuscript submitted for publication.
Swan M. (2009). Emerging patient-driven health care models: An examination of health social networks, consumer personalized medicine and quantified self-tracking. International Journal of Environmental Research and Public Health, 6, 492–525.
Utz K. S., Dimova V., Oppenländer K., Kerkhoff G. (2010). Electrified minds: Transcranial direct current stimulation (tDCS) and galvanic vestibular stimulation (GVS) as methods of non-invasive brain stimulation in neuropsychology—A review of current data and future implications. Neuropsychologia, 48, 2789–2810.
van Vugt M. K., Simen P., Nystrom L. E., Holmes P., Cohen J. D. (2014). EEG oscillations reveal neural correlates of evidence accumulation. Frontiers in Neuroscience, 5, Article 106, 108–120.
Weber E. U., Johnson E. J., Milch K. F., Chang H., Brodscholl J. C., Goldstein D. G. (2007). Asymmetric discounting in intertemporal choice a query-theory account. Psychological Science, 18, 516–523.
Willemsen M. C., Johnson E. J. (2011). Visiting the decision factory: Observing cognition with mouselabweb and other information acquisition methods. In Schulte-Mecklenbeck M., Kühberger A., Ranyard R. (Eds.), A handbook of process tracing methods for decision research (pp. 21–42). Oxford, UK: Psychology Press.
Xu P., Ehinger K. A., Zhang Y., Finkelstein A., Kulkarni S. R., Xiao J. (2015). Turkergaze: Crowdsourcing saliency with webcam based eye tracking. arXiv preprint arXiv:1504.06755.
Yarbus A. L. (1967). Eye movements and vision. New York, NY: Plenum Press.
Cite article
Cite article
Cite article
OR
Download to reference manager
If you have citation software installed, you can download article citation data to the citation manager of your choice
Information, rights and permissions
Information
Published In
Article first published online: October 30, 2017
Issue published: October 2017
Keywords
Authors
Metrics and citations
Metrics
Journals metrics
This article was published in Current Directions in Psychological Science.
VIEW ALL JOURNAL METRICSArticle usage*
Total views and downloads: 4220
*Article usage tracking started in December 2016
Altmetric
See the impact this article is making through the number of times it’s been read, and the Altmetric Score.
Learn more about the Altmetric Scores
Articles citing this one
Receive email alerts when this article is cited
Web of Science: 67 view articles Opens in new tab
Crossref: 71
- How Consumers Resolve Conflict over Branded Products: Evidence from Mo...
- An Information Acquisition Approach on How Young Adults Search for Men...
- Signaling sustainability and regionality in the electricity market: An...
- Eye movements as a tool to investigate exemplar retrieval in judgments
- How does probabilistic harm affect dishonesty? An experiment
- Decision avoidance and post-decision regret: A systematic review and m...
- Cognitive and Behavioral Impacts of Two Decision-Support Modes for Jud...
- Attention Constraints and Learning in Categories
- Measuring the Factors Influencing Purchasing Decisions: Evidence From ...
- Individual Differences and Situational Constraint Predict Information ...
- Computational Modeling of Basic Cognitive Functionalities
- Computational Models of Decision Making
- Automatic facial coding predicts self-report of emotion, advertisement...
- Order in multi‐attribute product choice decisions: Evidence from discr...
- Pay One or Pay All? The Role of Incentive Schemes in Decision Making A...
- Machine learning strategy identification: A paradigm to uncover decisi...
- Virtuous opinion change in structured groups
- Should I Stay or Should I Go? Cognitive Modeling of Left-Turn Gap Acce...
- Virtual social networking increases the individual's economic predicta...
- The “Effort Elephant” in the Room: What Is Effort, Anyway?
- Home is where your Gaze is – Evaluating effects of embedding regional ...
- Making Sense of Data: Identifying Children’s Strategies for Data Compa...
- The More You Ask, the Less You Get: When Additional Questions Hurt Ext...
- Information processing in tax decisions: a MouselabWEB study on the de...
- Salience
- Impact of video content and resolution on the cognitive dynamics of su...
- Measuring the Candidates' Emotions in Political Debates Based on Facia...
- Composition rules in original and cumulative prospect theory
- Synthesizing advancements in methodology and technology to understand ...
- Cognitive and affective processes of prosociality
- What’s in a face: Automatic facial coding of untrained study participa...
- Average user ratings prompt disparate decision strategies in online re...
- Enhancing models of social and strategic decision making with process ...
- I change my mind to get better: Process tracing-based microanalysis of...
- Resolving ambiguity: Broadening the consideration of risky decision ma...
- Combining Process Tracing and Policy Capturing Techniques for Judgment...
- Delphi with feedback of rationales: How large can a Delphi group be su...
- Do adolescents always take more risks than adults? A within-subjects d...
- Eye-tracking evidence for fixation asymmetries in verbal and numerical...
- Using mouse cursor tracking to investigate online cognition: Preservin...
- Decision-Making Process
- Behavioral Decision Theories that Explain Decision-Making Processes
- The Influence of Situational Regulation on the Information Processing ...
- Roles of cognitive load and self‐relevance during emotional informatio...
- Editorial: Process tracing methods in social psychology
- The impact of task complexity and task motivation on in-store marketin...
- Read My Face: Automatic Facial Coding Versus Psychophysiological Indic...
- From high- to one-dimensional dynamics of decision making: testing sim...
- Impact of Think-Aloud on Eye-Tracking: A Comparison of Concurrent and ...
- How Visualizing Inferential Uncertainty Can Mislead Readers About Trea...
- Examining the unfolding of moral decisions across time using the reach...
- An analysis of process-tracing research on consumer decision-making
- Opening the ‘Black Box’: An Overview of Methods to Investigate the Dec...
- Design factors in mouse-tracking: What makes a difference?
- Judgment and Decision Making
- Effects of social value orientation (SVO) and decision mode on control...
- This way, please: Uncovering the directional effects of attribute tran...
- The More You Ask, the Less You Get: When Additional Questions Hurt Ext...
- A tutorial on DynaSearch: A Web-based system for collecting process-tr...
- Forward inference in risky choice: Mapping gaze and decision processes
- Validating mouse-tracking: How design factors influence action dynamic...
- Reputation Star Society: Are star ratings consulted as substitute or c...
- The attention–aversion gap: how allocation of attention relates to los...
- Introducing otree_tools: A powerful package to provide process data fo...
- Beyond reach: Do symmetric changes in motor costs affect decision maki...
- 风险决策和跨期决策的过程比较：以确定效应和即刻效应为例
- Behavioral inattention
- Systematicity of Search Index: A new measure for exploring information...
- Facial expression analysis with AFFDEX and FACET: A validation study
- What Evidence Matters to Jurors? The Prevalence and Importance of Diff...
- The Effects of Information Search and Attention Distribution on the Co...
Figures and tables
Figures & Media
Tables
View Options
Get access
Access options
If you have access to journal content via a personal subscription, university, library, employer or society, select from the options below:
loading institutional access options
APS members can access this journal content using society membership credentials.
APS members can access this journal content using society membership credentials.
Alternatively, view purchase options below:
Purchase 24 hour online access to view and download content.
Access journal content via a DeepDyve subscription or find out more about this option.
