Confidence in value-based choice

Confidence in value-based choice

Play all audios:

Loading...

ABSTRACT Decisions are never perfect, with confidence in one's choices fluctuating over time. How subjective confidence and valuation of choice options interact at the level of brain


and behavior is unknown. Using a dynamic model of the decision process, we show that confidence reflects the evolution of a decision variable over time, explaining the observed relation


between confidence, value, accuracy and reaction time. As predicted by our dynamic model, we show that a functional magnetic resonance imaging signal in human ventromedial prefrontal cortex


(vmPFC) reflects both value comparison and confidence in the value comparison process. Crucially, individuals varied in how they related confidence to accuracy, allowing us to show that this


introspective ability is predicted by a measure of functional connectivity between vmPFC and rostrolateral prefrontal cortex. Our findings provide a mechanistic link between noise in value


comparison and metacognitive awareness of choice, enabling us both to want and to express knowledge of what we want. Access through your institution Buy or subscribe This is a preview of


subscription content, access via your institution ACCESS OPTIONS Access through your institution Subscribe to this journal Receive 12 print issues and online access $209.00 per year only


$17.42 per issue Learn more Buy this article * Purchase on SpringerLink * Instant access to full article PDF Buy now Prices may be subject to local taxes which are calculated during checkout


ADDITIONAL ACCESS OPTIONS: * Log in * Learn about institutional subscriptions * Read our FAQs * Contact customer support SIMILAR CONTENT BEING VIEWED BY OTHERS SUBJECTIVE VALUE AND DECISION


ENTROPY ARE JOINTLY ENCODED BY ALIGNED GRADIENTS ACROSS THE HUMAN BRAIN Article Open access 21 October 2020 NEURAL AND COMPUTATIONAL UNDERPINNINGS OF BIASED CONFIDENCE IN HUMAN


REINFORCEMENT LEARNING Article Open access 28 October 2023 SOURCES OF CONFIDENCE IN VALUE-BASED CHOICE Article Open access 17 December 2021 REFERENCES * Rangel, A. & Hare, T. Neural


computations associated with goal-directed choice. _Curr. Opin. Neurobiol._ 20, 262–270 (2010). Article  CAS  Google Scholar  * FitzGerald, T.H.B., Seymour, B. & Dolan, R.J. The role of


human orbitofrontal cortex in value comparison for incommensurable objects. _J. Neurosci._ 29, 8388–8395 (2009). Article  CAS  Google Scholar  * Kable, J.W. & Glimcher, P.W. The neural


correlates of subjective value during intertemporal choice. _Nat. Neurosci._ 10, 1625–1633 (2007). Article  CAS  Google Scholar  * Basten, U., Biele, G., Heekeren, H.R. & Fiebach, C.J.


How the brain integrates costs and benefits during decision making. _Proc. Natl. Acad. Sci. USA_ 107, 21767–21772 (2010). Article  CAS  Google Scholar  * Smith, D.V. et al. Distinct value


signals in anterior and posterior ventromedial prefrontal cortex. _J. Neurosci._ 30, 2490–2495 (2010). Article  CAS  Google Scholar  * Hunt, L.T. et al. Mechanisms underlying cortical


activity during value-guided choice. _Nat. Neurosci._ 15, 470–476 (2012). Article  CAS  Google Scholar  * Kepecs, A., Uchida, N., Zariwala, H.A. & Mainen, Z.F. Neural correlates,


computation and behavioural impact of decision confidence. _Nature_ 455, 227–231 (2008). Article  CAS  Google Scholar  * Rolls, E.T., Grabenhorst, F. & Deco, G. Choice, difficulty, and


confidence in the brain. _Neuroimage_ 53, 694–706 (2010). Article  Google Scholar  * Fleming, S.M., Weil, R.S., Nagy, Z., Dolan, R.J. & Rees, G. Relating introspective accuracy to


individual differences in brain structure. _Science_ 329, 1541–1543 (2010). Article  CAS  Google Scholar  * Pleskac, T.J. & Busemeyer, J.R. Two-stage dynamic signal detection: A theory


of choice, decision time, and confidence. _Psychol. Rev._ 117, 864–901 (2010). Article  Google Scholar  * Kepecs, A. & Mainen, Z. A computational framework for the study of confidence in


humans and animals. _Philos. Trans. R. Soc. Lond. B Biol. Sci._ 367, 1322–1337 (2012). Article  Google Scholar  * Vickers, D. _Decision Processes in Visual Perception_ (Academic Press,


1979). * Bogacz, R., Brown, E., Moehlis, J., Holmes, P. & Cohen, J.D. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice


tasks. _Psychol. Rev._ 113, 700–765 (2006). Article  Google Scholar  * Fleming, S.M., Huijgen, J. & Dolan, R.J. Prefrontal contributions to metacognition in perceptual decision making.


_J. Neurosci._ 32, 6117–6125 (2012). Article  CAS  Google Scholar  * Becker, G.M., DeGroot, M.H. & Marschak, J. Measuring utility by a single-response sequential method. _Behav. Sci._ 9,


226–232 (1964). Article  CAS  Google Scholar  * Plassmann, H., O'Doherty, J. & Rangel, A. Orbitofrontal cortex encodes willingness to pay in everyday economic transactions. _J.


Neurosci._ 27, 9984–9988 (2007). Article  CAS  Google Scholar  * De Martino, B., Kumaran, D., Holt, B. & Dolan, R.J. The neurobiology of reference-dependent value computation. _J.


Neurosci._ 29, 3833–3842 (2009). Article  CAS  Google Scholar  * Hare, T.A., O'Doherty, J., Camerer, C.F., Schultz, W. & Rangel, A. Dissociating the role of the orbitofrontal cortex


and the striatum in the computation of goal values and prediction errors. _J. Neurosci._ 28, 5623–5630 (2008). Article  CAS  Google Scholar  * Boorman, E.D., Behrens, T.E.J., Woolrich, M.W.


& Rushworth, M.F.S. How green is the grass on the other side? Frontopolar cortex and the evidence in favor of alternative courses of action. _Neuron_ 62, 733–743 (2009). Article  CAS 


Google Scholar  * Sugrue, L.P., Corrado, G.S. & Newsome, W.T. Choosing the greater of two goods: neural currencies for valuation and decision making. _Nat. Rev. Neurosci._ 6, 363–375


(2005). Article  CAS  Google Scholar  * Vickers, D. Evidence for an accumulator model of psychophysical discrimination. _Ergonomics_ 13, 37–58 (1970). Article  CAS  Google Scholar  *


Insabato, A., Pannunzi, M., Rolls, E.T. & Deco, G. Confidence-related decision making. _J. Neurophysiol._ 104, 539–547 (2010). Article  Google Scholar  * Lau, H. & Rosenthal, D.


Empirical support for higher-order theories of conscious awareness. _Trends Cogn. Sci._ 15, 365–373 (2011). Article  Google Scholar  * Pasquali, A., Timmermans, B. & Cleeremans, A. Know


thyself: metacognitive networks and measures of consciousness. _Cognition_ 117, 182–190 (2010). Article  Google Scholar  * Yokoyama, O. et al. Right frontopolar cortex activity correlates


with reliability of retrospective rating of confidence in short-term recognition memory performance. _Neurosci. Res._ 68, 199–206 (2010). Article  Google Scholar  * Maniscalco, B. & Lau,


H. Comparing signal detection models of perceptual decision confidence. _J. Vis._ 10, 213 (2010). Article  Google Scholar  * Kiani, R. & Shadlen, M.N. Representation of confidence


associated with a decision by neurons in the parietal cortex. _Science_ 324, 759–764 (2009). Article  CAS  Google Scholar  * Summerfield, C. & Tsetsos, K. Building bridges between


perceptual and economic decision-making: neural and computational mechanisms. _Front. Neurosci._ 6, 70 (2012). Article  Google Scholar  * Feldman, H. & Friston, K.J. Attention,


uncertainty, and free-energy. _Front. Hum. Neurosci._ 4, 215 (2010). Article  Google Scholar  * Knill, D.C. & Pouget, A. The Bayesian brain: the role of uncertainty in neural coding and


computation. _Trends Neurosci._ 27, 712–719 (2004). Article  CAS  Google Scholar  * Friston, K. The free-energy principle: a unified brain theory? _Nat. Rev. Neurosci._ 11, 127–138 (2010).


Article  CAS  Google Scholar  * Hare, T.A., Camerer, C.F. & Rangel, A. Self-control in decision-making involves modulation of the vmPFC valuation system. _Science_ 324, 646–648 (2009).


Article  CAS  Google Scholar  * Glimcher, P.W. Indeterminacy in brain and behavior. _Annu. Rev. Psychol._ 56, 25–56 (2005). Article  Google Scholar  * Bahrami, B. et al. Optimally


interacting minds. _Science_ 329, 1081–1085 (2010). Article  CAS  Google Scholar  * Kass, R. Bayes factor. _J. Am. Stat. Assoc._ 430, 773–795 (1995). Article  Google Scholar  * Song, C. et


al. Relating inter-individual differences in metacognitive performance on different perceptual tasks. _Conscious. Cogn._ 20, 1787–1792 (2011). Article  Google Scholar  * Gläscher, J.


Visualization of group inference data in functional neuroimaging. _Neuroinformatics_ 7, 73–82 (2009). Article  Google Scholar  Download references ACKNOWLEDGEMENTS We thank T. Fitzgerald, D.


Kumaran and T. Sharot for comments on a previous draft of this manuscript, and T. Behrens and N. Daw for discussions. This work was supported by a Wellcome Trust Senior Investigator Award,


098362/Z/12/Z to R.J.D.; S.M.F. and B.D.M. are supported by Sir Henry Wellcome Fellowships (B.D.M., 082674/Z/07/Z; S.M.F., WT096185). The Wellcome Trust Centre for Neuroimaging is supported


by core funding from the Wellcome Trust, 091593/Z/10/Z. AUTHOR INFORMATION Author notes * Benedetto De Martino and Stephen M Fleming: These authors contributed equally to this work. AUTHORS


AND AFFILIATIONS * Psychology and Language Sciences, University College London, London, UK Benedetto De Martino & Neil Garrett * Wellcome Trust Center for Neuroimaging, at University


College, London, UK Benedetto De Martino, Stephen M Fleming & Raymond J Dolan * Division of the Humanities and Social Sciences, California Institute of Technology, Pasadena, California,


USA Benedetto De Martino * Center for Neural Science, New York University, New York, New York, USA Stephen M Fleming * Department of Experimental Psychology, University of Oxford, Oxford, UK


Stephen M Fleming Authors * Benedetto De Martino View author publications You can also search for this author inPubMed Google Scholar * Stephen M Fleming View author publications You can


also search for this author inPubMed Google Scholar * Neil Garrett View author publications You can also search for this author inPubMed Google Scholar * Raymond J Dolan View author


publications You can also search for this author inPubMed Google Scholar CONTRIBUTIONS B.D.M. and S.M.F. conceived and designed the study. B.D.M., N.G. and S.M.F. developed stimuli and


gathered and analyzed behavioral and fMRI data. B.D.M., S.M.F. and R.J.D. interpreted the data and wrote the paper. CORRESPONDING AUTHORS Correspondence to Benedetto De Martino or Stephen M


Fleming. ETHICS DECLARATIONS COMPETING INTERESTS The authors declare no competing financial interests. SUPPLEMENTARY INFORMATION SUPPLEMENTARY TEXT AND FIGURES Supplementary Figures 1–4,


Supplementary Tables 1–4 (PDF 598 kb) RIGHTS AND PERMISSIONS Reprints and permissions ABOUT THIS ARTICLE CITE THIS ARTICLE De Martino, B., Fleming, S., Garrett, N. _et al._ Confidence in


value-based choice. _Nat Neurosci_ 16, 105–110 (2013). https://doi.org/10.1038/nn.3279 Download citation * Received: 06 August 2012 * Accepted: 15 November 2012 * Published: 09 December 2012


* Issue Date: January 2013 * DOI: https://doi.org/10.1038/nn.3279 SHARE THIS ARTICLE Anyone you share the following link with will be able to read this content: Get shareable link Sorry, a


shareable link is not currently available for this article. Copy to clipboard Provided by the Springer Nature SharedIt content-sharing initiative