Contemplation vs. intuition

a reinforcement learning perspective

In-Koo Cho, Anna Rubinchik

Research output: Contribution to journalArticle

Abstract

In a search for a positive model of decision-making with observable primitives, we rely on the burgeoning literature in cognitive neuroscience to construct a three-element machine (agent). Its control unit initiates either impulsive or cognitive elements to solve a problem in a stationary Markov environment, the element chosen depends on whether the problem is mundane or novel, memory of past successes, and the strength of inhibition. Our predictions are based on a stationary asymptotic distribution of the memory, which, depending on the parameters, can generate different “characters”, e.g., an uptight dimwit, who could succeed more often with less inhibition, as well as a laid-back wise-guy, who could gain more with a stronger inhibition of impulsive (intuitive) responses. As one would expect, stronger inhibition and lower cognitive costs increase the frequency of decisions made by the cognitive element. More surprisingly, increasing the “carrot” and reducing the “stick” (being in a more supportive environment) enhance contemplative decisions (made by the cognitive unit) for an alert agent, i.e., the one who identifies novel problems frequently enough.

Original languageEnglish (US)
Pages (from-to)141-167
Number of pages27
JournalEURO Journal on Decision Processes
Volume5
Issue number1-4
DOIs
StatePublished - Nov 1 2017

Fingerprint

Reinforcement learning
Reinforcement Learning
Data storage equipment
Chemical elements
Decision making
Carrot
Unit
Neuroscience
Stationary Distribution
Asymptotic distribution
Costs
Intuitive
Decision Making
Intuition
Prediction
Model

Keywords

  • 35B40
  • 60G99
  • 91C99
  • Adaptive learning
  • Executive control
  • Inhibition
  • Stochastic approximation
  • The two-system decision-making

ASJC Scopus subject areas

  • Decision Sciences(all)
  • Statistics and Probability
  • Business, Management and Accounting (miscellaneous)
  • Computational Mathematics
  • Applied Mathematics

Cite this

Contemplation vs. intuition : a reinforcement learning perspective. / Cho, In-Koo; Rubinchik, Anna.

In: EURO Journal on Decision Processes, Vol. 5, No. 1-4, 01.11.2017, p. 141-167.

Research output: Contribution to journalArticle

Cho, In-Koo ; Rubinchik, Anna. / Contemplation vs. intuition : a reinforcement learning perspective. In: EURO Journal on Decision Processes. 2017 ; Vol. 5, No. 1-4. pp. 141-167.
@article{e20d81f6b9514f7789b3e816d1e8de8e,
title = "Contemplation vs. intuition: a reinforcement learning perspective",
abstract = "In a search for a positive model of decision-making with observable primitives, we rely on the burgeoning literature in cognitive neuroscience to construct a three-element machine (agent). Its control unit initiates either impulsive or cognitive elements to solve a problem in a stationary Markov environment, the element chosen depends on whether the problem is mundane or novel, memory of past successes, and the strength of inhibition. Our predictions are based on a stationary asymptotic distribution of the memory, which, depending on the parameters, can generate different “characters”, e.g., an uptight dimwit, who could succeed more often with less inhibition, as well as a laid-back wise-guy, who could gain more with a stronger inhibition of impulsive (intuitive) responses. As one would expect, stronger inhibition and lower cognitive costs increase the frequency of decisions made by the cognitive element. More surprisingly, increasing the “carrot” and reducing the “stick” (being in a more supportive environment) enhance contemplative decisions (made by the cognitive unit) for an alert agent, i.e., the one who identifies novel problems frequently enough.",
keywords = "35B40, 60G99, 91C99, Adaptive learning, Executive control, Inhibition, Stochastic approximation, The two-system decision-making",
author = "In-Koo Cho and Anna Rubinchik",
year = "2017",
month = "11",
day = "1",
doi = "10.1007/s40070-017-0068-x",
language = "English (US)",
volume = "5",
pages = "141--167",
journal = "EURO Journal on Decision Processes",
issn = "2193-9438",
publisher = "Springer Berlin",
number = "1-4",

}

TY - JOUR

T1 - Contemplation vs. intuition

T2 - a reinforcement learning perspective

AU - Cho, In-Koo

AU - Rubinchik, Anna

PY - 2017/11/1

Y1 - 2017/11/1

N2 - In a search for a positive model of decision-making with observable primitives, we rely on the burgeoning literature in cognitive neuroscience to construct a three-element machine (agent). Its control unit initiates either impulsive or cognitive elements to solve a problem in a stationary Markov environment, the element chosen depends on whether the problem is mundane or novel, memory of past successes, and the strength of inhibition. Our predictions are based on a stationary asymptotic distribution of the memory, which, depending on the parameters, can generate different “characters”, e.g., an uptight dimwit, who could succeed more often with less inhibition, as well as a laid-back wise-guy, who could gain more with a stronger inhibition of impulsive (intuitive) responses. As one would expect, stronger inhibition and lower cognitive costs increase the frequency of decisions made by the cognitive element. More surprisingly, increasing the “carrot” and reducing the “stick” (being in a more supportive environment) enhance contemplative decisions (made by the cognitive unit) for an alert agent, i.e., the one who identifies novel problems frequently enough.

AB - In a search for a positive model of decision-making with observable primitives, we rely on the burgeoning literature in cognitive neuroscience to construct a three-element machine (agent). Its control unit initiates either impulsive or cognitive elements to solve a problem in a stationary Markov environment, the element chosen depends on whether the problem is mundane or novel, memory of past successes, and the strength of inhibition. Our predictions are based on a stationary asymptotic distribution of the memory, which, depending on the parameters, can generate different “characters”, e.g., an uptight dimwit, who could succeed more often with less inhibition, as well as a laid-back wise-guy, who could gain more with a stronger inhibition of impulsive (intuitive) responses. As one would expect, stronger inhibition and lower cognitive costs increase the frequency of decisions made by the cognitive element. More surprisingly, increasing the “carrot” and reducing the “stick” (being in a more supportive environment) enhance contemplative decisions (made by the cognitive unit) for an alert agent, i.e., the one who identifies novel problems frequently enough.

KW - 35B40

KW - 60G99

KW - 91C99

KW - Adaptive learning

KW - Executive control

KW - Inhibition

KW - Stochastic approximation

KW - The two-system decision-making

UR - http://www.scopus.com/inward/record.url?scp=85065134691&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065134691&partnerID=8YFLogxK

U2 - 10.1007/s40070-017-0068-x

DO - 10.1007/s40070-017-0068-x

M3 - Article

VL - 5

SP - 141

EP - 167

JO - EURO Journal on Decision Processes

JF - EURO Journal on Decision Processes

SN - 2193-9438

IS - 1-4

ER -