Browsing by Author "Done, John"

Now showing 1 - 3 of 3

Citation - WoS: 10
Citation - Scopus: 11
Common and Distinct Functional Brain Networks for Intuitive and Deliberate Decision Making
(Mdpi, 2019) Erdeniz, Burak; Done, John
Reinforcement learning studies in rodents and primates demonstrate that goal-directed and habitual choice behaviors are mediated through different fronto-striatal systems, but the evidence is less clear in humans. In this study, functional magnetic resonance imaging (fMRI) data were collected whilst participants (n = 20) performed a conditional associative learning task in which blocks of novel conditional stimuli (CS) required a deliberate choice, and blocks of familiar CS required an intuitive choice. Using standard subtraction analysis for fMRI event-related designs, activation shifted from the dorso-fronto-parietal network, which involves dorsolateral prefrontal cortex (DLPFC) for deliberate choice of novel CS, to ventro-medial frontal (VMPFC) and anterior cingulate cortex for intuitive choice of familiar CS. Supporting this finding, psycho-physiological interaction (PPI) analysis, using the peak active areas within the PFC for novel and familiar CS as seed regions, showed functional coupling between caudate and DLPFC when processing novel CS and VMPFC when processing familiar CS. These findings demonstrate separable systems for deliberate and intuitive processing, which is in keeping with rodent and primate reinforcement learning studies, although in humans they operate in a dynamic, possibly synergistic, manner particularly at the level of the striatum.
Citation - WoS: 2
Citation - Scopus: 2
Neural Correlates of Opponent Processes for Financial Gains and Losses
(Ege Univ, 2019) Erdeniz, Burak; Done, John
Objective: Functional imaging studies offer alternative explanations for the neural correlates of monetary gain and loss related brain activity, and their opponents, omission of gains and losses. One possible explanation based on the psychology of opponent process theory suggests that successful avoidance of an aversive outcome is itself rewarding, and hence activates brain regions involved in reward processing. In order to test this hypothesis, we compared brain activation for successful avoidance of losses and receipt of monetary gains. Additionally, the brain regions involved in processing of frustrative neutral outcomes and actual losses were compared in order to test whether these two representations are coded in common or distinct brain regions. Methods: Using a 3 Tesla functional magnetic resonance imaging machine, fifteen healthy volunteers between the ages 22 to 28 were scanned for blood oxygen level dependent signal changes while they were performing a probabilistic learning task, wherein each trial a participant chose one of the two available options in order to win or avoid losing money. Results: The results confirmed, previous findings showing that medial frontal cortex and ventral striatum show significant activation (p<0.001) not only for monetary gains but also for successful avoidance of losses. A similar activation pattern was also observed for monetary losses and avoidance of gains in the medial frontal cortex, and posterior cingulate cortex, however, there was increased activation in a mygdala specific to monetary losses (p<0.001). Further, subtraction analysis showed that regardless of the type of loss (i.e., frustrative neutral outcomes) posterior insula showed increased activation. Conclusion: This study provides evidence for a significant overlap not only between gains and losses, but also between their opponents. The results suggested that the overlapping activity pattern in the medial frontal cortex could be explained by a more abstract function of medial frontal cortex, such as outcome evaluation or performance monitoring, which possibly does not differentiate between winning and losing monetary outcomes.
Citation - WoS: 2
Citation - Scopus: 1
Towards Automaticity in Reinforcement Learning: a Model-Based Functional Magnetic Resonance Imaging Study
(Turkish Neuropsychiatry Assoc-Turk Noropsikiyatri Dernegi, 2020) Erdeniz, Burak; Done, John
Introduction: Previous studies showed that over the course of learning many neurons in the medial prefrontal cortex adapt their firing rate towards the options with highest predicted value reward but it was showed that during later learning trials the brain switches to a more automatic processing mode governed by the basal ganglia. Based on this evidence, we hypothesized that during the early learning trials the predicted values of chosen options will be coded by a goal directed system in the medial frontal cortex but during the late trials the predicted values will be coded by the habitual learning system in the dorsal striatum. Methods: In this study, using a 3 Tesla functional magnetic resonance imaging scanner (fMRI), blood oxygen level dependent signal (BOLD) data was collected whilst participants (N=12) performed a reinforcement learning task. The task consisted of instrumental conditioning trials wherein each trial a participant choose one of the two available options in order to win or avoid losing money. In addition to that, depending on the experimental condition, participants received either monetary reward (gain money), monetary penalty (lose money) or neural outcome. Results: Using model-based analysis for functional magnetic resonance imaging (fMRI) event related designs; region of interest (ROI) analysis was performed to nucleus accumbens, medial frontal cortex, caudate nucleus, putamen and globus pallidus internal and external segments. In order to compare the difference in brain activity for early (goal directed) versus late learning (habitual, automatic) trials, separate ROI analyses were performed for each anatomical sub-region. For the reward condition, we found significant activity in the medial frontal cortex (p<0.05) only for early learning trials but activity is shifted to bilateral putamen (p<0.05) during later trials. However, for the loss condition no significant activity was found for early trials except globus pallidus internal segment showed a significant activity (p<0.05) for later trials. Conclusion: We found that during reinforcement learning activation in the brain shifted from the medial frontal regions to dorsal regions of the striatum. These findings suggest that there are two separable (early goal directed and late habitual) learning systems in the brain.