| Paper: | PS-1A.63 | ||
| Session: | Poster Session 1A | ||
| Location: | H Lichthof | ||
| Session Time: | Saturday, September 14, 16:30 - 19:30 | ||
| Presentation Time: | Saturday, September 14, 16:30 - 19:30 | ||
| Presentation: | Poster | ||
| Publication: | 2019 Conference on Cognitive Computational Neuroscience, 13-16 September 2019, Berlin, Germany | ||
| Paper Title: | The orbitofrontal cortex as a negative feedback control system: computational modeling and fMRI | ||
| Manuscript: | Click here to view manuscript | ||
| License: |  This work is licensed under a Creative Commons Attribution 3.0 Unported License. |
||
| DOI: | https://doi.org/10.32470/CCN.2019.1070-0 | ||
| Authors: | Noah Zarr, Joshua Brown, Indiana University, United States | ||
| Abstract: | In this work we address two inter-related issues. First, the computational roles of the orbitofrontal cortex (OFC) and hippocampus in value-based decision-making have been unclear, with various proposed roles in value representation, cognitive maps, and prospection. Second, reinforcement learning models have been slow to adapt to more general problems in which the reward values of states may change over time, thus requiring different Q values for a given state at different times. We have developed a model of artificial general intelligence that treats much of the brain as a high dimensional control system in the framework of control theory. We show with computational modeling and combined fMRI and representational similarity analysis (RSA) that the model can autonomously learn to solve problems and provides a clear computational account of how a number of brain regions, particularly the OFC, interact to guide behavior to achieve arbitrary goals. | ||