Header menu link for other important links
X
Modeling the Contributions of Basal Ganglia and Hippocampus to Spatial Navigation Using Reinforcement Learning
Maithreye Rengaswamy,
Published in
2012
PMID: 23110073
Volume: 7
   
Issue: 10
Abstract
A computational neural model that describes the competing roles of Basal Ganglia and Hippocampus in spatial navigation is presented. Model performance is evaluated on a simulated Morris water maze explored by a model rat. Cue-based and place-based navigational strategies, thought to be subserved by the Basal ganglia and Hippocampus respectively, are described. In cue-based navigation, the model rat learns to directly head towards a visible target, while in place-based navigation the target position is represented in terms of spatial context provided by an array of poles placed around the pool. Learning is formulated within the framework of Reinforcement Learning, with the nigrostriatal dopamine signal playing the role of Temporal Difference Error. Navigation inherently involves two apparently contradictory movements: goal oriented movements vs. random, wandering movements. The model hypothesizes that while the goal-directedness is determined by the gradient in Value function, randomness is driven by the complex activity of the SubThalamic Nucleus (STN)-Globus Pallidus externa (GPe) system. Each navigational system is associated with a Critic, prescribing actions that maximize value gradients for the corresponding system. In the integrated system, that incorporates both cue-based and place-based forms of navigation, navigation at a given position is determined by the system whose value function is greater at that position. The proposed model describes the experimental results of [1], a lesion-study that investigates the competition between cue-based and place-based navigational systems. The present study also examines impaired navigational performance under Parkinsonian-like conditions. The integrated navigational system, operated under dopamine-deficient conditions, exhibits increased escape latency as was observed in experimental literature describing MPTP model rats navigating a water maze. © 2012 Sukumar et al.
About the journal
JournalPLoS ONE
ISSN19326203
Open AccessYes
Concepts (28)
  •  related image
    Dopamine
  •  related image
    Article
  •  related image
    Artificial neural network
  •  related image
    Association
  •  related image
    BASAL GANGLION
  •  related image
    Computer simulation
  •  related image
    DOPAMINERGIC TRANSMISSION
  •  related image
    ESCAPE BEHAVIOR
  •  related image
    GLOBUS PALLIDUS
  •  related image
    Hippocampus
  •  related image
    MAZE TEST
  •  related image
    Motivation
  •  related image
    Movement (physiology)
  •  related image
    NIGRONEOSTRIATAL SYSTEM
  •  related image
    Parkinson disease
  •  related image
    Reinforcement
  •  related image
    Spatial navigation
  •  related image
    Spatial orientation
  •  related image
    SUBTHALAMIC NUCLEUS
  •  related image
    TASK PERFORMANCE
  •  related image
    Animals
  •  related image
    BASAL GANGLIA
  •  related image
    Models, theoretical
  •  related image
    Rats
  •  related image
    REINFORCEMENT (PSYCHOLOGY)
  •  related image
    Space perception
  •  related image
    PARKINSONIA
  •  related image
    Rattus