Skip to main content
  • Poster Presentation
  • Open access
  • Published:

Learning mechanisms for DA-modulated spiking networks in the basal ganglia

How the basal ganglia act to gate cortically planned actions is a topic of current discussion. Interesting work by Gurney et al [13] suggests an interaction between the STN and GPe as a central element of inhibition for action gating, with pathological oscillations occurring if striatal input changes due to dopamine depletion in Parkinson's disease.

But what exactly changes in the signals that the striatum projects to the rest of the basal ganglia? How could the altered dopamine signal and its effect on striatal learning influence the observed functions of the basal ganglia in Parkinsonian and in healthy patients?

While rate-based learning models of the basal ganglia have been suggested [5], a spiking network that reproduces basal ganglia anatomy and autonomously learns a set of possible action sequences that can then be reinforced through dopamine feedback has yet to be demonstrated.

On the way to constructing such a network, we present some effects of spike timing dependent plasticity, synaptic delay, group inhibition, noisy & localised projections and dopamine modulation on feed-forward and associative spiking networks within the basal ganglia and cortex.

References

  1. Gurney K, Prescott TJ, Redgrave P: A computational model of action selection in the basal ganglia. I. A new functional anatomy. Biol. Cybern. 2001, 84: 401-410. 10.1007/PL00007984.

    Article  CAS  PubMed  Google Scholar 

  2. Humphries MD, Stewart RD, Gurney KN: A physiologically plausible model of action selection and oscillatory activity in the basal ganglia. J Neurosci. 2006, 26: 12921-42. 10.1523/JNEUROSCI.3486-06.2006.

    Article  CAS  PubMed  Google Scholar 

  3. Bogacz R, Gurney K: The basal ganglia and cortex implement optimal decision making between alternative actions. Neural Comput. 2007, 19: 442-477. 10.1162/neco.2007.19.2.442.

    Article  PubMed  Google Scholar 

  4. Cisek P: Cortical mechanisms of action selection: the affordance competition hypothesis. Philos Trans R Soc Lond B Biol Sci. 2007, 362: 1585-1599. 10.1098/rstb.2007.2054.

    Article  PubMed Central  PubMed  Google Scholar 

  5. Frank MJ: Dynamic dopamine modulation in the basal ganglia: a neurocomputational account of cognitive deficits in medicated and nonmedicated Parkinsonism. J Cogn Neurosci. 2005, 17: 51-72. 10.1162/0898929052880093.

    Article  PubMed  Google Scholar 

  6. Schultz W: Multiple reward signals in the brain. Nature Reviews Neuroscience. 2000, 1: 199-207. 10.1038/35044563.

    Article  CAS  PubMed  Google Scholar 

  7. Farries MA, Fairhall AL: Reinforcement learning with modulated spike timing dependent synaptic plasticity. Journal of neurophysiology. 2007, 98: 3648-65. 10.1152/jn.00364.2007.

    Article  PubMed  Google Scholar 

  8. Masquelier T, Guyonneau R, Thorpe SJ: Competitive STDP-based spike pattern learning. Neural Computation. 2009, 21: 1259-76. 10.1162/neco.2008.06-08-804.

    Article  PubMed  Google Scholar 

  9. Potjans W, Morrison A, Diesmann M: A spiking neural network model of an actor-critic learning agent. Neural computation. 2009, 21: 301-39. 10.1162/neco.2008.08-07-593.

    Article  PubMed  Google Scholar 

  10. Singh SP, Barto AG, Chenanez N: Intrinsically motivated reinforcement learning. Advances in Neural Information Processing Systems. 2005, 17: 1281-1288.

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Simon M Vogt.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Vogt, S.M., Hofmann, U.G. Learning mechanisms for DA-modulated spiking networks in the basal ganglia. BMC Neurosci 11 (Suppl 1), P106 (2010). https://doi.org/10.1186/1471-2202-11-S1-P106

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-11-S1-P106

Keywords