Email updates

Keep up to date with the latest news and content from BMC Neuroscience and BioMed Central.

This article is part of the supplement: Seventeenth Annual Computational Neuroscience Meeting: CNS*2008

Open Access Poster presentation

A mechanism for temporal sequence learning and recognition in neural systems

Sean Byrnes12*, Anthony N Burkitt13, Hamish Meffin4, Chris Trengove12 and David B Grayden13

Author Affiliations

1 The Bionic Ear Institute, Melbourne, Victoria, 3002, Australia

2 Department of Otolaryngology, The University of Melbourne, Melbourne, Victoria, 3010, Australia

3 Department of Electrical and Electronic Engineering, The University of Melbourne, Melbourne, Victoria, 3010, Australia

4 NICTA, c/-Department of Electrical and Electronic Engineering, The University of Melbourne, Melbourne, Victoria, 3010, Australia

For all author emails, please log on.

BMC Neuroscience 2008, 9(Suppl 1):P97  doi:10.1186/1471-2202-9-S1-P97


The electronic version of this article is the complete one and can be found online at: http://www.biomedcentral.com/1471-2202/9/S1/P97


Published:11 July 2008

© 2008 Byrnes et al; licensee BioMed Central Ltd.

Background

We propose a network structure, inspired by experimental data on the neural correlates of navigation in the hippocampus [1], that learns to recognize sequences of symbols. An interaction of rhythmic inhibition with input conveying symbol information, similar to that proposed in [2], renders the model robust to wide variations in the rate of presentation of symbols and enables relationships between symbols to be learnt via spike-timing dependent plasticity. Competitive heterosynaptic plasticity results in the specialization of neurons to particular sequences so that our model is able to learn and recognize multiple sequences that share common subsequences, a capacity that was absent in earlier sequence learning models.

Model

The network consists of pools of leaky integrate and fire neurons, with one such pool for each symbol. On presentation of a symbol, excitatory (Poisson) input commences to the corresponding pool. When a symbol is first presented it is represented by weak input, then the strength of input ramps up before turning off. As in [2], the rhythmic inhibition combines with the ramp-like input to result in sequence compression, i.e. the firing of the most recent symbols in the correct order during each cycle of the inhibition. Sequence compression ensures both the appropriate timescale for spike-timing dependent plasticity and robustness to variation in symbol presentation rate.

Connections between pools are subject to spike-timing dependent plasticity (in which synaptic strength is increased when the presynaptic neuron spikes shortly before the postsynaptic neuron). Synapses between pools corresponding to consecutive symbols are strengthened. Those neurons that receive such connections from the previously active pool fire with reduced latency; recurrent inhibition then prevents the other neurons of the pool from firing at all. Subtractive normalization, in which the total strength of the synapses onto a particular neuron is held constant [3], leads to competition so that each neuron specializes to a particular presynaptic group, resulting ultimately in neurons specialized to particular sequences.

Results

A nonplastic network specified according to the scheme above is shown to correctly classify sequences with lengthy overlaps and to be robust to variation in symbol duration. Its classification performance is shown to degrade gracefully with perturbation of its parameters. A plastic network, trained on overlapping sequences presented with equal frequency, demonstrates correct classification behaviour. The effectiveness of training is sensitive to the frequency with which competing sequences are presented and to variation in the sizes of subpools corresponding to subsequences.

References

  1. Skaggs WE, McNaughton BL, Wilson BL, Barnes CA: Theta phase precession in hippocampal neuronal populations and the compression of temporal sequences.

    Hippocampus 1996, 6(2):149-172. PubMed Abstract | Publisher Full Text OpenURL

  2. Mehta MR, Lee AK, Wilson MA: Role of experience and oscillations in transforming a rate code into a temporal code.

    Nature 2002, 417(6890):741-746. PubMed Abstract | Publisher Full Text OpenURL

  3. Royer S, Pare D: Conservation of total synaptic weight through balanced synaptic depression and potentiation.

    Nature 2003, 422(6931):518-522. PubMed Abstract | Publisher Full Text OpenURL