Email updates

Keep up to date with the latest news and content from BMC Neuroscience and BioMed Central.

This article is part of the supplement: Sixteenth Annual Computational Neuroscience Meeting: CNS*2007

Open Access Oral presentation

A model for structural plasticity in neocortical associative networks trained by the hippocampus

Andreas Knoblauch1*, Friedrich T Sommer2, Marc-Oliver Gewaltig1, Rüdiger Kupper1, Ursula Körner1 and Edgar Körner1

Author Affiliations

1 Honda Research Institute Europe, D-63073 Offenbach, Germany

2 Redwood Center for Theoretical Neuroscience, University of California, Berkeley, CA, USA

For all author emails, please log on.

BMC Neuroscience 2007, 8(Suppl 2):S14  doi:10.1186/1471-2202-8-S2-S14

The electronic version of this article is the complete one and can be found online at:


Published:6 July 2007

© 2007 Knoblauch et al; licensee BioMed Central Ltd.

Oral presentation

The hippocampal formation plays a crucial role in organizing cortical long-term memory. It is believed that the hippocampus is capable of fast (one-shot) learning of new episodic information followed by extensive time periods where corresponding neocortical representations are trained and "compressed" [1]. Here, compression usually refers to processes such as chunking spatially and temporally distributed activity patterns. We take the complementary approach and optimize the synaptic network by structural plasticity, e.g., replacing unused synapses, thereby making full use of the potential connectivity [2].

We apply the frameworks of structural plasticity and hippocampus-induced learning to the training of neocortical associative networks [3]. Associative networks such as the Hopfield or Willshaw model are at the heart of many cortex theories and have been analyzed for a long time with respect to information storage capacity and plausible retrieval strategies [3,4]. For example, it is well known that a completely connected network can store about 0.7 bits per synapse. However, for incompletely connected networks the capacity per synapse can be massively reduced or even vanish, depending on the retrieval algorithm [4].

In this work we analyze how structural processes and synaptic consolidation [5] during hippocampal training can improve the performance of neocortical associative networks by emulating full (or increased) synaptic connectivity. In our model the hippocampus can store a set of activity patterns by one-shot learning. Then the hippocampus trains the neocortex by repeatedly replaying the patterns in a sequence. The synapses of the neocortical network are consolidated depending on Hebbian learning. In each time step a fraction of the unconsolidated synapses are removed and replaced by the same number of new synapses at random locations thereby maintaining total connectivity. We show that this procedure can massively increase the synaptic capacity of a cortical macrocolumn (factor 10–20 or even up to factor 200 for pattern capacity). In a second step we analyze the model with respect to the time (or number of repetitions) necessary to increase effective connectivity from base level to a desired level. The analysis shows that acceptable training time requires a certain fraction of unconsolidated synapses to keep the network plastic.

References

  1. Buzsaki G: The hippocampo-neocortical dialogue.

    Cerebral Cortex 1996, 6:81-92. PubMed Abstract | Publisher Full Text OpenURL

  2. Stepanyants A, Chklovskii DB: Geometry and structural plasticity of synaptic connectivity.

    Neuron 2002, 34:275-288. PubMed Abstract | Publisher Full Text OpenURL

  3. Knoblauch A: On compressing the memory structures of binary neural associative networks. In Technical Report HRI-EU 06-02. Honda Research Institute Europe, Offenbach, Germany; 2006. OpenURL

  4. Graham B, Willshaw D: Improving recall from an associative memory.

    Biological Cybernetics 1995, 72:337-346. OpenURL

  5. Fusi S, Drew PJ, Abbott LF: Cascade models of synaptically stored memories.

    Neuron 2005, 45:599-611. PubMed Abstract | Publisher Full Text OpenURL