Skip to main content

On efficient sparse spike coding schemes for learning natural scenes in the primary visual cortex

We describe the theoretical formulation of a learning algorithm in a model of the primary visual cortex (V1) and present results of the efficiency of this algorithm by comparing it to the SparseNet algorithm [1]. As the SparseNet algorithm, it is based on a model of signal synthesis as a Linear Generative Model but differs in the efficiency criteria for the representation. This learning algorithm is in fact based on an efficiency criteria based on the Occam razor: for a similar quality, the shortest representation should be privileged. This inverse problem is NP-complete and we propose here a greedy solution which is based on the architecture and nature of neural computations [2]). It proposes that the supra-threshold neural activity progressively removes redundancies in the representation based on a correlation-based inhibition and provides a dynamical implementation close to the concept of neural assemblies from Hebb [3]). We present here results of simulation of this network with small natural images (available at http://incm.cnrs-mrs.fr/LaurentPerrinet/SparseHebbianLearning) and compare it to the Sparsenet solution. Extending it to realistic images and to the NEST simulator http://www.nest-initiative.org/, we show that this learning algorithm based on the properties of neural computations produces adaptive and efficient representations in V1.

References

  1. Olshausen B, Field DJ: Sparse coding with an overcomplete basis set: A strategy employed by V1?. Vision Res. 1997, 37: 3311-3325. 10.1016/S0042-6989(97)00169-7.

    Article  PubMed  CAS  Google Scholar 

  2. Perrinet L: Feature detection using spikes: the greedy approach. J Physiol Paris. 2004, 98 (4–6): 530-539. 10.1016/j.jphysparis.2005.09.012.

    Article  PubMed  Google Scholar 

  3. Hebb DO: The organization of behavior. 1949, Wiley, New York

    Google Scholar 

Download references

Acknowledgements

This was work supported by the 6th RFP of the EU (grant no. 15879-FACETS). Simulations use the PyNN software available at http://pynn.gforge.inria.fr/.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laurent Perrinet.

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Perrinet, L. On efficient sparse spike coding schemes for learning natural scenes in the primary visual cortex. BMC Neurosci 8 (Suppl 2), P206 (2007). https://doi.org/10.1186/1471-2202-8-S2-P206

Download citation

  • Published:

  • DOI: https://doi.org/10.1186/1471-2202-8-S2-P206

Keywords