Questioning the role of sparse coding in the brain.
(2015) In Trends in Neurosciences 38(7). p.417-427- Abstract
- Coding principles are central to understanding the organization of brain circuitry. Sparse coding offers several advantages, but a near-consensus has developed that it only has beneficial properties, and these are partially unique to sparse coding. We find that these advantages come at the cost of several trade-offs, with the lower capacity for generalization being especially problematic, and the value of sparse coding as a measure and its experimental support are both questionable. Furthermore, silent synapses and inhibitory interneurons can permit learning speed and memory capacity that was previously ascribed to sparse coding only. Combining these properties without exaggerated sparse coding improves the capacity for generalization and... (More)
- Coding principles are central to understanding the organization of brain circuitry. Sparse coding offers several advantages, but a near-consensus has developed that it only has beneficial properties, and these are partially unique to sparse coding. We find that these advantages come at the cost of several trade-offs, with the lower capacity for generalization being especially problematic, and the value of sparse coding as a measure and its experimental support are both questionable. Furthermore, silent synapses and inhibitory interneurons can permit learning speed and memory capacity that was previously ascribed to sparse coding only. Combining these properties without exaggerated sparse coding improves the capacity for generalization and facilitates learning of models of a complex and high-dimensional reality. (Less)
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/7484450
- author
- Spanne, Anton LU and Jörntell, Henrik LU
- organization
- publishing date
- 2015
- type
- Contribution to journal
- publication status
- published
- subject
- in
- Trends in Neurosciences
- volume
- 38
- issue
- 7
- pages
- 417 - 427
- publisher
- Elsevier
- external identifiers
-
- pmid:26093844
- wos:000357757500005
- scopus:84937191224
- pmid:26093844
- ISSN
- 1878-108X
- DOI
- 10.1016/j.tins.2015.05.005
- language
- English
- LU publication?
- yes
- id
- 231ba04d-53c7-4931-a389-dc85aec6ef0a (old id 7484450)
- alternative location
- http://www.ncbi.nlm.nih.gov/pubmed/26093844?dopt=Abstract
- date added to LUP
- 2016-04-01 10:07:27
- date last changed
- 2022-03-19 17:34:02
@article{231ba04d-53c7-4931-a389-dc85aec6ef0a,
abstract = {{Coding principles are central to understanding the organization of brain circuitry. Sparse coding offers several advantages, but a near-consensus has developed that it only has beneficial properties, and these are partially unique to sparse coding. We find that these advantages come at the cost of several trade-offs, with the lower capacity for generalization being especially problematic, and the value of sparse coding as a measure and its experimental support are both questionable. Furthermore, silent synapses and inhibitory interneurons can permit learning speed and memory capacity that was previously ascribed to sparse coding only. Combining these properties without exaggerated sparse coding improves the capacity for generalization and facilitates learning of models of a complex and high-dimensional reality.}},
author = {{Spanne, Anton and Jörntell, Henrik}},
issn = {{1878-108X}},
language = {{eng}},
number = {{7}},
pages = {{417--427}},
publisher = {{Elsevier}},
series = {{Trends in Neurosciences}},
title = {{Questioning the role of sparse coding in the brain.}},
url = {{http://dx.doi.org/10.1016/j.tins.2015.05.005}},
doi = {{10.1016/j.tins.2015.05.005}},
volume = {{38}},
year = {{2015}},
}