Modular and hierarchical specialization in neural networks
(2003) In Istanbul University - Journal of Electrical & Electronics Engineering 3(1). p.719-726- Abstract
- Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of feed-forward networks. Further we illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.
Please use this url to cite or link to this publication:
https://lup.lub.lu.se/record/602452
- author
- ten Berg, A.J.W.M. and Spaanenburg, Lambert LU
- organization
- publishing date
- 2003
- type
- Contribution to journal
- publication status
- published
- subject
- keywords
- Hierarchy, Structure Transformation, Function Specialization., Modularity, Neural Networks
- in
- Istanbul University - Journal of Electrical & Electronics Engineering
- volume
- 3
- issue
- 1
- pages
- 719 - 726
- language
- English
- LU publication?
- yes
- id
- 33f3ddd0-7720-444b-bb4b-a3f0a90a8673 (old id 602452)
- date added to LUP
- 2016-04-04 13:34:33
- date last changed
- 2018-11-21 21:14:52
@article{33f3ddd0-7720-444b-bb4b-a3f0a90a8673, abstract = {{Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of feed-forward networks. Further we illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.}}, author = {{ten Berg, A.J.W.M. and Spaanenburg, Lambert}}, keywords = {{Hierarchy; Structure Transformation; Function Specialization.; Modularity; Neural Networks}}, language = {{eng}}, number = {{1}}, pages = {{719--726}}, series = {{Istanbul University - Journal of Electrical & Electronics Engineering}}, title = {{Modular and hierarchical specialization in neural networks}}, volume = {{3}}, year = {{2003}}, }