Advanced

Modular and hierarchical specialization in neural networks

ten Berg, A.J.W.M. and Spaanenburg, Lambert LU (2003) In Istanbul University - Journal of Electrical & Electronics Engineering 3(1). p.719-726
Abstract
Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of feed-forward networks. Further we illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.
Please use this url to cite or link to this publication:
author
organization
publishing date
type
Contribution to journal
publication status
published
subject
keywords
Hierarchy, Structure Transformation, Function Specialization., Modularity, Neural Networks
in
Istanbul University - Journal of Electrical & Electronics Engineering
volume
3
issue
1
pages
719 - 726
language
English
LU publication?
yes
id
33f3ddd0-7720-444b-bb4b-a3f0a90a8673 (old id 602452)
date added to LUP
2007-12-04 11:11:43
date last changed
2016-04-16 11:23:23
@misc{33f3ddd0-7720-444b-bb4b-a3f0a90a8673,
  abstract     = {Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of feed-forward networks. Further we illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.},
  author       = {ten Berg, A.J.W.M. and Spaanenburg, Lambert},
  keyword      = {Hierarchy,Structure Transformation,Function Specialization.,Modularity,Neural Networks},
  language     = {eng},
  number       = {1},
  pages        = {719--726},
  series       = {Istanbul University - Journal of Electrical & Electronics Engineering},
  title        = {Modular and hierarchical specialization in neural networks},
  volume       = {3},
  year         = {2003},
}