Entropy learning in neural network
In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entropy...
Main Authors: | Geok, See Ng, Shi, Daming, Abdul Rahman, Abdul Wahab, Singh, H. |
---|---|
Format: | Article |
Language: | English |
Published: |
ASEAN Committee on Science and Technology
2003
|
Subjects: | |
Online Access: | http://irep.iium.edu.my/38199/ http://irep.iium.edu.my/38199/ http://irep.iium.edu.my/38199/1/ENTROPY_LEARNING_IN_NEURAL_NETWORK.pdf |
Similar Items
-
Entropy learning and relevance criteria for neural network pruning
by: Geok, See Ng, et al.
Published: (2003) -
Feature extraction for neural-fuzzy inference system
by: Quek, Chai, et al.
Published: (2003) -
Application of EFUNN for the classification of handwritten digits
by: Geok, See Ng, et al.
Published: (2004) -
Fault tolerant hardware for high performance signal processing
by: Erdogan, S. S., et al.
Published: (2008) -
An experimental study of the extended NRBF regression model and its enhancement for classification problem
by: Ma, L., et al.
Published: (2008)