Entropy learning in neural network

In this paper, entropy term is used in the learning phase of a neural network. As learning progresses, more hidden nodes get into saturation. The early creation of such hidden nodes may impair generalisation. Hence entropy approach is proposed to dampen the early creation of such nodes. The entropy...

Full description

Bibliographic Details
Main Authors: Geok, See Ng, Shi, Daming, Abdul Rahman, Abdul Wahab, Singh, H.
Format: Article
Language:English
Published: ASEAN Committee on Science and Technology 2003
Subjects:
Online Access:http://irep.iium.edu.my/38199/
http://irep.iium.edu.my/38199/
http://irep.iium.edu.my/38199/1/ENTROPY_LEARNING_IN_NEURAL_NETWORK.pdf