Neural Comp. NEW Faster Access
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
 QUICK SEARCH:   [advanced]


     


This Article
Right arrow Full Text
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Smithies, R.
Right arrow Articles by Queen, N.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Smithies, R.
Right arrow Articles by Queen, N.
(Neural Computation. 2004;16:139-157.)
© 2004 The MIT Press


Letter

Adaptive Hybrid Learning for Neural Networks

Rob Smithies

smithier{at}for.mat.bham.ac.uk, School of Mathematics and Statistics, University of Birmingham, Birmingham B15 2TT, U.K.

Said Salhi

s.salhi{at}bham.ac.uk, School of Mathematics and Statistics, University of Birmingham, Birmingham B15 2TT, U.K.

Nat Queen

n.m.queen{at}bham.ac.uk, School of Mathematics and Statistics, University of Birmingham, Birmingham B15 2TT, U.K.

A robust locally adaptive learning algorithm is developed via two enhancements of the Resilient Propagation (RPROP) method. Remaining drawbacks of the gradient-based approach are addressed by hybridization with gradient-independent Local Search. Finally, a global optimization method based on recursion of the hybrid is constructed, making use of tabu neighborhoods to accelerate the search for minima through diversification. Enhanced RPROP is shown to be faster and more accurate than the standard RPROP in solving classification tasks based on natural data sets taken from the UCI repository of machine learning databases. Furthermore, the use of Local Search is shown to improve Enhanced RPROP by solving the same classification tasks as part of the global optimization method.







HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 2004 by The MIT Press.