Neural Comp. Sign up for ETOCS
HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
QUICK SEARCH:   [advanced]


     

This Article
Right arrow Full Text (PDF)
Right arrow Alert me when this article is cited
Right arrow Alert me if a correction is posted
Services
Right arrow Similar articles in this journal
Right arrow Similar articles in PubMed
Right arrow Alert me to new issues of the journal
Right arrow Download to citation manager
Right arrow reprints & permissions
Citing Articles
Right arrow Citing Articles via HighWire
Right arrow Citing Articles via Google Scholar
Google Scholar
Right arrow Articles by Schaal, S.
Right arrow Articles by Atkeson, C. G.
Right arrow Search for Related Content
PubMed
Right arrow PubMed Citation
Right arrow Articles by Schaal, S.
Right arrow Articles by Atkeson, C. G.

Neural Computation, Vol 10, 2047-2084, Copyright © 1998 by The MIT Press

LETTERS

Constructive Incremental Learning from Only Local Information

Stefan Schaal and Christopher G. Atkeson

We introduce a constructive, incremental learning system for regression problems that models data by means of spatially localized linear models. In contrast to other approaches, the size and shape of the receptive field of each locally linear model, as well as the parameters of the locally linear model itself, are learned independently, that is, without the need for competition or any other kind of communication. Independent learning is accomplished by incrementally minimizing a weighted local cross-validation error. As a result, we obtain a learning system that can allocate resources as needed while dealing with the bias-variance dilemma in a principled way. The spatial localization of the linear models increases robustness toward negative interference. Our learning system can be interpreted as a nonparametric adaptive bandwidth smoother, as a mixture of experts where the experts are trained in isolation, and as a learning system that profits from combining independent expert knowledge on the same problem. This article illustrates the potential learning capabilities of purely local learning and offers an interesting and powerful approach to learning with receptive fields.


This article has been cited by other articles:


Home page
 IEICE Trans Inf & SystHome page
K. YAMAUCHI and J. HAYAMI
Incremental Leaning and Model Selection for Radial Basis Function Network through Sleep
IEICE Trans D: Information, March 1, 2007; E90-D(4): 722 - 735.
[Abstract] [PDF]

Home page
 Neural Comput.Home page
S. Vijayakumar, A. D'Souza, and S. Schaal
Incremental Online Learning in High Dimensions
Neural Comput., December 1, 2005; 17(12): 2602 - 2634.
[Abstract] [Full Text] [PDF]

Home page
 Neural Comput.Home page
K. Hsiang Low, W. Kheng Leow, and M. H. Ang Jr.
An Ensemble of Cooperative Extended Kohonen Maps for Complex Robot Motion Tasks
Neural Comput., June 1, 2005; 17(6): 1411 - 1445.
[Abstract] [Full Text] [PDF]

Home page
 Neural Comput.Home page
T. Karkkainen
MLP in Layer-Wise Form with Applications to Weight Decay
Neural Comput., June 1, 2002; 14(6): 1451 - 1480.
[Abstract] [Full Text]

Home page
 Neural Comput.Home page
M.-a. Sato and S. Ishii
On-line EM Algorithm for the Normalized Gaussian Network
Neural Comput., February 1, 2000; 12(2): 407 - 432.
[Abstract] [Full Text]


HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS
J COGNITIVE NEUROSCIENCE NEURAL COMPUTATION MIT PRESS JOURNALS
Copyright © 1998 by The MIT Press.