HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Wersing, H. Articles by Körner, E. Search for Related Content PubMed PubMed Citation Articles by Wersing, H. Articles by Körner, E.

Learning Optimized Features for Hierarchical Models of Invariant Object Recognition

heiko.wersing{at}honda-ri.de HONDA Research Institute Europe GmbH, 63073 Offenbach/Main, Germany

Edgar Körner

edgar.koerner{at}honda-ri.de HONDA Research Institute Europe GmbH, 63073 Offenbach/Main, Germany

There is an ongoing debate over the capabilities of hierarchical neural feedforward architectures for performing real-world invariant object recognition. Although a variety of hierarchical models exists, appropriate supervised and unsupervised learning methods are still an issue of intense research. We propose a feedforward model for recognition that shares components like weight sharing, pooling stages, and competitive nonlinearities with earlier approaches but focuses on new methods for learning optimal feature-detecting cells in intermediate stages of the hierarchical network. We show that principles of sparse coding, which were previously mostly applied to the initial feature detection stages, can also be employed to obtain optimized intermediate complex features. We suggest a new approach to optimize the learning of sparse features under the constraints of a weight-sharing or convolutional architecture that uses pooling operations to achieve gradual invariance in the feature hierarchy. The approach explicitly enforces symmetry constraints like translation invariance on the feature set. This leads to a dimension reduction in the search space of optimal features and allows determining more efficiently the basis representatives, which achieve a sparse decomposition of the input. We analyze the quality of the learned feature representation by investigating the recognition performance of the resulting hierarchical network on object and face databases. We show that a hierarchy with features learned on a single object data set can also be applied to face recognition without parameter changes and is competitive with other recent machine learning recognition approaches. To investigate the effect of the interplay between sparse coding and processing nonlinearities, we also consider alternative feedforward pooling nonlinearities such as presynaptic maximum selection and sum-of-squares integration. The comparison shows that a combination of strong competitive nonlinearities with sparse coding offers the best recognition performance in the difficult scenario of segmentation-free recognition in cluttered surround. We demonstrate that for both learning and recognition, a precise segmentation of the objects is not necessary.

This article has been cited by other articles:

				S. Hasler, H. Wersing, and E. Korner Combining reconstruction and discrimination with class-specific sparse coding. Neural Comput., July 1, 2007; 19(7): 1897 - 1918. [Abstract] [Full Text] [PDF]

				T. Serre, A. Oliva, and T. Poggio A feedforward architecture accounts for rapid categorization PNAS, April 10, 2007; 104(15): 6424 - 6429. [Abstract] [Full Text] [PDF]