HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via Google Scholar Google Scholar Articles by Osindero, S. Articles by Hinton, G. E. Search for Related Content PubMed Articles by Osindero, S. Articles by Hinton, G. E.

Topographic Product Models Applied to Natural Scene Statistics

osindero{at}cs.toronto.edu Department of Computer Science, University of Toronto, Toronto, Ontario, M5S 3G4, Canada

Max Welling

welling{at}ics.uci.edu Department of Computer Science, University of California Irvine, Irvine, CA 92697-3425, U.S.A.

Geoffrey E. Hinton

hinton{at}cs.toronto.edu Canadian Institute for Advanced Research and Department of Computer Science, University of Toronto, Toronto, Ontario, M5S 3G4, Canada

We present an energy-based model that uses a product of generalized Student-t distributions to capture the statistical structure in data sets. This model is inspired by and particularly applicable to "natural" data sets such as images. We begin by providing the mathematical framework, where we discuss complete and overcomplete models and provide algorithms for training these models from data. Using patches of natural scenes, we demonstrate that our approach represents a viable alternative to independent component analysis as an interpretive model of biological visual systems. Although the two approaches are similar in flavor, there are also important differences, particularly when the representations are overcomplete. By constraining the interactions within our model, we are also able to study the topographic organization of Gabor-like receptive fields that our model learns. Finally, we discuss the relation of our new approach to previous work—in particular, gaussian scale mixture models and variants of independent components analysis.