HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Schmitt, M. Search for Related Content PubMed PubMed Citation Articles by Schmitt, M.

Neural Networks with Local Receptive Fields and Superlinear VC Dimension

mschmitt{at}lmi.ruhr-uni-bochum.de, Lehrstuhl Mathematik und Informatik, Fakultät für Mathematik Ruhr-Universität Bochum, D–44780 Bochum, Germany

Local receptive field neurons comprise such well-known and widely used unit types as radial basis function (RBF) neurons and neurons with center-surround receptive field. We study the Vapnik-Chervonenkis (VC) dimension of feedforward neural networks with one hidden layer of these units. For several variants of local receptive field neurons, we show that the VC dimension of these networks is superlinear. In particular, we establish the bound (Wlogk) for any reasonably sized network with W parameters and k hidden nodes. This bound is shown to hold for discrete center-surround receptive field neurons, which are physiologically relevant models of cells in the mammalian visual system, for neurons computing a difference of gaussians, which are popular in computational vision, and for standard RBF neurons, a major alternative to sigmoidal neurons in artificial neural networks. The result for RBF neural networks is of particular interest since it answers a question that has been open for several years. The results also give rise to lower bounds for networks with fixed input dimension. Regarding constants, all bounds are larger than those known thus far for similar architectures with sigmoidal neurons. The superlinear lower bounds contrast with linear upper bounds for single local receptive field neurons also derived here.

This article has been cited by other articles:

				M. Schmitt On the Capabilities of Higher-Order Neurons: A Radial Basis Function Approach Neural Comput., March 1, 2005; 17(3): 715 - 729. [Abstract] [Full Text] [PDF]

				M. Schmitt Descartes' Rule of Signs for Radial Basis Function Neural Networks Neural Comput., December 1, 2002; 14(12): 2997 - 3011. [Abstract] [Full Text]