Neural Computation, Vol 10, 281-293, Copyright © 1998 by The MIT Press

NOTES

Combined Learning and Use for a Mixture Model Equivalent to the RBF Classifier

David Miller and Hasan S. Uyar

We show that the decision function of a radial basis function (RBF) classifier is equivalent in form to the Bayes-optimal discriminant associated with a special kind of mixture-based statistical model. The relevant mixture model is a type of mixture-of-experts model for which class labels, like continuous-valued features, are assumed to have been generated randomly, conditional on the mixture component of origin. The new interpretation shows that RBF classifiers effectively assume a probability model, which, moreover, is easily determined given the designed RBF. This interpretation also suggests a statistical learning objective as an alternative to standard methods for designing the RBF-equivalent models. The statistical objective is especially useful for incorporating unlabeled data to enhance learning. Finally, it is observed that any new data to classify are simply additional unlabeled data. Thus, we suggest a combined learning and use paradigm, to be invoked whenever there are new data to classify.

This article has been cited by other articles:

				M. K. Titsias and A. Likas Mixture of Experts Classification Using a Hierarchical Mixture Model Neural Comput., September 1, 2002; 14(9): 2221 - 2244. [Abstract] [Full Text] [PDF]

				J.-M. Wu Natural Discriminant Analysis Using Interactive Potts Models Neural Comput., March 1, 2002; 14(3): 689 - 713. [Abstract] [Full Text]