HOME HELP FEEDBACK SUBSCRIPTIONS ARCHIVE SEARCH TABLE OF CONTENTS		QUICK SEARCH:   [advanced] Author: Keyword(s): Year:  Vol:  Page:

This Article Full Text Full Text (PDF) Alert me when this article is cited Alert me if a correction is posted Services Similar articles in this journal Similar articles in PubMed Alert me to new issues of the journal Download to citation manager Citing Articles Citing Articles via HighWire Citing Articles via Google Scholar Google Scholar Articles by Jacobsson, H. Search for Related Content PubMed PubMed Citation Articles by Jacobsson, H.

Rule Extraction from Recurrent Neural Networks: A Taxonomy and Review

henrik.jacobsson{at}his.se, School of Humanities and Informatics, University of Skövde, Skövde, Sweden, and Department of Computer Science, University of Sheffield, United Kingdom.

Rule extraction (RE) from recurrent neural networks (RNNs) refers to finding models of the underlying RNN, typically in the form of finite state machines, that mimic the network to a satisfactory degree while having the advantage of being more transparent. RE from RNNs can be argued to allow a deeper and more profound form of analysis of RNNs than other, more or less ad hoc methods. RE may give us understanding of RNNs in the intermediate levels between quite abstract theoretical knowledge of RNNs as a class of computing devices and quantitative performance evaluations of RNN instantiations. The development of techniques for extraction of rules from RNNs has been an active field since the early 1990s. This article reviews the progress of this development and analyzes it in detail. In order to structure the survey and evaluate the techniques, a taxonomy specifically designed for this purpose has been developed. Moreover, important open research issues are identified that, if addressed properly, possibly can give the field a significant push forward.

This article has been cited by other articles:

				H. Jacobsson The Crystallizing Substochastic Sequential Machine Extractor: CrySSMEx. Neural Comput., September 1, 2006; 18(9): 2211 - 2255. [Abstract] [Full Text] [PDF]

				P. Tino and A. J. S. Mills Learning beyond finite memory in recurrent networks of spiking neurons. Neural Comput., March 1, 2006; 18(3): 591 - 613. [Abstract] [Full Text] [PDF]