Noise suppression in training examples for improving generalization capability.

Abstract

For the supervised learning problem, error correcting memorization learning was proposed in order to suppress noise in teacher signals. In this paper, generalization capability of the learning method is discussed. Generalization capability is evaluated based on the projection learning criterion. We give a necessary and sufficient condition for error correcting memorization learning to provide the same level of generalization as projection learning, and suggest how to choose a training set so as to satisfy the obtained condition. Moreover, it is revealed that noise suppression based on the error correcting memorization learning criterion always has a good effect on improving generalization to the level of projection learning.