A self-supervised learning system for pattern recognition by sensory integration.

Abstract

Artificial neural networks are useful tools for pattern recognition because they realize nonlinear mapping between input and output spaces. This ability is tuned by supervised learning methods such as back-propagation. In the supervised learning methods, desired outputs of the neural network are needed. However, the desired outputs are usually unknown in unpredictable environments. To solve this problem, this paper presents a self-supervised learning system for category detection. This system learns categories of objects automatically by integrating information from several sensors. We assume that these sensory inputs are always ambiguous patterns that include some noises according to deformations of the objects. After the learning, the system recognizes objects, also controlling the priority of each sensor, according to the deformation of the sensory input pattern.In the simulation, the system is applied to several learning and recognition tasks using artificial or actual sensory inputs. In all tasks, the system found the categories. Particularly, we applied the new system to the learning of five Japanese vowels with the corresponding shapes of the mouth. As result, the system became to yield specific outputs corresponding to each vowel.