A Numerical Implementation of Kolmogorov's Superpositions.

Abstract

Hecht-Nielsen proposed a feedforward neural network based on Kolmogorov's superpositionsf(x(i), em leader,x(n))= summation operator q=02piPhi(q)(y(q)) that apply to all real valued continuous functions f(x(1), em leader, x(n)) defined on a Euclidean unit cube of dimension n >/= 2. This network has a hidden layer that is independent of f and that transforms the n-tuples (x(1), em leader, x(n)) into the 2n + 1 variables y(q), and an output layer in which f is computed. Kůrková has shown that such a network has an approximate implementation with arbitrary activation functions of sigmoidal type. Actual implementation is, however, impeded by the lack of numerical algorithms for the hidden layer which contain continuous functions of the formy(q)=Sigma(n)(p=1)alpha(p)psi(x(p)+qa) with constants a and alpha(p). This paper gives an explicit numerical implementation of the hidden layer that also enables the implementation of the output layer. Copyright 1996 Elsevier Science Ltd