Learning in higher order Boltzmann machines using linear response.

Leisink, M A; Kappen, H J · Neural Netw · 2000

basic_science · Level V

Where this comes from

Abstract

We introduce an efficient method for learning and inference in higher order Boltzmann machines. The method is based on mean field theory with the linear response correction. We compute the correlations using the exact and the approximated method for a fully connected third order network of ten neurons. In addition, we compare the results of the exact and approximate learning algorithm. Finally we use the presented method to solve the shifter problem. We conclude that the linear response approximation gives good results as long as the couplings are not too large.

Medical subject headings