General Gaussian Priors for Improved Generalization.
basic_science · Level V
Where this comes from
- Record sourced from PubMed, PMID 12662573.
- No licence information is recorded for this record.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
We explore the dependence of performance measures, such as the generalization error and generalization consistency, on the structure and the parametrization of the prior on "rules", instanced here by the noisy linear perceptron. Using a statistical mechanics framework, we show how one may assign values to the parameters of a model for a "rule" on the basis of data instancing the rule. Information about the data, such as input distribution, noise distribution and other "rule" characteristics may be embedded in the form of general Gaussian priors for improving net performance. We examine explicitly two types of general Gaussian priors which are useful in some simple cases. We calculate the optimal values for the parameters of these priors and show their effect in modifying the most probable, MAP, values for the rules. Copyright 1996 Elsevier Science Ltd.