Performance Bounds for Single Layer Threshold Networks when Tracking a Drifting Adversary.
basic_science · Level V
Where this comes from
- Record sourced from PubMed, PMID 12662878.
- No licence information is recorded for this record.
- Because redistribution is not established, this page shows the abstract only. Follow the links below for the full text.
Abstract
This paper finds upper bounds for the generalization error of three tracking algorithms when confronted with a worst case adversary. A system identification model is used where both the target and tracking network are single layer threshold networks, with the target weights changing slowly (the drift problem). Previous work considered random unbiased drifting adversaries. This paper focuses on the analysis of a worst case drifting adversary. For a small drift rate of gamma, we find that upper bounds for the optimal conservative tracker, the perceptron tracker, and the least mean square (LMS) tracker are respectively 2gamma/cos(gammapi),2gamman/, and gamma(2n + 2.5) where n is the number of inputs. Simulation results validate the analysis and also show that the bounds are tight when gamma is small for the perceptron and LMS tracker. The effects of additive noise, correlated inputs and non-Gaussian inputs are also discussed. Copyright 1997 Elsevier Science Ltd.