NADALINE: A Normalized Adaptive Linear Element That Learns Efficiently
- Richard S. Sutton, Department of Computing Science, University of Alberta
This paper introduces a variant of the ADALINE in which the input signals are normalized to have zero mean and unit variance, and in which the bias or 'threshold weight' is learned slightly differently. These changes result in a linear learning element that learns much more efficiently and rapidly, and that is much less dependent on the choice of the step-size parameter. Using simulation experiments, learning time improvements of from 30% to hundreds of times are shown. The memory and computational complexity of the new element remains O(N), where N is the number of input signals, and the added computations are entirely local. Theoretical analysis indicates that the new element learns optimally fast in a certain sense and to the extent that the input signals are statistically independent.
Citation
R. Sutton. "NADALINE: A Normalized Adaptive Linear Element That Learns Efficiently". Technical Report, January 1988.| Keywords: | computations, threshold weight, machine learning |
| Category: | Technical Report |
BibTeX
@manual{Sutton:88,
author = {Richard S. Sutton},
title = {NADALINE: A Normalized Adaptive Linear Element That Learns
Efficiently},
year = 1988,
}Last Updated: May 31, 2007Submitted by Staurt H. Johnson
