GHA update rule
The Generalized Hebbian Algorithm (GHA) update rule (also known as Sanger's rule in the literature) is a Hebbian type update rule that performs PCA. It is similar to Oja's rule, but converges to ordered principal components.
The Generalized Hebbian Algorithm tunes a Hebbian layer so that its weights form ordered principal components. The principal components are basis vectors that are aligned so that the greatest variance by any projection of the data comes to lie on the first component, the second greatest variance on the second component and so on.
where is the learning rate.
The settings can be modified using the settings browser.
|GHA update rule settings|