next up previous contents index
Next: Optimal Brain Surgeon Up: Theory of the Previous: Magnitude Based Pruning

Optimal Brain Damage


Optimal Brain Damage (OBD) approximates the change of the error function when pruning a certain weight. A Taylor series is used for the approximation:


To simplify the computation, we assume that

The result of all these simplifications reads as follows:

Now it is necessary to compute the diagonal elements of the Hesse-Matrix. For the description of this and to obtain further information read [YLC90].
Tue Nov 28 10:30:44 MET 1995