The output of a recurrent unit **r** is given by:

where:

The derivatives of with respect to and are computed as follows:

and

At **t=0**, it is assumed that the unit's previous value and previous
derivatives are all zero.

Niels.Mache@informatik.uni-stuttgart.de

Tue Nov 28 10:30:44 MET 1995