AdaDelta Class

Adadelta is an extension of Adagrad that seeks to reduce its aggressive, monotonically decreasing learning rate. Instead of accumulating all past squared gradients, Adadelta restricts the window of accumulated past gradients to some fixed size w.

Namespace:  SiaNet.Model.Optimizers
Assembly:  SiaNet (in SiaNet.dll)

Syntax


public class AdaDelta : BaseOptimizer
Public Class AdaDelta _
	Inherits BaseOptimizer
public ref class AdaDelta : public BaseOptimizer

Inheritance Hierarchy


Object
  SiaNet.Model.Optimizers..::..BaseOptimizer
    SiaNet.Model.Optimizers..::..AdaDelta