AdaDelta Class
Adadelta is an extension of Adagrad that seeks to reduce its aggressive, monotonically decreasing learning rate. Instead of accumulating all past squared gradients, Adadelta restricts the window of accumulated past gradients to some fixed size w.
Namespace:
SiaNet.Model.OptimizersAssembly: SiaNet (in SiaNet.dll)
Syntax
public class AdaDelta : BaseOptimizer
Public Class AdaDelta _ Inherits BaseOptimizer
public ref class AdaDelta : public BaseOptimizer
Inheritance Hierarchy
SiaNet.Model.Optimizers..::..BaseOptimizer
SiaNet.Model.Optimizers..::..AdaDelta