Contains classes for computing the Stochastic gradient descent.
More...
Available methods for computing the Stochastic gradient descent
Enumerator |
---|
defaultDense |
Default: Required gradient is computed using only one term of objective function
|
miniBatch |
Required gradient is computed using batchSize terms of objective function
|
momentum |
Required gradient is computed using batchSize terms of objective function, perform momentum update rule
|
Available identifiers of optional input for the iterative solver
Enumerator |
---|
pastUpdateVector |
NumericTable of size p x 1 with vector update from past iteration. Applied for momentum method
|
pastWorkValue |
NumericTable of size p x 1 with work vector value from past main iteration. Applied for minibatch method
|