nestov_momentum¶

Nestov momentum¶

Nestrov momentum is a type of accelerated gradient descent, it converges faster and reduces oscilation.

Classes

NestovMomentum(lr)

Nestrov momentum.

BlueBird

Navigation

bluebird
- activations
- data
- dataloader
- datasets
- exceptions
- layers
- loss
- metrics
- nn
- optimizers
  - Optimizers
  - adagrad
  - adam
  - nestov_momentum
    - Nestov momentum
      - NestovMomentum
  - optimizer
  - sgd
- progress_tracker
- regularizators
- tensor
- utils
- weight_initializers

Related Topics

Documentation overview
- bluebird
  - optimizers
    - Previous: Adam
    - Next: NestovMomentum

Quick search

©2020, Gordan Prastalo. | Powered by Sphinx 3.3.1 & Alabaster 0.7.12 | Page source