Skip to content

Commit

Permalink
Clarifying documentation (#3616)
Browse files Browse the repository at this point in the history
Updated documentation w.r.t. #3549

Signed-off-by: Iztok Lebar Bajec ilb@fri.uni-lj.si
Signed-off-by: Iztok Lebar Bajec <ilb@fri.uni-lj.si>

Co-authored-by: Oleksii Kuchaiev <okuchaiev@users.noreply.github.com>
  • Loading branch information
itzsimpl and okuchaiev authored Feb 7, 2022
1 parent 5278a09 commit 8313b01
Showing 1 changed file with 9 additions and 9 deletions.
18 changes: 9 additions & 9 deletions docs/source/core/core.rst
Original file line number Diff line number Diff line change
Expand Up @@ -391,17 +391,17 @@ configuration for a Novograd optimizer with Cosine Annealing learning rate sched
# scheduler setup
sched:
name: CosineAnnealing
name: CosineAnnealing
# Optional arguments
max_steps: null # computed at runtime or explicitly set here
monitor: val_loss
reduce_on_plateau: false
# Optional arguments
max_steps: null # computed at runtime or explicitly set here
monitor: val_loss
reduce_on_plateau: false
# scheduler config override
warmup_steps: 1000
warmup_ratio: null
min_lr: 1e-9:
# scheduler config override
warmup_steps: 1000
warmup_ratio: null
min_lr: 1e-9:
.. note:: `NeMo Examples <https://github.com/NVIDIA/NeMo/tree/v1.0.2/examples>`_ has optimizer and scheduler configurations for
every NeMo model.
Expand Down

0 comments on commit 8313b01

Please sign in to comment.