Skip to content

Commit

Permalink
Merge pull request #270 from VectorInstitute/update-lr-scheduler-docu…
Browse files Browse the repository at this point in the history
…mentation

Address Shawns CR on previous PR
  • Loading branch information
jewelltaylor authored Oct 29, 2024
2 parents 7c56439 + 9e8ac7b commit a3d0dfb
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion fl4health/utils/nnunet_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -430,8 +430,10 @@ def __init__(
initial_lr (float): The initial learning rate of the optimizer.
max_steps (int): The maximum total number of steps across all FL rounds.
exponent (float): Controls how quickly LR descreases over time. Higher values
lead to more rapdid descent.
lead to more rapdid descent. Defaults to 0.9.
steps_per_lr (int): The number of steps per LR before decaying.
(ie 10 means the LR will be constant for 10 steps prior to being decreased to the subsequent value).
Defaults to 250 as that is the default for nnunet (decay LR once an epoch and epoch is 250 steps).
"""
self.optimizer = optimizer
self.initial_lr = initial_lr
Expand Down

0 comments on commit a3d0dfb

Please sign in to comment.