Skip to content

Commit

Permalink
feat: Policy driven training control
Browse files Browse the repository at this point in the history
Signed-off-by: Padmanabha V Seshadri <seshapad@in.ibm.com>
  • Loading branch information
seshapad committed Feb 15, 2024
1 parent 70c9460 commit ada3aca
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions examples/training-control-definitions/Readme.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
# Note on training control definition examples
- `ctldef_step_v0.3.yaml`: Defines a training controller which computes loss at every step and loss consistently increases for three steps, then the training is stopped.
- `ctldef_epoch_v0.3.yaml`: Defines a epoch level training controller which computes loss at every epoch. The rule applied here is to compare a current epoch loss with previous epoch loss and it turns out to be more, then training is stopped.
- `ctldef_epoch_threshold_v0.3.yaml`: Defines a training controller similar to previous case, but also adds a threshold constraint.
- `ctldef_evaluate_v0.3.yaml`: Defines a training controller which behaves similar to the `EarlyStoppingCallback` from hugging face which can be found [here](https://github.com/huggingface/transformers/blob/v4.37.2/src/transformers/trainer_callback.py#L543).

0 comments on commit ada3aca

Please sign in to comment.