checkpoint_model ignores best model if just one metric stays the same #7286
Labels
area:rasa-oss/ml 👁
All issues related to machine learning
type:bug 🐛
Inconsistencies or issues which will cause an issue or problem for users or implementors.
This issue concerns the checkpoint_model parameter in every trainable component (DietClassifier, ResponseSelector, RulePolicy, etc...)
In order to save a model that has improved in every metric except one that has staled (can even stale at 1.00 accuracy !), the _does_model_improve function could compare with a superior or equal sign rather than superior strict.
rasa/rasa/utils/tensorflow/models.py
Line 483 in 0ccfa20
The text was updated successfully, but these errors were encountered: