You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The default in scikit-learn's SearchCV is to use the learning algorithm's score function. E.g. SVM will use accuracy. This could be a problem if the data is imbalanced. It would be better to use balanced_accuracy.
To prevent this, ideally we should warn the user if:
Hyperparemeter tuning is happening
Scoring is implicit
Additionally, this should include an example
How do you imagine this integrated in julearn?
In the checks, if a SearchCV is used and the scoring is None
Do you have a sample code that implements this outside of julearn?
No response
Anything else to say?
No response
The text was updated successfully, but these errors were encountered:
Which feature do you want to include?
The default in scikit-learn's SearchCV is to use the learning algorithm's
score
function. E.g. SVM will useaccuracy
. This could be a problem if the data is imbalanced. It would be better to usebalanced_accuracy
.To prevent this, ideally we should warn the user if:
Additionally, this should include an example
How do you imagine this integrated in julearn?
In the checks, if a SearchCV is used and the scoring is
None
Do you have a sample code that implements this outside of julearn?
No response
Anything else to say?
No response
The text was updated successfully, but these errors were encountered: