You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I see in the tox21 example , the evaluation metric is the roc_auc_score on the multilabel binary classification task. However, the final activation function in the model is linear. Does this output interact well with the roc_auc_score? I believe the sklearn implementation of the metric expects an array of shape (n_samples, n_classes) where the values in the array correspond to probability estimates for the labels in each class. As I understand, the current output of the model does not correspond to a probability estimate (linear activation), so does this pose an issue for getting the correct roc_auc value? Would a better implementation be with a sigmoid activation function at the output layer?
Thanks
The text was updated successfully, but these errors were encountered:
Aidan-Kehoe
changed the title
ROC_AUC score work with final linear activation function
Linear activation function interaction with ROC_AUC metric
Jan 22, 2021
I see in the tox21 example , the evaluation metric is the roc_auc_score on the multilabel binary classification task. However, the final activation function in the model is linear. Does this output interact well with the roc_auc_score? I believe the sklearn implementation of the metric expects an array of shape (n_samples, n_classes) where the values in the array correspond to probability estimates for the labels in each class. As I understand, the current output of the model does not correspond to a probability estimate (linear activation), so does this pose an issue for getting the correct roc_auc value? Would a better implementation be with a sigmoid activation function at the output layer?
Thanks
The text was updated successfully, but these errors were encountered: