You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thanks for bringing this up. We’ll need to discuss internally but I think this is an interesting idea to extend the usefulness of the data set. You can expect an update by the end of next week (12/10/2021).
Please reply to this thread if you have any questions or concerns. Cheers!
Hi All,
yes, this would greatly help the community to get new metrics evaluated as we even mention in the paper, this is a great use of the blind test for automatic metrics.
However, I am a bit worried that it would be too time-consuming to evaluate all metrics, so I have tried to describe how to submit the metrics to an evaluation in the README.md. Let's see if that will be working or not.
Have a lovely day,
Tom
Dear Author,
With @GuillaumeStaermanML we would like to add new metrics results specifically:
BaryScore https://arxiv.org/abs/2108.12463
And DepthScore https://arxiv.org/abs/2103.12711
And InfoLM (currently unpublished).
Is it something you could be interested in ?
Kindest regards,
The text was updated successfully, but these errors were encountered: