You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
As a relevance engineer, I would like to be able to reset the ratings of any items that were rated unrateable, allowing them to return to the pool of query document pairs to be rated. I can manually select an individual judgment, then manually select unrate from the rating screen, to accomplish the task.
Describe the solution you'd like
Add a selection check box for ratings on the Judgments page, allowing me to select 1 or more items. Add an action button to unrate selected. There could be other actions associated with the selected items, but unrate is the only one that is currently in my workflow.
Additional context
I imagine select check box on each row, action button or menu at the top.
The text was updated successfully, but these errors were encountered:
This feature would also be useful for our use case. We have many 'newsy' quries where the most relevant documents quickly become stale as new articles are written. Being able to easily un-rate all of those query-doc pairs would be handy.
Is your feature request related to a problem? Please describe.
As a relevance engineer, I would like to be able to reset the ratings of any items that were rated unrateable, allowing them to return to the pool of query document pairs to be rated. I can manually select an individual judgment, then manually select unrate from the rating screen, to accomplish the task.
Describe the solution you'd like
Add a selection check box for ratings on the Judgments page, allowing me to select 1 or more items. Add an action button to unrate selected. There could be other actions associated with the selected items, but unrate is the only one that is currently in my workflow.
Additional context
I imagine select check box on each row, action button or menu at the top.
The text was updated successfully, but these errors were encountered: