How to obtain test-A/expected.tsv ?

[thibaultdouzon]

Hi, thanks for the dataset. I'm currently prototyping with and would like to compare my results to those proposed in the paper about Kleister-Charity.

It seems that it was available through a Google Drive at some point ( #1 ) but is not available anymore.

Can you provide it either through git-annex or Google Drive ?

[ivo-1]

Seems like it's intentionally left out according to the README and is supposed to be on a branch called dont-peek. I can't find that branch however and as you correctly say the Google Drive Link is expired. Would really appreciate the file as the dataset is really great and I would love to evaluate on the actual test set.

[AleRosae]

I also don't understand if we are supposed to have access to the expected.tsv file for test-A or not. It would be extremely helpful if @tstanislawek could clarify this aspect 🙏

[ivo-1]

Hey @tstanislawek could you please give us an update for this. I want to benchmark my approach and would be happy to upload results to paperswithcode which should boost visibility of your dataset and work :)

[tstanislawek]

@ivo-1 / @AleRosae / @thibaultdouzon

Not everything is dependent on me. I'm trying to speed things up but right now I don't know when the test data will be available.

You can try to check you scores on this webpage: https://kleister.info/challenge/kleister-charity

[ivo-1]

Thank you for your efforts! Hope that it works out 🤞