exception seen during make benchmark

[severo]

Not sure which dataset threw this exception though, that's why I put the previous rows for further investigation.

poetry run python ../scripts/get_rows_report.py wikiann___CONFIG___or___SPLIT___test ../tmp/get_rows_reports/wikiann___CONFIG___or___SPLIT___test.json
poetry run python ../scripts/get_rows_report.py csebuetnlp___SLASH___xlsum___CONFIG___uzbek___SPLIT___test ../tmp/get_rows_reports/csebuetnlp___SLASH___xlsum___CONFIG___uzbek___SPLIT___test.json
poetry run python ../scripts/get_rows_report.py clips___SLASH___mfaq___CONFIG___no___SPLIT___train ../tmp/get_rows_reports/clips___SLASH___mfaq___CONFIG___no___SPLIT___train.json
poetry run python ../scripts/get_rows_report.py common_voice___CONFIG___rm-vallader___SPLIT___train ../tmp/get_rows_reports/common_voice___CONFIG___rm-vallader___SPLIT___train.json
https://media.githubusercontent.com/media/persiannlp/parsinlu/master/data/translation/translation_combined_fa_en/test.tsv
poetry run python ../scripts/get_rows_report.py pasinit___SLASH___xlwic___CONFIG___xlwic_en_da___SPLIT___train ../tmp/get_rows_reports/pasinit___SLASH___xlwic___CONFIG___xlwic_en_da___SPLIT___train.json
poetry run python ../scripts/get_rows_report.py indic_glue___CONFIG___wstp.mr___SPLIT___validation ../tmp/get_rows_reports/indic_glue___CONFIG___wstp.mr___SPLIT___validation.json
poetry run python ../scripts/get_rows_report.py banking77___CONFIG___default___SPLIT___test ../tmp/get_rows_reports/banking77___CONFIG___default___SPLIT___test.json
poetry run python ../scripts/get_rows_report.py gem___CONFIG___xsum___SPLIT___challenge_test_bfp_05 ../tmp/get_rows_reports/gem___CONFIG___xsum___SPLIT___challenge_test_bfp_05.json
poetry run python ../scripts/get_rows_report.py turingbench___SLASH___TuringBench___CONFIG___TT_fair_wmt19___SPLIT___validation ../tmp/get_rows_reports/turingbench___SLASH___TuringBench___CONFIG___TT_fair_wmt19___SPLIT___validation.json
poetry run python ../scripts/get_rows_report.py igbo_monolingual___CONFIG___eze_goes_to_school___SPLIT___train ../tmp/get_rows_reports/igbo_monolingual___CONFIG___eze_goes_to_school___SPLIT___train.json
poetry run python ../scripts/get_rows_report.py flax-sentence-embeddings___SLASH___stackexchange_titlebody_best_voted_answer_jsonl___CONFIG___gamedev___SPLIT___train ../tmp/get_rows_reports/flax-sentence-embeddings___SLASH___stackexchange_titlebody_best_voted_answer_jsonl___CONFIG___gamedev___SPLIT___train.json
 * skipping . . .
Exception ignored in: <generator object ParsinluReadingComprehension._generate_examples at 0x7f094caa6dd0>
Traceback (most recent call last):
  File "/home/slesage/hf/datasets-preview-backend/.venv/lib/python3.8/site-packages/datasets/iterable_dataset.py", line 79, in __iter__
    yield key, example
RuntimeError: generator ignored GeneratorExit

[severo]

The benchmark is now based on requests to the API. If it still occurs, it will generate a 500 error. We will have to check the logs of the app to find this kind of uncaught exception.