Miscellaneous pipeline updates #58

atreyasha · 2022-11-08T18:55:51Z

Use the --full_determinism flag for the trainer (we already do this, but the trainer does it again apparently)
We should use indent=4 for JSON dumps to be consistent across all pipelines

github-actions · 2022-11-08T18:57:41Z

Coverage Report

File	Stmts	Miss	Cover	Missing
parser.py	0	0	100%
privacy_glue.py	0	0	100%
reading_comprehension.py	0	0	100%
sequence_classification.py	0	0	100%
sequence_tagging.py	0	5	58%	9, 12, 15, 18, 21
tasks
opp_115.py	0	0	100%
piextract.py	0	0	100%
policy_detection.py	0	0	100%
policy_ie_a.py	0	0	100%
policy_ie_b.py	0	0	100%
policy_qa.py	0	0	100%
privacy_qa.py	0	0	100%
utils
experiment_utils.py	0	0	100%
logging_utils.py	0	0	100%
parser_utils.py	0	0	100%
pipeline_utils.py	0	0	100%
task_utils.py	0	0	100%
trainer_utils.py	0	0	100%
TOTAL	822	5	99%

Tests	Skipped	Failures	Errors	Time
1397	210 💤	0 ❌	0 🔥	33.283s ⏱️

Update integration tests as well

github-actions · 2022-11-08T19:26:13Z

Coverage Report

File	Stmts	Miss	Cover	Missing
parser.py	0	0	100%
privacy_glue.py	0	0	100%
reading_comprehension.py	0	0	100%
sequence_classification.py	0	0	100%
sequence_tagging.py	0	5	58%	9, 12, 15, 18, 21
tasks
opp_115.py	0	0	100%
piextract.py	0	0	100%
policy_detection.py	0	0	100%
policy_ie_a.py	0	0	100%
policy_ie_b.py	0	0	100%
policy_qa.py	0	0	100%
privacy_qa.py	0	0	100%
utils
experiment_utils.py	0	0	100%
logging_utils.py	0	0	100%
parser_utils.py	0	0	100%
pipeline_utils.py	0	0	100%
task_utils.py	0	0	100%
trainer_utils.py	0	0	100%
TOTAL	822	5	99%

Tests	Skipped	Failures	Errors	Time
1397	210 💤	0 ❌	0 🔥	36.541s ⏱️

Add explicit JSON indent to all prediction dumps

5823fb4

atreyasha changed the title ~~Add explicit JSON indent to all prediction dumps~~ Miscellaneous pipeline updates Nov 8, 2022

Enable --full_determinism in our entrypoint

1fbf068

Update integration tests as well

atreyasha merged commit adf4409 into main Nov 9, 2022

atreyasha deleted the as/patch-pipelines branch November 9, 2022 07:33

Provide feedback