Handle parallel testing

[fpagnoux]

Connected to openfisca/openfisca-france#734

New features

• Use nose in the openfisca-run-test script
  • This avoids boilerplate code on country packages, and makes parallelism easier to set on Circle CI.

[cbenz]

I'm still not enough convinced about why there is a need to implement this mechanism (node-index and nb-nodes) into the script, and about why there is a --nose option.

Is it OK to tie the script to the CI needs?

I'm not criticizing the implementation; I just don't want to approve a code for which I don't understand the rationale :-)

[fpagnoux]

Good point 👍 .
It's indeed better to keep the parallelism business out of the core if we can.
I found an alternative implementation.

I still need the --nose option though. This options allows me to run OpenFisca YAML tests cases with nose (CI-friendly output, no failfast) without a boilerplate test_yaml.py. This has two advantages:

• Less boilerplate
• More important, I can do openfisca-run-test --nose fileA.yaml fileB.yaml path/to/file.yaml. This allows me to rely on Circle CI native parallelism features.

[cbenz]

OK, so I understand now!

The --nose option runs the specified YAML tests using nose as a runner.

But couldn't we keep this option as the default and only one? When is it useful not to use this option?

[fpagnoux]

But couldn't we keep this option as the default and only one? When is it useful not to use this option?

Good question. The only drawback I see is that if running with nose is the only option, then
- Either nosetests becomes a dependency of openfisca-core
- Or we keep it as a test dependency, but anyone who wants to run YAML tests must pip install openfisca_xxx[test]

I guess the second option is ok.