[RFC] calling ramp-test as python <file>.py so debugger can be used

[kegl]

No description provided.

[kegl]

In a python prompt you can do

from rampwf.utils.testing import assert_submission

then

assert_submission()

if you are in a valid RAMP kit. If you want to test another submission, do

assert_submission(submission='<submission_name>')

For the rest, see the signature of assert submission.

[jorisvandenbossche]

Sort of related to #159

[kegl]

I added this remark to the wiki: https://github.com/paris-saclay-cds/ramp-workflow/wiki/Getting-started-with-a-ramp-kit#test-the-execution

[jorisvandenbossche]

BTW, for me adding a breakpoint in a submission and calling ramp_test_submission goes into the debugger.

[kegl]

Also discussed in #131

[albertcthomas]

BTW, for me adding a breakpoint in a submission and calling ramp_test_submission goes into the debugger.

thanks for the tip @jorisvandenbossche

[glemaitre]

Now you can use directly cross_validate from scikit-learn

[albertcthomas]

Thanks @glemaitre! Is there an example somewhere?

[glemaitre]

You can check the following notebook from the iris challenge: https://github.com/ramp-kits/iris/blob/master/iris_starting_kit.ipynb Then, it requires to change the problem.py file using the Estimator or EstimatorExternalData class. We did not find more case for the moment for our simple challenge.

…

On Fri, 28 Feb 2020 at 17:46, Albert Thomas ***@***.***> wrote: Thanks @glemaitre <https://github.com/glemaitre>! Is there an example somewhere? — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#183?email_source=notifications&email_token=ABY32PYWY4CLLQGK6AU5ORDRFE5XPA5CNFSM4G4VCTJ2YY3PNVWWK3TUL52HS4DFVREXG43VMVBW63LNMVXHJKTDN5WW2ZLOORPWSZGOENJFHPA#issuecomment-592597948>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/ABY32P3X2MAOJIJ473DHCI3RFE5XPANCNFSM4G4VCTJQ> .

-- Guillaume Lemaitre Scikit-learn @ Inria Foundation https://glemaitre.github.io/

[albertcthomas]

Another solution that I didn't test: calling python -i $(which ramp-test) and then import pdb; pdb.pm(), see https://til.simonwillison.net/til/til/python_debug-click-with-pdb.md. A better one would be to have a --pdb option. I can give it a try.