Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Added method pull_docker_image in evaluation_script_starter.py #50

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

emilio-cartoni
Copy link

I am currently trying to setup a code-based challenge.
This requires that the participants submit docker images, which are then run by the evaluation script.
Downloading these docker submissions requires logging to AWS ECR, which is a complex and not enough documented operation to people who have not used it before.
So I am creating this pull request where I share the method I wrote to download the images in the evaluation script.
I think having this will be very valuable to future people who want to run code-based challenges with EvalAI.

This method requires boto3 (to login on AWS) and docker (since it has to pull docker images), so it requires more libraries compared to those listed in requirements.txt.
Since these libraries are only needed for code based challenges, I have not added them to the requirements.txt and I have also "hidden" the imports inside the method, so that the libraries will only requested to those who actually used this method.

@RishabhJain2018
Copy link
Member

@Ram81 Can you please review this?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants