Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove the datasets blocklist and re-enqueue server errors #352

Merged
merged 6 commits into from
Jun 7, 2022
Merged

Remove the datasets blocklist and re-enqueue server errors #352

merged 6 commits into from
Jun 7, 2022

Commits on Jun 7, 2022

  1. feat: 🎸 add "retries" field to dataset and split jobs

    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    4c7b2c7 View commit details
    Browse the repository at this point in the history

  2. feat: 🎸 remove DATASETS_BLOCKLIST and re-enqueue if 500 error 

    We now catch a 500 error, and re-enqueue the job if it's within the
limit of MAX_JOBS_RETRIES. The workers should not break now for memory
error for example: the job should just be marked as erroneous.
    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    af11d19 View commit details
    Browse the repository at this point in the history

  3. feat: 🎸 deploy worker image with retries instead of blocklist

    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    73dd09c View commit details
    Browse the repository at this point in the history

  4. feat: 🎸 maintain the same retries number when requeueing

    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    e512036 View commit details
    Browse the repository at this point in the history

  5. feat: 🎸 upgrade libqueue to manage the job retries

    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    c26970d View commit details
    Browse the repository at this point in the history

  6. feat: 🎸 upgrade admin image

    @severo
    severo committed Jun 7, 2022
    Configuration menu
    Copy the full SHA
    6bd48de View commit details
    Browse the repository at this point in the history