Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Refactor common cache entry #634

Merged
merged 40 commits into from
Nov 18, 2022
Merged

Refactor common cache entry #634

merged 40 commits into from
Nov 18, 2022

Commits on Nov 17, 2022

  1. docs: ✏️ fix docstring

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    e73219b View commit details
    Browse the repository at this point in the history

  2. feat: 🎸 use a common CachedResponse collection 

    instead of one collection for each kind of cached entry (splits,
first-rows, etc). Some admin methods have bveen disabled for now and
will be reintroduced later.
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    fcd2755 View commit details
    Browse the repository at this point in the history

  3. feat: 🎸 deprecate cache_refresh scripts (not used)` 

    The preferred way to refresh the cache is to specifically call the
webhook for each dataset you want to refresh
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    77afd8c View commit details
    Browse the repository at this point in the history

  4. feat: 🎸 add support for cache_reports and metrics count

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    dea1167 View commit details
    Browse the repository at this point in the history

  5. feat: 🎸 update to libcache 0.4. Disable /cache-reports/features

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    368761a View commit details
    Browse the repository at this point in the history

  6. feat: 🎸 remove the "stale" field which is not needed anymore 

    since the cache is considered stale if the worker version or the git
revision has changed.
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    3418237 View commit details
    Browse the repository at this point in the history

  7. feat: 🎸 update libcache

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    19b4001 View commit details
    Browse the repository at this point in the history

  8. feat: 🎸 rename delete_responses to delete_dataset_responses 

    as we only need this for now
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    e14cef2 View commit details
    Browse the repository at this point in the history

  9. feat: 🎸 add two methods for external /valid+/is-valid endpoints 

    also: rename internal method _clean_database to _clean_cache_database
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    e010182 View commit details
    Browse the repository at this point in the history

  10. feat: 🎸 update to libqueue 0.4.0

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    2dea44d View commit details
    Browse the repository at this point in the history

  11. feat: 🎸 update libcache

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    73df014 View commit details
    Browse the repository at this point in the history

  12. feat: 🎸 add delete_response and get_response_without_content 

    needed for the splits worker
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    ffe1942 View commit details
    Browse the repository at this point in the history

  13. feat: 🎸 change the return format of get_dataset_response_ids 

    and add tests
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    ea0320e View commit details
    Browse the repository at this point in the history

  14. feat: 🎸 update to libcache 0.4.0

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    73fada3 View commit details
    Browse the repository at this point in the history

  15. feat: 🎸 update to libcache 0.4.0

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    98da8f3 View commit details
    Browse the repository at this point in the history

  16. feat: 🎸 update libcache

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    2db9431 View commit details
    Browse the repository at this point in the history

  17. style: 💄 fix style

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    43252f9 View commit details
    Browse the repository at this point in the history

  18. fix: 🐛 fix kind of the caches

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    32397a3 View commit details
    Browse the repository at this point in the history

  19. chore: 🤖 create the database migration script

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    394bd45 View commit details
    Browse the repository at this point in the history

  20. feat: 🎸 update the indexes

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    3a158b4 View commit details
    Browse the repository at this point in the history

  21. feat: 🎸 update libcache

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    3452215 View commit details
    Browse the repository at this point in the history

  22. chore: 🤖 respect the alphabet

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    8ff577c View commit details
    Browse the repository at this point in the history

  23. fix: 🐛 stale has been deprecated in the cache 

    just remove these lines
    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    4e3b901 View commit details
    Browse the repository at this point in the history

  24. test: 💍 remove test to avoid using obsolete objects (SplitResp)

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    fb73d73 View commit details
    Browse the repository at this point in the history

  25. style: 💄 fix style

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    8f7004e View commit details
    Browse the repository at this point in the history

  26. test: 💍 fix test that randomly fails

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    3e2fd7e View commit details
    Browse the repository at this point in the history

  27. feat: 🎸 update docker images

    @severo
    severo committed Nov 17, 2022
    Configuration menu
    Copy the full SHA
    9292f7a View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2022

  1. test: 💍 adapt tests to cache change

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    a840681 View commit details
    Browse the repository at this point in the history

  2. chore: 🤖 don't delete the migration job to be able to read logs

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    fa1f8f4 View commit details
    Browse the repository at this point in the history

  3. fix: 🐛 the migration script returns exit code "1" if error 

    So that the hook will stop the update of the Helm chart. If not, the
code will be updated (and expects the new database) while the database
migration has failed
    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    cf65b25 View commit details
    Browse the repository at this point in the history

  4. test: 💍 fix test and style

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    3b64d16 View commit details
    Browse the repository at this point in the history

  5. feat: 🎸 update docker image

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    150c6f7 View commit details
    Browse the repository at this point in the history

  6. fix: 🐛 fix the migration script

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    9128049 View commit details
    Browse the repository at this point in the history

  7. fix: 🐛 support empty fields (None)

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    77d4cf7 View commit details
    Browse the repository at this point in the history

  8. fix: 🐛 fix mismatch in the name of the collection 

    use variables to avoid typos
    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    502e16e View commit details
    Browse the repository at this point in the history

  9. fix: 🐛 fix field name

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    9461e24 View commit details
    Browse the repository at this point in the history

  10. feat: 🎸 add log information in case of validation error

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    9d6778f View commit details
    Browse the repository at this point in the history

  11. fix: 🐛 fix a mongoengine issue with unique_with and null values

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    396540c View commit details
    Browse the repository at this point in the history

  12. feat: 🎸 update libcache

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    dfa89b1 View commit details
    Browse the repository at this point in the history

  13. feat: 🎸 upgrade docker images (tested on ephemeral)

    @severo
    severo committed Nov 18, 2022
    Configuration menu
    Copy the full SHA
    d3e850d View commit details
    Browse the repository at this point in the history