Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for compression on gRPC cache #14041

Closed
wants to merge 25 commits into from
Closed

Add support for compression on gRPC cache #14041

wants to merge 25 commits into from

Commits on Oct 15, 2021

  1. [Compression] Add experimental option and verify capabilities

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    ccea6a4 View commit details
    Browse the repository at this point in the history

  2. [Compression] Implement bytestream compressed cache downloads

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    148ebc6 View commit details
    Browse the repository at this point in the history

  3. [Compression] Implement bytestream compressed cache uploads

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    bb6b53f View commit details
    Browse the repository at this point in the history

  4. [Compression][Tests] Test chunker with compression

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    ad5b0b4 View commit details
    Browse the repository at this point in the history

  5. [Compression][Tests] Test compressed cache uplaods

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    c0a3b3e View commit details
    Browse the repository at this point in the history

  6. [Compression][Tests] Test compressed cache downloads

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    1d643aa View commit details
    Browse the repository at this point in the history

  7. Allow calling getActualSize when upload are not finished

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    4d1dc31 View commit details
    Browse the repository at this point in the history

  8. Use thin jars for zstd jni

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    d84a76d View commit details
    Browse the repository at this point in the history

  9. [Compression] Wrap output stream with decompression

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    df571eb View commit details
    Browse the repository at this point in the history

  10. [Compression][Upload] Simplify Chunker with auxiliary classes

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    8c77992 View commit details
    Browse the repository at this point in the history

  11. Ensure hasNext is consistent after seek

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    ef40b33 View commit details
    Browse the repository at this point in the history

  12. Exhaust input and compute final size

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    054ce2d View commit details
    Browse the repository at this point in the history

  13. Adjust test params

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    55affb4 View commit details
    Browse the repository at this point in the history

  14. [Compression][Tests] Add test for compressed progressive uploads

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    9fc9b0a View commit details
    Browse the repository at this point in the history

  15. [Compression][Upload] Seek before jumping in rpc call

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    91ba7b8 View commit details
    Browse the repository at this point in the history

  16. Compile zstd-jni from sources

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    edf0f8c View commit details
    Browse the repository at this point in the history

  17. [Compression] Support progressive reads

    @AlessandroPatti
    AlessandroPatti committed Oct 15, 2021
    Configuration menu
    Copy the full SHA
    43bbd5f View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2021

  1. Simplify compressing stream

    @AlessandroPatti
    AlessandroPatti committed Oct 17, 2021
    Configuration menu
    Copy the full SHA
    acb7fb7 View commit details
    Browse the repository at this point in the history

  2. [Compression][Tests] Test progressive compressed download

    @AlessandroPatti
    AlessandroPatti committed Oct 17, 2021
    Configuration menu
    Copy the full SHA
    327d6b9 View commit details
    Browse the repository at this point in the history

  3. [Compression] Rename option to remote_cache_compression

    @AlessandroPatti
    AlessandroPatti committed Oct 17, 2021
    Configuration menu
    Copy the full SHA
    dfc3068 View commit details
    Browse the repository at this point in the history

  4. Only check for expected commited size if we completed the upload

    @AlessandroPatti
    AlessandroPatti committed Oct 17, 2021
    Configuration menu
    Copy the full SHA
    f6e1d2e View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2021

  1. Ensure minimum pipe size

    @AlessandroPatti
    AlessandroPatti committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    4f7771d View commit details
    Browse the repository at this point in the history

  2. Add simple tests for zstd streams

    @AlessandroPatti
    AlessandroPatti committed Oct 18, 2021
    Configuration menu
    Copy the full SHA
    6c13594 View commit details
    Browse the repository at this point in the history

Commits on Oct 20, 2021

  1. Move native patch to patch file

    @AlessandroPatti
    AlessandroPatti committed Oct 20, 2021
    Configuration menu
    Copy the full SHA
    9648105 View commit details
    Browse the repository at this point in the history

  2. Add mirror

    @AlessandroPatti
    AlessandroPatti committed Oct 20, 2021
    Configuration menu
    Copy the full SHA
    522a07f View commit details
    Browse the repository at this point in the history