Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add pre_transform_spec support for inlining transformed data in arrow format #365

Merged
merged 11 commits into from
Jul 24, 2023
Merged

Add pre_transform_spec support for inlining transformed data in arrow format #365

merged 11 commits into from
Jul 24, 2023

Commits on Jul 23, 2023

  1. Add extract_threshold and extract_format options 

    to pre_transform_extract
    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    c66d197 View commit details
    Browse the repository at this point in the history

  2. Add arrow-ipc-base64 extraction format

    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    d391ecc View commit details
    Browse the repository at this point in the history

  3. Add keep variables support to pre_transform_extract

    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    82900ba View commit details
    Browse the repository at this point in the history

  4. Add data_encoding_threshold and data_encoding_format to 

    pre_transform_spec.

With these, it's possible to include large datasets in encoded formats inside the spec dictionary.
    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    4bd9a88 View commit details
    Browse the repository at this point in the history

  5. Add Python test of data_encoding_threshold and data_encoding_format

    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    26a4834 View commit details
    Browse the repository at this point in the history

  6. Fix tests

    @jonmmease
    jonmmease committed Jul 23, 2023
    Configuration menu
    Copy the full SHA
    1cad1b3 View commit details
    Browse the repository at this point in the history

Commits on Jul 24, 2023

  1. clippy

    @jonmmease
    jonmmease committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    2cb845c View commit details
    Browse the repository at this point in the history

  2. Fix test extract threshold

    @jonmmease
    jonmmease committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    851f93b View commit details
    Browse the repository at this point in the history

  3. Pin windows CI machine

    @jonmmease
    jonmmease committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    450f0bd View commit details
    Browse the repository at this point in the history

  4. Comment other tests, disable rust cache on build-vegafusion-server-wi… 

    …n64 test
    @jonmmease
    jonmmease committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    91b1272 View commit details
    Browse the repository at this point in the history

  5. re-enable all tests

    @jonmmease
    jonmmease committed Jul 24, 2023
    Configuration menu
    Copy the full SHA
    34f4d60 View commit details
    Browse the repository at this point in the history