Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Potentially buffer multiple RecordBatches before writing a parquet row group in ArrowWriter #1214

Merged
merged 9 commits into from
Feb 1, 2022
Merged

Potentially buffer multiple RecordBatches before writing a parquet row group in ArrowWriter #1214

merged 9 commits into from
Feb 1, 2022

Commits on Jan 20, 2022

  1. Batch multiple records in ArrowWriter

    @tustvold
    tustvold committed Jan 20, 2022
    Configuration menu
    Copy the full SHA
    03cb4ca View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2022

  1. Document max_group_size and reduce default (apache#1213)

    @tustvold
    tustvold committed Jan 21, 2022
    Configuration menu
    Copy the full SHA
    9dbfdf2 View commit details
    Browse the repository at this point in the history

Commits on Jan 31, 2022

  1. Merge remote-tracking branch 'upstream/master' into arrow-writer-batch

    @tustvold
    tustvold committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    1802ab9 View commit details
    Browse the repository at this point in the history

  2. Review feedback

    @tustvold
    tustvold committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    65454bb View commit details
    Browse the repository at this point in the history

  3. Write multiple arrays without concat

    @tustvold
    tustvold committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    4185fa7 View commit details
    Browse the repository at this point in the history

  4. Clippy

    @tustvold
    tustvold committed Jan 31, 2022
    Configuration menu
    Copy the full SHA
    e894fa8 View commit details
    Browse the repository at this point in the history

Commits on Feb 1, 2022

  1. Test aggregating complex types

    @tustvold
    tustvold committed Feb 1, 2022
    Configuration menu
    Copy the full SHA
    e552b7a View commit details
    Browse the repository at this point in the history

  2. Test complex slice

    @tustvold
    tustvold committed Feb 1, 2022
    Configuration menu
    Copy the full SHA
    9d10c2d View commit details
    Browse the repository at this point in the history

  3. Clippy

    @tustvold
    tustvold committed Feb 1, 2022
    Configuration menu
    Copy the full SHA
    326461b View commit details
    Browse the repository at this point in the history