Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP(iox-10578): patched df upgrade 202-04-20 #14

Closed
wants to merge 8 commits into from

Conversation

appletreeisyellow
Copy link

@appletreeisyellow appletreeisyellow commented Apr 26, 2024

⚠️ This will not be merged. ⚠️

This PR is based on #13 that including the following patch(es):

  1. Bringing us up to datafusion to 2024-04-20

  2. Cherry picked Allow adding user defined metadata to ParquetSink apache/datafusion#10224 / apache@9c8873a

commit 9c8873af12826e47f5743991859790df7a3b6400
Author: wiedld <wiedld@users.noreply.github.com>
Date:   Fri Apr 26 03:42:16 2024 -0700

    Allow adding user defined metadata to `ParquetSink` (#10224)

wiedld and others added 2 commits April 26, 2024 08:27
* chore: make explicit what ParquetWriterOptions are created from a subset of TableParquetOptions

* refactor: restore the ability to add kv metadata into the generated file sink

* test: demomnstrate API contract for metadata TableParquetOptions

* chore: update code docs

* fix: parse on proper delimiter, and improve tests

* fix: enable any character in the metadata string value, by having any key parsing be a part of the format.metadata::key
@appletreeisyellow appletreeisyellow changed the title WIP(iox-10578): patched df upgrade 202-04-TBD WIP(iox-10578): patched df upgrade 202-04-20 Apr 26, 2024
@appletreeisyellow
Copy link
Author

The upgrade is done. Closing

@appletreeisyellow appletreeisyellow deleted the chunchun/update-df-apr-week-3 branch May 1, 2024 20:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants