Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Move ParquetMetadataWriter to its own module, update documentation #6202

Merged
merged 8 commits into from
Aug 13, 2024
Merged

Move ParquetMetadataWriter to its own module, update documentation #6202

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
f83c419
Move `ThriftMetadataWriter` and `ParquetMetadataWriter` to a new module
alamb Aug 6, 2024
1e29088
Improve documentation, make pub(crate)
alamb Aug 6, 2024
f873c19
Merge remote-tracking branch 'apache/master' into alamb/make_writer_pub
alamb Aug 8, 2024
19749fd
Apply suggestions from code review
alamb Aug 8, 2024
634e970
Merge branch 'alamb/make_writer_pub' of github.com:alamb/arrow-rs int…
alamb Aug 8, 2024
cc6f9bf
Add comment side effect of writing column and offset indexes
alamb Aug 8, 2024
d51c697
Document how to write bloom filters
alamb Aug 8, 2024
f5cbc6e
Update parquet/src/file/metadata/writer.rs
alamb Aug 8, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions parquet/src/file/metadata/mod.rs
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -50,10 +50,9 @@
//! [`decode_metadata`]: crate::file::footer::decode_metadata
//!
//! Writing:
//! * Write `ParquetMetaData` to bytes in memory: Not yet supported (see [#6002])
//! * Write `ParquetMetaData` to bytes in memory: [`ParquetMetaDataWriter`]
//! * Writes `ParquetMetaData` to an async target: Not yet supported
//!
//! [#6002]: https://github.com/apache/arrow-rs/issues/6002
//!
//! # Metadata Encodings and Structures
//!
Expand Down Expand Up @@ -95,6 +94,7 @@
//! * Same name, different struct
//! ```
mod memory;
mod writer;

use std::ops::Range;
use std::sync::Arc;
Expand All @@ -115,6 +115,8 @@ use crate::schema::types::{
ColumnDescPtr, ColumnDescriptor, ColumnPath, SchemaDescPtr, SchemaDescriptor,
Type as SchemaType,
};
pub use writer::ParquetMetaDataWriter;
pub(crate) use writer::ThriftMetadataWriter;

/// Page level statistics for each column chunk of each row group.
///
Expand Down
Loading
Loading