Skip to content

Commit

Permalink
[CELEBORN-1482][CIP-8] Add partition meta handler
Browse files Browse the repository at this point in the history
### What changes were proposed in this pull request?
1. Add partition meta handler to eliminate reduce/map/mapSegment partition writers.

### Why are the changes needed?
https://cwiki.apache.org/confluence/display/CELEBORN/CIP-8+Refactor+Partition+Data+Writer

### Does this PR introduce _any_ user-facing change?
NO.

### How was this patch tested?
GA.

Closes #3058 from FMX/b1482-1.

Authored-by: mingji <fengmingxiao.fmx@alibaba-inc.com>
Signed-off-by: Shuang <lvshuang.xjs@alibaba-inc.com>
  • Loading branch information
FMX authored and RexXiong committed Jan 9, 2025
1 parent b74e05b commit df25129
Show file tree
Hide file tree
Showing 2 changed files with 742 additions and 0 deletions.
Loading

0 comments on commit df25129

Please sign in to comment.