Skip to content

Commit

Permalink
Merge fixes from main to 1.3 branch (#626)
Browse files Browse the repository at this point in the history
* add table changes with use_delta_format=True example (#619)

* Fix wheels build by removing duplicate wheels (#623)

* update delta-kernel-rust-sharing-wrapper to 0.2.1 and fix path in workflows (#625)

* update delta-kernel-rust-sharing-wrapper to 0.2.1

* fix names in build workflow
  • Loading branch information
PatrickJin-db authored Dec 20, 2024
1 parent a16890c commit 0546359
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 12 deletions.
18 changes: 7 additions & 11 deletions .github/workflows/build-kernel-wheels.yml
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
name: Build wheels for 4 os for delta-kernel-rust-sharing-wrapper
name: Build delta-kernel-rust-sharing-wrapper wheels for 4 OS and 2 architectures

on:
push:
paths:
- python/delta-sharing-kernel/**
- python/delta-kernel-rust-sharing-wrapper/**
- .github/workflows/**
pull_request:
paths:
- python/delta-sharing-kernel/**
- python/delta-kernel-rust-sharing-wrapper/**
- .github/workflows/**

jobs:
Expand All @@ -18,17 +18,13 @@ jobs:
os: [ubuntu-latest, ubuntu-20.04, macos-latest, windows-latest]
python-version: [3.8]
arch: [x86_64, arm64]
include:
- os: macos-latest
arch: x86_64
- os: macos-latest
arch: arm64
exclude:
- os: ubuntu-latest
arch: x86_64
arch: arm64
- os: ubuntu-20.04
arch: x86_64
arch: arm64
- os: windows-latest
arch: x86_64
arch: arm64

steps:
- uses: actions/checkout@v2
Expand Down
3 changes: 3 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -108,6 +108,9 @@ If the table supports history sharing(`tableConfig.cdfEnabled=true` in the OSS D
# Load table changes from version 0 to version 5, as a Pandas DataFrame.
delta_sharing.load_table_changes_as_pandas(table_url, starting_version=0, ending_version=5)

# Load table changes from version 0 to version 5 as a Pandas DataFrame, explicitly using Delta Format.
delta_sharing.load_table_changes_as_pandas(table_url, starting_version=0, ending_version=5, use_delta_format=True)

# If the code is running with PySpark, you can load table changes as Spark DataFrame.
delta_sharing.load_table_changes_as_spark(table_url, starting_version=0, ending_version=5)
```
Expand Down
2 changes: 1 addition & 1 deletion python/delta-kernel-rust-sharing-wrapper/Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
name = "delta-kernel-rust-sharing-wrapper"
edition = "2021"
license = "Apache-2.0"
version = "0.2.0"
version = "0.2.1"

[lib]
name = "delta_kernel_rust_sharing_wrapper"
Expand Down

0 comments on commit 0546359

Please sign in to comment.