Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Implement ObjectWriter Support #1431

Merged
merged 37 commits into from
Mar 1, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
2c06526
Add output writer
Xuanwo Feb 28, 2023
9325043
Add blocking writer
Xuanwo Feb 28, 2023
662732c
Save work
Xuanwo Feb 28, 2023
40e1276
Migrate azblob
Xuanwo Feb 28, 2023
fd17c2f
Add azdfs support
Xuanwo Feb 28, 2023
c6290f0
Add fs support
Xuanwo Feb 28, 2023
6b9e578
Polish API
Xuanwo Feb 28, 2023
c0822ba
Add ftp support
Xuanwo Feb 28, 2023
cad8dcc
Add gcs support
Xuanwo Feb 28, 2023
8c11246
Add ghac support
Xuanwo Feb 28, 2023
41a515d
Add hdfs support
Xuanwo Feb 28, 2023
2235688
Add http support
Xuanwo Feb 28, 2023
7e4b6cd
Add ipfs support
Xuanwo Feb 28, 2023
86068d6
Add ipmfs support
Xuanwo Feb 28, 2023
0fa6b5b
Add obs support
Xuanwo Feb 28, 2023
2fb702f
Add oss support
Xuanwo Feb 28, 2023
bec5903
Merge branch 'main' into object-writer
Xuanwo Feb 28, 2023
cd01a02
Migrate s3
Xuanwo Feb 28, 2023
3f2f6c4
Migrate webdav
Xuanwo Feb 28, 2023
317d2b9
Migrate webhdfs
Xuanwo Feb 28, 2023
85b1160
Remove oay
Xuanwo Feb 28, 2023
b21420e
Fix build
Xuanwo Feb 28, 2023
c527a4e
Use bytes instead
Xuanwo Feb 28, 2023
85c7a41
Add object writer
Xuanwo Mar 1, 2023
040e020
Make oli happy
Xuanwo Mar 1, 2023
aeed7ec
Save work
Xuanwo Mar 1, 2023
3515430
Make clippy happy
Xuanwo Mar 1, 2023
4b93bac
Cleanup api
Xuanwo Mar 1, 2023
8329a44
Remove multipart related code
Xuanwo Mar 1, 2023
834bae0
Allow dead code for now
Xuanwo Mar 1, 2023
08287a7
Fix typo
Xuanwo Mar 1, 2023
962c52f
Add append
Xuanwo Mar 1, 2023
19922e4
Fix tests
Xuanwo Mar 1, 2023
3437de7
Merge branch 'main' into object-writer
Xuanwo Mar 1, 2023
22d159a
Fix fs
Xuanwo Mar 1, 2023
efdc269
Fix webdav test
Xuanwo Mar 1, 2023
9ca8ea9
Fix webdav test
Xuanwo Mar 1, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 0 additions & 6 deletions .github/dependabot.yml
Original file line number Diff line number Diff line change
Expand Up @@ -26,12 +26,6 @@ updates:
schedule:
interval: "weekly"

# Maintain dependencies for oay
- package-ecosystem: "cargo"
directory: "/oay"
schedule:
interval: "monthly"

# Maintain dependencies for oli
- package-ecosystem: "cargo"
directory: "/oli"
Expand Down
26 changes: 0 additions & 26 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -192,32 +192,6 @@ jobs:
working-directory: ./binaries/oli
run: cargo nextest run && cargo test --doc

build_oay:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os:
- ubuntu-latest
steps:
- uses: actions/checkout@v3
- name: Build
working-directory: ./binaries/oay
run: cargo build

unit_oay:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os:
- ubuntu-latest
steps:
- uses: actions/checkout@v3
- name: Install cargo-nextest
uses: taiki-e/install-action@nextest
- name: Test
working-directory: ./binaries/oay
run: cargo nextest run && cargo test --doc

build_object_store:
runs-on: ${{ matrix.os }}
strategy:
Expand Down
2 changes: 1 addition & 1 deletion Cargo.toml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ authors = ["Databend Authors <opensource@datafuselabs.com>"]
categories = ["filesystem"]
description = "OpenDAL: Access data freely, painlessly, and efficiently."
edition = "2021"
exclude = [".github/", "bindings/", "profiles/", "oay/", "oli/", "tests/"]
exclude = [".github/", "bindings/", "profiles/", "oli/", "tests/"]
homepage = "https://opendal.databend.rs/"
keywords = ["storage", "fs", "s3", "azblob", "gcs"]
license = "Apache-2.0"
Expand Down
Loading