-
Notifications
You must be signed in to change notification settings - Fork 275
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[File system] Add Google Cloud Storage integration #631
base: main
Are you sure you want to change the base?
Conversation
Will add integration tests. Putting temporary to draft |
Added an integration test based on Since the service account key is in a file form and not in a string form I see two options.
In the pr I followed the second approach. |
@luoyuxia could you help to review it? |
@gkatzioura , could you check how Flink tests the gs-filesystem in CI? |
Hi @wuchong , after checking there are not tests for the actual filesystem integration. |
Thank you @gkatzioura , please ping me when you have finished the mock server. |
Hi @wuchong & @luoyuxia |
<artifactId>maven-compiler-plugin</artifactId> | ||
<configuration> | ||
<source>9</source> | ||
<target>9</target> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can we remove this? It breaks the CI build. Currently, we still need to ship artifacts build in Java8.
Error: Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.8.0:compile (default-compile) on project fluss-fs-gs: Fatal error compiling: invalid target release: 9 -> [Help 1]
https://github.com/alibaba/fluss/actions/runs/14344481121/job/40238125178?pr=631
Purpose
Linked issue: close #630
Brief change log
Added the GSFileSystem based on the given Hadoop Google Cloud Storage file system
Tests
API and Format
No
Documentation
It adds support for the Google Cloud Storage Filesystem