Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix/45 java gateway error #48

Merged
merged 11 commits into from
Nov 1, 2022
Merged

Conversation

ValeriiKhalimendik
Copy link
Collaborator

No description provided.

@ValeriiKhalimendik ValeriiKhalimendik force-pushed the bugfix/45-java-gateway-error branch from d4bc409 to 9b00420 Compare October 24, 2022 08:19
@yruslan yruslan self-requested a review October 24, 2022 08:21
@yruslan
Copy link
Collaborator

yruslan commented Oct 24, 2022

@zhukovgreen, it is strange that lint fails on files that @ValeriiKhalimendik hasn't changed.

@zhukovgreen
Copy link
Collaborator

@zhukovgreen, it is strange that lint fails on files that @ValeriiKhalimendik hasn't changed.

Maybe @ValeriiKhalimendik just didn't install the pre-commit hooks, in this case, git commit won't run them. To install git hooks you need to:

pre-commit install --install-hooks

…rtedFileSystemException: No FileSystem for scheme "C"
@ValeriiKhalimendik ValeriiKhalimendik force-pushed the bugfix/45-java-gateway-error branch from a5e7e7a to ac6fc16 Compare October 26, 2022 07:47
zhukovgreen and others added 3 commits October 26, 2022 10:52
Copy link
Collaborator

@zhukovgreen zhukovgreen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd like to ask you to move the fix_uri_scheme_availability feature to a separate MR. It is adding additional complexity now and out of the scope of this MR. I am pretty sure it will be easier to have it apart.

PLease ignore my comments about this function. They are incomplete.

pramen-py/src/pramen_py/utils/file_system.py Outdated Show resolved Hide resolved
pramen-py/src/pramen_py/utils/file_system.py Outdated Show resolved Hide resolved
pramen-py/tests/test_utils/test_file_system.py Outdated Show resolved Hide resolved
pramen-py/tests/test_utils/test_file_system.py Outdated Show resolved Hide resolved
pramen-py/tests/test_utils/test_utils.py Outdated Show resolved Hide resolved
Copy link
Collaborator

@zhukovgreen zhukovgreen left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a follow up on fixing URI for your MR to it

@@ -52,10 +55,25 @@ def get_fs_from_uri(self, uri: str) -> "_FileSystem":
object (i.e. S3FileSystem, LocalFileSystem etc.)
"""
return self.FileSystem.get(
self.URI(uri),
self.URI(self.fix_uri_scheme_availability(uri)),
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We are expecting the properly formatted uri at this place. The postprocessing of the config input is happening here https://github.com/AbsaOSS/pramen/blob/main/pramen-py/src/pramen_py/models/__init__.py#L73-L83.

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good idea. But let's do it in a different PR.

@yruslan
Copy link
Collaborator

yruslan commented Oct 31, 2022

Please, insert the license to

pramen-py/tests/test_utils/__init__.py

Interestingly, I can add a comment to an empty file 😆

@ValeriiKhalimendik ValeriiKhalimendik force-pushed the bugfix/45-java-gateway-error branch from 4974695 to 592b2a0 Compare November 1, 2022 11:07
@ValeriiKhalimendik ValeriiKhalimendik force-pushed the bugfix/45-java-gateway-error branch from 592b2a0 to 5931a34 Compare November 1, 2022 11:17
@ValeriiKhalimendik ValeriiKhalimendik merged commit 549adb1 into main Nov 1, 2022
@ValeriiKhalimendik ValeriiKhalimendik deleted the bugfix/45-java-gateway-error branch November 1, 2022 11:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants