Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Up package version #123

Merged
merged 7 commits into from
Mar 24, 2023
Merged

Up package version #123

merged 7 commits into from
Mar 24, 2023

Conversation

TimvdHeijden
Copy link
Contributor

No description provided.

@TimvdHeijden
Copy link
Contributor Author

@melvinfolkers Is there a good way to test this before merging? After merging we can first use it with a release candidate.

@TimvdHeijden
Copy link
Contributor Author

@erfannariman I don't see your comment anymore, but you mean like this with the >=? I was not sure whether its also desired in the requirements.txt.

@erfannariman
Copy link
Member

@erfannariman I don't see your comment anymore, but you mean like this with the >=? I was not sure whether its also desired in the requirements.txt.

Yes I removed the comment because it would actually introduce breaking changes already, so in this case it's not valid with the Azure packages.

@TimvdHeijden
Copy link
Contributor Author

@erfannariman I don't see your comment anymore, but you mean like this with the >=? I was not sure whether its also desired in the requirements.txt.

Yes I removed the comment because it would actually introduce breaking changes already, so in this case it's not valid with the Azure packages.

Ready for review, limited some packages from above, and replaced the deprecated parameter line_terminator with lineterminator. All tests succeeded.

@TimvdHeijden
Copy link
Contributor Author

@erfannariman or @melvinfolkers can one of you check again?

Copy link
Member

@melvinfolkers melvinfolkers left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved from my side, but note that some code is written by me also. Maybe @erfannariman can take a look as well.

@TimvdHeijden did you run the tests from the test suite?

@@ -197,7 +197,7 @@ def upload_to_blob(self):
blob=f"{self.table_name}/{self.table_name}.csv",
)

data = self.df.to_csv(index=False, sep="^", quotechar='"', line_terminator="\n")
data = self.df.to_csv(index=False, sep="^", quotechar='"', lineterminator="\n")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

side note: Ive created e a new issue #125 for making this an export to .parquet.

@TimvdHeijden
Copy link
Contributor Author

Approved from my side, but note that some code is written by me also. Maybe @erfannariman can take a look as well.

@TimvdHeijden did you run the tests from the test suite?

Yes see my comment from March 17, All tests succeeded.

@erfannariman
Copy link
Member

@erfannariman or @melvinfolkers can one of you check again?

I think we need to set pandas>=1.5.0 because of the change in argument lineterminator.

@TimvdHeijden
Copy link
Contributor Author

@erfannariman or @melvinfolkers can one of you check again?

I think we need to set pandas>=1.5.0 because of the change in argument lineterminator.

Done. Tests work, but thats because I already had 1.5.3 locally. and they did not work with pandas 1.4.3. So valid point.

@erfannariman erfannariman merged commit 2e6b6cc into development Mar 24, 2023
@erfannariman erfannariman deleted the up-package-version branch March 24, 2023 10:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants