Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(ingest/deps): bump pyspark from 3.0.3 to 3.3.2 #7357

Closed
wants to merge 1 commit into from

Conversation

asikowitz
Copy link
Collaborator

@asikowitz asikowitz commented Feb 17, 2023

Blocked by https://github.com/awslabs/python-deequ not supporting pyspark 3.1, 3.2, or 3.3. They've completed support for 3.1 and 3.2, it seems, but with some issues: awslabs/python-deequ#106

Checklist

  • The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
  • Links to related issues (if applicable)
  • Tests for the changes have been added/updated (if applicable)
  • Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
  • For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

@github-actions github-actions bot added devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata labels Feb 17, 2023
@asikowitz asikowitz marked this pull request as draft February 17, 2023 17:23
@hsheth2 hsheth2 mentioned this pull request Aug 11, 2023
5 tasks
@hsheth2
Copy link
Collaborator

hsheth2 commented Aug 15, 2023

Closing in favor of #8638

@hsheth2 hsheth2 closed this Aug 15, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
devops PR or Issue related to DataHub backend & deployment ingestion PR or Issue related to the ingestion of metadata
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants