Python package is incompatibility with Airflow 2.3.0

[Tonkonozhenko]

Describe the bug
sqlalchemy==1.3.24 is incompatible with Airflow 2.3.0 (1), (2)

[Ladjack7]

Facing the same on an attempt to install acryl-datahub[athena] and acryl-datahub[vertica] >=0.8.36 together with apache-airflow 2.3.*.
Please bump SQLAlchemy to 1.4.*

pipenv.patched.notpip._vendor.resolvelib.resolvers.ResolutionImpossible: [RequirementInformation(requirement=SpecifierRequirement('sqlalchemy<1.4.10,>=1.4'), parent=LinkCandidate('https://files.pythonhosted.org/packages/9f/77/f4670a54833734f57959e38f6331a28e9cf676762d357163dfa7fd5aa8b6/apache_airflow-2.3.1-py3-none-any.whl#sha256=75e309cb88e941012888dd09909c4285a314e5fa14d16b70e432d240b5883f0c (from https://pypi.org/simple/apache-airflow/) (requires-python:~=3.7)')), RequirementInformation(requirement=SpecifierRequirement('SQLAlchemy<1.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/55/a2/7a068ebd489912602c64238e21a787760fec402cf748cd877d4e532da9d1/Flask_AppBuilder-3.4.5-py3-none-any.whl#sha256=7a4c9981bc030f29e4071edd173e9fe8cfcdbe7febefe141160b6783a0cc871a (from https://pypi.org/simple/flask-appbuilder/) (requires-python:~=3.6)')), RequirementInformation(requirement=SpecifierRequirement('sqlalchemy==1.3.24; extra == "athena"'), parent=ExtrasCandidate(base=LinkCandidate('https://files.pythonhosted.org/packages/bf/f5/5c4a3677905c01d4c920e1aabd5ceb5b97a87c927f379670bbcc160289e9/acryl_datahub-0.8.36-py3-none-any.whl#sha256=9a42d40cfc1cfd46db98964ef1c4e21ba78ef8ba51f1b92908fcede7cd9a95c5 (from https://pypi.org/simple/acryl-datahub/) (requires-python:>=3.6)'), extras=frozenset({'athena', 'datahub-rest', 's3', 'glue'})))]

pipenv.patched.notpip._vendor.resolvelib.resolvers.ResolutionImpossible: [RequirementInformation(requirement=SpecifierRequirement('sqlalchemy<1.4.10,>=1.4'), parent=LinkCandidate('https://files.pythonhosted.org/packages/9f/77/f4670a54833734f57959e38f6331a28e9cf676762d357163dfa7fd5aa8b6/apache_airflow-2.3.1-py3-none-any.whl#sha256=75e309cb88e941012888dd09909c4285a314e5fa14d16b70e432d240b5883f0c (from https://pypi.org/simple/apache-airflow/) (requires-python:~=3.7)')), RequirementInformation(requirement=SpecifierRequirement('SQLAlchemy<1.5'), parent=LinkCandidate('https://files.pythonhosted.org/packages/55/a2/7a068ebd489912602c64238e21a787760fec402cf748cd877d4e532da9d1/Flask_AppBuilder-3.4.5-py3-none-any.whl#sha256=7a4c9981bc030f29e4071edd173e9fe8cfcdbe7febefe141160b6783a0cc871a (from https://pypi.org/simple/flask-appbuilder/) (requires-python:~=3.6)')), RequirementInformation(requirement=SpecifierRequirement('sqlalchemy==1.3.24; extra == "vertica"'), parent=ExtrasCandidate(base=LinkCandidate('https://files.pythonhosted.org/packages/bf/f5/5c4a3677905c01d4c920e1aabd5ceb5b97a87c927f379670bbcc160289e9/acryl_datahub-0.8.36-py3-none-any.whl#sha256=9a42d40cfc1cfd46db98964ef1c4e21ba78ef8ba51f1b92908fcede7cd9a95c5 (from https://pypi.org/simple/acryl-datahub/) (requires-python:>=3.6)'), extras=frozenset({'s3', 'glue', 'datahub-rest', 'vertica'})))]

[KulykDmytro]

is it possible to up version pin ?
this one is stopping us to move forward with airflow (tend to stick on airflow:2.2.5)

[KulykDmytro]

Due to rollback via #5289 @treff7es please reopen this one

[vincentkoc]

This is screwing up my current Airflow installs, need to resolve the rollback

[KulykDmytro]

This is screwing up my current Airflow installs, need to resolve the rollback

the only way is to use apache-airflow:2.2.5
or try to loose airflow-to-sqlalchemy dependency

[mirobertod]

Hi, we are using Airflow 2.3 and we are unable to install the Python package acryl-datahub[bigquery].
Any plan to upgrade the dependency sqlalchemy?
Thanks!

[colinfernandes87]

Hello,

Airflow rolls back to older version when we install datahub bigquery plugin. if anyone has a workaround to enable bigquery and not downgrade airflow. Please let me know.

[github-actions]

This issue is stale because it has been open for 30 days with no activity. If you believe this is still an issue on the latest DataHub release please leave a comment with the version that you tested it with. If this is a question/discussion please head to https://slack.datahubproject.io. For feature requests please use https://feature-requests.datahubproject.io

[shicholas]

please do not close, this is still an issue.

[Vimpy]

Hey with latest datahub release i.e. 0.8.45 still we are getting same incompatibility issue with sqlalchemy

[KulykDmytro]

Airflow 2.4.1 has been released - same stuff

[pedro-iatzky]

I'm facing the same error. I cannot use the plugin on our Airflow 2.3 because of this.
Could you provide some ETA for this?

[hsheth2]

Update here: I'm working on loosening our SQLAlchemy dependency in #6204.

[tommy-watts-depop]

Hi, Do we have an ETA for this fix?