Add python 3.11 to the CI

[bdraco]

Proposed change

Add python 3.11 to the CI
Previous PR #74650

Breaking enum changes

some breaking changes to Enum https://blog.pecar.me/python-enum

• Change DeviceAutomationDetails to use a dataclass for py3.11 #88087

cchardet has a fork now: https://pypi.org/project/faust-cchardet/

• vulcan-api change Replace abandoned cchardet library kapi2289/vulcan-api#126
• docker Replace abandoned cchardet library docker#260
• bump docker
• bump lib Bump vulcan-api to 2.3.0 for python 3.11 #88254
• ban abandoned cchardet

Remaining known issues (this list will probably grow)

InterruptibleThreadPoolExecutor needs to be updated for py3.11

• investigate - this was a small timing issue, its behaving as expected

Issues with pending fixes

• cloud Fix cloud integration with py3.11 #88088
• group Fix group integration with py3.11 #88089
• hassio Fix hassio integration with py3.11 #88090
• forked_daapd Fix forked_daapd integration with py3.11 #88091
• mqtt Fix invalid spec in mqtt tests for py3.11 #88092
• netatmo Fix netatmo with python 3.11 #88093
• rmvtransport Fix rmvtransport integration with py3.11 #88094
• sleepiq Fix sleepiq with python 3.11 #88098
• unifiprotect Fix unifiprotect with python 3.11 #88101
• pyunifiprotect Bump pyunifiprotect to 4.7.0 for python 3.11 #88130
• deconz Bump pydeconz to v107 #88114
• twentemilieu Fix twentemilieu diagnostics with python 3.11 #88121
• zwave_me Fix zwave_me tests with python 3.11 #88122
• wemo Fix wemo tests with py3.11 #88123
• vera Fix vera tests with python3.11 #88124
• arcam Bump arcam dependency to 1.2.1 #88125
• apprise Fix apprise tests for python 3.11 #88126
• enum util Fix enum try_parse test for python3.11 #88131
• yeelight Fix exception ordering in yeelight for python 3.11 #88134
• zha Account for changed python3.11 enum.IntFlag 0 behavior in zha #88144
• Profiler - drop service.memory Disable profiler.memory service with python 3.11 #88136
• aprs - Fix aprs tests with python 3.11 #88189
• matter - Bump python-matter-server to 2.1.1 #88258

Known issues that need to be broken out of here in a separate PR

• Python 3.11 issues for uaqmp Azure/azure-uamqp-python#334
  fixed by Remove uamqp version constrain #88176
  • aqualink
  • Axis
  • Azure Service Bus

Integrations using a stub for asyncio.coroutine in tests only (broken in py3.11 but will still run in CI to keep py3.10 support)

• rflink Python 3.11 compatibility aequitas/python-rflink#70 - AttributeError: module 'asyncio' has no attribute 'coroutine'
• fido Update pyfido to 2.1.2 #88343 Remove deprecated asyncio coroutine decorator, handle session closing titilambert/pyfido#5 - AttributeError: module 'asyncio' has no attribute 'coroutine'
• blackbird Replace coroutine decorator with async keyword koolsb/pyblackbird#8 - AttributeError: module 'asyncio' has no attribute 'coroutine'

Type of change

• Dependency upgrade
• Bugfix (non-breaking change which fixes an issue)
• New integration (thank you!)
• New feature (which adds functionality to an existing integration)
• Deprecation (breaking change to happen in the future)
• Breaking change (fix/feature causing existing functionality to break)
• Code quality improvements to existing code or addition of tests

Additional information

• This PR fixes or closes issue: fixes #
• This PR is related to issue:
• Link to documentation pull request:

Checklist

• The code change is tested and works locally.
• Local tests pass. Your PR cannot be merged unless tests pass
• There is no commented out code in this PR.
• I have followed the development checklist
• The code has been formatted using Black (black --fast homeassistant tests)
• Tests have been added to verify that the new code works.

If user exposed functionality or configuration variables are added/changed:

• Documentation added/updated for www.home-assistant.io

If the code communicates with devices, web services, or third-party tools:

• The manifest file has all fields filled out correctly.
  Updated and included derived files by running: python3 -m script.hassfest.
• New or updated dependencies have been added to requirements_all.txt.
  Updated by running python3 -m script.gen_requirements_all.
• For the updated dependencies - a link to the changelog, or at minimum a diff between library versions is added to the PR description.
• Untested files have been added to .coveragerc.

To help with the load of incoming pull requests:

• I have reviewed two other open pull requests in this repository.

[bdraco]

Looks like the custom executor needs to be adapted as well

[bdraco]

Maybe mock out asyncio.Coro for py3.11 so they still work with 10

[bdraco]

Still not sure what's going on with the executor since it works locally

[frenck]

Not sure what to do about this one

• cchardet has a fork now: pypi.org/project/faust-cchardet

This is, as far as I spotted, used in two places:

• vulcan-api package: https://github.com/kapi2289/vulcan-api/blob/792a9ec42fd7f059e9e6850cc135dc1bad0ca1c2/setup.py#L38
  For that one, we could open a PR to replace it.

• Our Docker base images, as it speeds up aiohttp. As it seems to be a drop in replacement, we can just replace it. aiohttp will try to import it: https://github.com/aio-libs/aiohttp/blob/3a8e65f3c1cd0f3a22fc7b1ed48d383b453156d5/aiohttp/client_reqrep.py#L72-L75
  Used here: https://github.com/home-assistant/docker/blob/c08a196241e3a63792b5f4a6b589a68582d021e6/requirements.txt#LL2-L2C9

As they re-used the namespace in the maintained version, it became both a drop-in replacement and a conflict. If both packages end up in our dependencies, one wins... (without knowing, as they will overwrite each other). So, it is suboptimal.

We can fix it, all, by getting the first one fixed, bumping it on our end, bumping the docker base after that, and lastly banning the old package in our constraints file (all in that order).

[bdraco]

We can strip out the asyncio test patching at at any point once those integration have their libs updated.

home-assistant/docker#260 will take care of the ccchardet