Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consumer.stop() blocks in GroupCoordinator.ensure_coordinator_known() if all brokers are unavailable #659

Closed
dkilgore90 opened this issue Sep 24, 2020 · 0 comments · Fixed by #660

Comments

@dkilgore90
Copy link
Contributor

Describe the bug
In a scenario where all kafka brokers have been shut down, an application may also want to shut down (or at least stop consumers). Consumer.stop() can get blocked, cycling endlessly to confirm the group coordinator id:

https://github.com/aio-libs/aiokafka/blob/v0.6.0/aiokafka/consumer/group_coordinator.py#L535-L541

the NodeNotReadyError received in this case is marked as retriable, so the loop continues.

Expected behaviour
Consumer.stop() should be able to complete

Environment (please complete the following information):

  • aiokafka version (python -c "import aiokafka; print(aiokafka.__version__)"): 0.6.0
  • kafka-python version (python -c "import kafka; print(kafka.__version__)"): 2.0.1
  • Kafka Broker version (kafka-topics.sh --version): 2.3.0
  • Other information (Confluent Cloud version, etc.):

Reproducible example

# Add a short Python script or Docker configuration that can reproduce the issue.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant