Skip to content

A Python implementation of "Kafka Connect"-like functionality that uses plain AvroConsumer/-Producers to make it easier to develop Kafka connect applications.

License

Notifications You must be signed in to change notification settings

real-digital/pyconnect

Repository files navigation

PyConnect

pypi Version Python Versions Build Status License: MIT

A Python implementation of "Kafka Connect"-like functionality that uses plain AvroConsumer/-Producers to make it easier to develop Kafka connect applications.

TODOs

  • Flush consumer messages based on a timeout optionally
  • Provide runtime and examples that show how to run it in a dockerized environment
  • Add travis build process and mypy checking

Known issues

  • Kafkacat and the Producer will try to reach the test cluster via "localhost" but will get the response that they should connect to "broker", which isn't resolvable outside of the docker-compose environment. That's why we change /etc/hosts during development setup. You can undo the changes with make uninstall-hosts

About

A Python implementation of "Kafka Connect"-like functionality that uses plain AvroConsumer/-Producers to make it easier to develop Kafka connect applications.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published