Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Kafka sender: Use metadata to pick topic #235

Open
KristianLyng opened this issue May 24, 2022 · 0 comments
Open

Kafka sender: Use metadata to pick topic #235

KristianLyng opened this issue May 24, 2022 · 0 comments
Labels
enhancement New feature or request sender Sender-related issue

Comments

@KristianLyng
Copy link
Collaborator

Similar to the influxdb sender, a "TopicFromMeatadata" would reduce the needed configuration significantly.

At the moment, I need to specify 8 senders to send to 8 different topics, then set up a switch sender to determine what goes where. This is a bit cumbersome.

However, the Kafka-go library requires that a Writer object specifies the topic to send to, and reasonably disallows modifying the Writer-object if used concurrently. So unlike the influx sender, where we just write the measurement in the line protocol format, we need to dynamically allocate Writer-objects on demand, and possibly have some sort of safety mechanism to avoid arbitrary amounts of Writers.

As such, this is a bit of a future-item since it's a bit of work.

@KristianLyng KristianLyng added sender Sender-related issue enhancement New feature or request labels May 24, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request sender Sender-related issue
Projects
None yet
Development

No branches or pull requests

1 participant