Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement Round Robin/Load balancing #23

Open
ph opened this issue Aug 8, 2016 · 8 comments
Open

Implement Round Robin/Load balancing #23

ph opened this issue Aug 8, 2016 · 8 comments

Comments

@ph
Copy link
Contributor

ph commented Aug 8, 2016

On the first payload of events, the plugin will randomly choose a server and will keep that connection open until something bad happen to the server. It would be great if we had the option to round robin between sending batches.

@ph ph added the enhancement label Aug 8, 2016
@ph
Copy link
Contributor Author

ph commented Aug 8, 2016

cc @jakommo

@lsoumille
Copy link

Any progress on this ?

@GazzaC
Copy link

GazzaC commented Apr 14, 2018

I would like to hear news on this item also. I have a tiered implementation of logstash which is connected via the lumberjack protocol and the logstash-output-lumberjack and logstash-input-lumberjack plugins. I also employ the logstash multi pipeline feature and connect multi-piplines vua lumberjack on a 2 tiered arrangement. Are there any plans on this happening soon?

@ydewinte
Copy link

ydewinte commented Nov 7, 2019

Any update?

@systemdave
Copy link

Has there been any further discussion on a path forward for this functionality Logstash to Logstash?

@tomerilp
Copy link

tomerilp commented May 4, 2020

any chance to add this capability?

@tfrederick74656
Copy link

I am also very interested in this functionality. Working with an implementation ow that consists of larger individual Logstash nodes at various remote sites that aggregate to a scale-out set of lower-spec cloud-hosted Logstash nodes. It's impossible to achieve horizontal scalability at the final aggregation point when the downstream nodes use sticky node selection and may be larger than any individual node in the upstream set.

@nextsummer33
Copy link

Just checking the code in lumberjack client, A host is selected by shuffling the array and pop the last. As the result, it just create a single connection rather than multiple connections and flush the data to each host by the round robin.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

8 participants