-
Notifications
You must be signed in to change notification settings - Fork 29
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Use loggly bulk API #18
Conversation
Next steps is to implement the multi_receive(events) to support logstash 2.2.x |
+1 here, this is a huge design flaw with the current plugin. Connections are set up/torn down for each event in the current model. HTTPS and Proxies only exacerbate this. |
@Vincent-- apologies for not moving on this PR. Can you please rebase? I can merge this then |
@suyograo, done 👍 |
Are there any plans to merge this? |
Is this ever going to be merged? This plugin is not usable for production in it's current state. |
Sorry for the delay in getting to this, especially to @Vincent-- , who's been responsive in everything the team asked. This plugin doesn't have an active maintainer (see #20), so it's hard for us to dedicate much time to it. I'll try to get this merged shortly. |
This has been merged and expanded upon. Published as v4.0.0. |
Very late, but thanks @Vincent-- for your contribution! |
See https://www.loggly.com/docs/http-bulk-endpoint/
With the bulk API and some tweaking on the number of output workers and the flush size, the speed increased by around 50 times on my setup.