Skip to content
This repository has been archived by the owner on Jun 1, 2024. It is now read-only.

Make sure the sink (and app) do not crash when the ES is unreachable … #359

Merged
merged 2 commits into from
Sep 19, 2020

Conversation

mivano
Copy link
Contributor

@mivano mivano commented Sep 16, 2020

Make sure the sink (and app) do not crash when the ES is unreachable during the discovery of the ES version.

What issue does this PR address?

Fixes the problem raised in this issue: #316

Does this PR introduce a breaking change?

If you are now depending on an app crash when the ES is not available during detection of the version, then this will no longer be the case. The error is logged to the selflog, but a sink should not bring down an app.

Please check if the PR fulfills these requirements

  • The commit follows our guidelines
  • Unit Tests for the changes have been added (for bug fixes / features)

Other information:

@mivano mivano merged commit c26047a into dev Sep 19, 2020
@orjan
Copy link
Contributor

orjan commented Sep 21, 2020

It's good that the application not crashes, still the behavior isn't deterministic.
That make we wonder if we'll need dynamic looks up in future versions?

  • Running an application against a specific version of Elastic is often a deliberate choice.
  • Make the sink less complex and deterministic
  • Changes are typically gradually introduced e.g. in the current versions of v7 it's possible to drop the _type

Maybe we should move this discussion to a separate issue since it's not directly related to the pull request, that looking good.

@mivano
Copy link
Contributor Author

mivano commented Sep 28, 2020

Agreed, it would be strange to have a suddenly changed version of Elasticsearch. The original intent was to make it as easy as possible to get started with the default settings. So no manual template and mapping setup. However, we are now supporting too many options and versions, making it more complex. Combined with a lot of duplicated code for the buffer option, we might need to reconsider some options here.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants