Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce a feature flag to set the default value of cluster.logsdb.enabled #109614

Open
salvatore-campagna opened this issue Jun 12, 2024 · 2 comments

Comments

@salvatore-campagna
Copy link
Contributor

salvatore-campagna commented Jun 12, 2024

Description

PR #109025 introduced a node level settings which controls whether the logs index mode is used by default in logs@settings. Introducing the index mode in the existing logs@settings composable template results in indices
matching the logs-*-* pattern to adopt the new logs index mode.

Enabling the index mode by default, anyway, still requires us to fix a couple of issues with synthetic source first:

Fixing such issues is required to prevent some tests failures, including:

  • org.elasticsearch.datastreams.LogsDataStreamIT
  • org.elasticsearch.datastreams.EcsLogsDataStreamIT

and to prevent mapping failures in the elastic/logs Rally nightly track execution.

For this reason the setting was created with a default value of false and the feature flag introduction has
been postponed waiting for such issues to be fixed. After fixing the issues above we can proceed with
using a feature flag to set the default value of cluster.logsdb.enable to true for snapshot builds only.

Before merging the PR including the feature flag, anyway, we need to make sure we address any Rally issue so that we can prevent failures of the nightly benchmark of elastic/logs. See #109523.

@elasticsearchmachine
Copy link
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

@salvatore-campagna
Copy link
Contributor Author

salvatore-campagna commented Jun 27, 2024

We are considering not doing this anymore for two reasons:

  1. enabling LogsDB will already need an override for the setting and upgrading of the version of the stack template registry. Adding a feature flag seems something overkilling, making things even more complicated.
  2. even without a feature flag we have a setting that integrations can act on to enable/disabled LogsDB. Sure not having the feature flag does not give us snapshot builds with LogsDB by default, but that is not really an obstacle when it comes to test integrations.

Anyway, not matter if we decide or not about adding the feature flag, if we decide to have it, we will add it after the integration testing activity is complete so that the feature flag is available when LogsDB is in Tech Preview and not before.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants