Release v3.1.2

Logging Core Module Release 3.1.2

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team SIGHUP.

This is a patch release fixing a bug with the included Grafana dashboard, see here for more.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.5.0	No update
opensearch-dashboards	v2.5.0	No update
cerebro	v0.9.4	No update
logging-operator	v3.17.10	No update
loki-distributed	v2.7.3	No update
minio-ha	vRELEASE.2023-01-12T02-06-16Z	No update

Bug Fixes and Changes 🐛

• Updated the included Grafana dashboard in the Logging Operated package, the old version was using metrics that are not available anymore, breaking some widgets.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.1.1

Logging Core Module Release 3.1.1

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team SIGHUP.

This is a patch release that includes bug fixes, see here for more.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.5.0	No update
opensearch-dashboards	v2.5.0	No update
cerebro	v0.9.4	No update
logging-operator	v3.17.10	No update
loki-distributed	v2.7.3	No update
minio-ha	vRELEASE.2023-01-12T02-06-16Z	No update

Bug Fixes and Changes 🐛

• Missing index pattern infra-* on OpenSearch Dashboards
• gatekeeper-system namespace was not excluded from kubernetes flow and included in infra flow
• Bump fluent-bit version to 1.9.5 in all HostTailers.
• Add containerd to systemd tailers.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.1.0

Logging Core Module Release 3.1.0

Welcome to the latest release of the logging module of Kubernetes Fury Distribution maintained by team SIGHUP.

This update includes new versions of various components, such as OpenSearch and OpenSearch Dashboards, as well as bug fixes and changes, such as support for Kubernetes 1.25 and the introduction of two new packages, Loki distributed and minio-ha.
Additionally, a new Infra flow has been added to retrieve all infrastructural (KFD) logs.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.5.0	2.0.0
opensearch-dashboards	v2.5.0	2.0.0
cerebro	v0.9.4	No update
logging-operator	v3.17.10	3.17.7
loki-distributed	v2.7.3	New package
minio-ha	vRELEASE.2023-01-12T02-06-16Z	New package

Bug Fixes and Changes 🐛

• Added support for Kubernetes 1.25.
• Introduced Loki distributed package ready for production use.
• Introduced minio-ha package to store errors from Fluentd, and as an S3 backend for Loki.
• The Kubernetes ClusterFlow now exclude by default all the infrastructural (KFD) log, a new Infra ClusterFlow has been added to collect all the infrastructural (KFD) logs.
• Removed the two non-clustered MinIO pods from logging-operated package, minio-ha package is now a requirement.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Note: Now, logging-operated and loki-distributed requires the installation of the minio-ha package. After the installation, you can safely remove the minio StatefulSet with kubectl delete sts minio -n logging and the related setup CronJob minio-ilm with kubectl delete cronjob -n logging minio-ilm.

Preview v3.1.0-rc10

DRAFT Logging Core Module Release 3.1.0

Welcome to the latest release of logging module of Kubernetes Fury Distribution
maintained by team SIGHUP.

This update includes new versions of various components, such as OpenSearch and OpenSearch Dashboards,
as well as bug fixes and changes, such as support for Kubernetes 1.25 and the introduction of a new Loki distributed package and minio-ha package.
Additionally, a new Infra flow has been added to retrieve all infrastructural (KFD) logs.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.5.0	2.0.0
opensearch-dashboards	v2.5.0	2.0.0
cerebro	v0.9.4	No update
logging-operator	v3.17.10	3.17.7
loki-distributed	v2.7.3	New package
minio-ha	vRELEASE.2023-01-12T02-06-16Z	New package

Bug Fixes and Changes 🐛

• Add support for Kubernetes 1.25.
• Introduced Loki distributed package ready for production use.
• Introduced minio-ha package to store errors from Fluentd, and as an S3 backend for Loki.
• The Kubernetes ClusterFlow now exclude by default all the infrastructural (KFD) logs and a new Infra ClusterFlow has been added to get all the infrastructural (KFD) logs.
• Removed the two non-clustered MinIO pods from logging-operated package, minio-ha package is now a requirement.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v2.1.0

Logging Core Module Release 2.1.0

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team
SIGHUP.

This is a minor release that removes support for Kubernetes 1.20, 1.21 and adds support for Kubernetes 1.24.

Component Images 🚢

Component	Supported Version	Previous Version
elasticsearch	v7.16.2	No update
kibana	v7.16.2	No update
cerebro	v0.9.4	No update
curator	v5.8.4	No update
logging-operator	v3.17.7	No update

Bug Fixes and Changes 🐛

• Fixed initContainer on ElasticSearch, to change fs.file-max that was missing.
• Improve Elasticsearch replicas for indexes
• MinIO replicated to two nodes, added 7 days retention

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.0.3

Logging Core Module Release 3.0.3

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team SIGHUP.

This is a patch release that adds some enhancements and fixes.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.0.0	No update
opensearch-dashboards	v2.0.0	No update
cerebro	v0.9.4	No update
logging-operator	v3.17.7	No update
loki-stack	v2.4.2	No update

Bug Fixes and Changes 🐛

• Updated initContainer on OpenSearch, to change vm.max_map_count and fs.file-max only if the value is lower than expected.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.0.2

Logging Core Module Release 3.0.2

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team SIGHUP.

This is a patch release that adds some enhancements and fixes.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.0.0	No update
opensearch-dashboards	v2.0.0	No update
cerebro	v0.9.4	No update
logging-operator	v3.17.7	No update
loki-stack	v2.4.2	No update

Bug Fixes and Changes 🐛

• Changed the Fluentd log level to debug and enabled log_os_400_reason: true on all OpenSearch outputs so that rejected logs from OpenSearch are labeled @error and captured on Minio.
• Added a retention of 7 days for saved objects on Minio.
• Removed the emission of @ERROR logs that cannot be parsed in JSON from ClusterFlow Kubernetes.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.0.1

Logging Core Module Release 3.0.1

Welcome to the latest release of logging module of Kubernetes Fury Distribution
maintained by team SIGHUP.

This is a patch release that adds fixes.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.0.0	No update
opensearch-dashboards	v2.0.0	No update
cerebro	v0.9.4	No update
logging-operator	v3.17.7	No update
loki-stack	v2.4.2	No update

Bug Fixes and Changes 🐛

• #96 fixing alerts descriptions.
• #98 fixing node selection on audit and etcd HostTailers.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -

Release v3.0.0

Logging Core Module Release 3.0.0

Welcome to the latest release of logging module of the Kubernetes Fury Distribution maintained by team SIGHUP.

⚠️ This is a major release including a breaking change that replaces Elasticsearch and Kibana stack with the OpenSearch alternative.
Curator and its variants are also removed.

Component Images 🚢

Component	Supported Version	Previous Version
opensearch	v2.0.0	New component
opensearch-dashboards	v2.0.0	New component
cerebro	v0.9.4	No update
logging-operator	v3.17.7	No update
loki-stack	v2.4.2	New component

Please refer to the individual release notes to get detailed information on each release.

New package: Welcome OpenSearch! 📕

This release completely removes the Elasticsearch and Kibana stack in favor of the OpenSearch cluster and OpenSearch Dashboards UI.

Removals: Curator and its variants 🚮

This release completely removes Curator package and its variants. The index expiration is now managed via ISM policies on the OpenSearch cluster.

Technical preview: Loki 🔬

We are also adding Loki storage as an alternative to OpenSearch. This is a preview release and is not considered production ready.

Update Guide 🦮

The update procedure is pretty straightforward, you just need to install the new stack.
The suggested approach is to maintain the old Elasticsearch and Kibana stack up&running while the new OpenSearch stack starts to receive logs.

Also, all the configurations for the logging operator are updated to send logs to the new OpenSearch cluster.

Apply the new stack:

kustomize build vendor/katalog/logging-operator | kubectl apply -f -
kustomize build vendor/katalog/logging-operated | kubectl apply -f -
kustomize build vendor/katalog/configs | kubectl apply -f -
# You can choose the single or triple opensearch deployment
kustomize build vendor/katalog/opensearch-single | kubectl apply -f -
kustomize build vendor/katalog/opensearch-dashboards | kubectl apply -f -

NOTE: Run kubectl apply multiple times until you see no errors in the console

When everything is ok on the OpenSearch side, you can proceed with the removal of the old stack:

kubectl delete statefulset elasticsearch -n logging
kubectl delete service elasticsearch -n logging
kubectl delete prometheusrule es-rules -n logging
kubectl delete servicemonitor elasticsearch -n logging
kubectl delete deployment kibana -n logging
kubectl delete service kibana -n logging
kubectl delete cronjob curator -n logging

Release v2.0.3

Logging Core Module Release 2.0.3

Welcome to the latest release of logging module of Kubernetes Fury Distribution maintained by team
SIGHUP.

This is a patch release fixing curator index rotation.

Component Images 🚢

Component	Supported Version	Previous Version
elasticsearch	v7.16.2	No update
kibana	v7.16.2	No update
cerebro	v0.9.4	No update
curator	v5.8.4	No update
logging-operator	v3.17.7	No update

Bug Fixes and Changes 🐛

• #89 missing indexes on curator.

Update Guide 🦮

Process

To upgrade the module run:

kustomize build | kubectl apply -f -