We are starting using a git branching model like the Elastic Stack projects. 

This commit makes sure this `7.7` branch is using the 7.7.x-SNAPSHOT Docker images and  this branch will be used for the development and release processes  for the Helm Charts 7.7.x

[meta] fix ci jobs

The cluster names created for running tests can't contain the `.`
character which is part of the branch name.

For doing the integration tests some GKE clusters are created. There is
a dedicated job to cleanup these clusters at the end of the tests.
This commit fixes the Jenkins configuration to make sure this upstream
job (which does not need parameter) is triggered.

Metricbeat improvements

Filebeat improvements

This commit updates the remaining links to GitHub and Jenkins which
had `master` as the branch name to 7.7

[helm] bump helm version to 2.16.6

* [script] Update bumper script to handle SNAPSHOT versions

This commit updates the `bumper.py` script to handle the
workflows for updating the versions to test staging artifacts
and before a release, for example:

- update 7.7.0-SNAPSHOT to 7.7.0 before tagging a release, by running
  `env BUMPER_VERSION_7="7.7.0" ./helpers/bumper.py`
- update 7.7.0-SNAPHSHOT to 7.7.0-abcdefgh for testing staging artifacts
by running:
  `env BUMPER_VERSION_7="7.7.0-abcdefgh" BUMPER_USE_STAGING_IMAGES="true" ./helpers/bumper.py`

For now this script do not handle the bump from 7.7.0 to 7.7.1-SNAPSHOT
for the next developement iteration after a release. In the meantime
this update should be done manually.

…c#582)

The multijob configuration for testing staging 7.7 artifacts was
referencing jobs from another branch. This commit makes sure the
configured jobs are all from the same git branch.

…ndom-key

Use busybox for key generation in testing

[metricbeat] split values for daemonset and deployment

[metricbeat] add host networking option

[elasticsearch] Adds imagePullSecrets for test Pod

[elasticsearch] Set securityContext for test pod

Update defaults for extra values to support lists

[elasticsearch] update readiness probe endpoint

Added support for envFrom in apm-server, logstash, kibana and elasticsearch

[logstash] update doc and values.yaml for http.host issues

Doc improvements

- Reformat all `README.md` files
  - Fix typos and missing syntaxes)
  - Use Markdown implicit link names
  - Sort values in configuration tables
  - Limit lines to 80 characters (except for code blocks and tables)
  - Add table of content
- Fix default values descriptions
- Move testing instructions to `CONTRIBUTING.md` doc
- Move breaking changes notices to `BREAKING_CHANGES.md` doc

FAQ and examples improvements (elastic#598)

- Add missing section in contributing guide
- Add note about ECK
- Add more FAQ topics
- Document all examples
- NIT: fixes typos...

This commit initiates the 6.8 branch which will be dedicated to the 7.x.x releases for the Helm Charts. It will allow to:

- test this branch with the daily Stack Docker images 7.8.0-SNAPSHOT via dedicated Jenkins jobs
- test the staging 7.8.x Docker images before a release

This branch is based on https://github.com/elastic/helm-charts/tree/7.7/ which was initiated in elastic#541.

Also related to elastic#602.

…c.selector.matchLabels (elastic#622)

This fix metricbeat chart upgrades when .Chart.Version change.

UPGRADE FAILED
Error: Deployment.apps "metricbeat-metricbeat-metrics" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"metricbeat-metricbeat-metrics", "chart":"metricbeat-7.7.0", "heritage":"Tiller", "release":"metricbeat"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable
Error: UPGRADE FAILED: Deployment.apps "metricbeat-metricbeat-metrics" is invalid: spec.selector: Invalid value: v1.LabelSelector{MatchLabels:map[string]string{"app":"metricbeat-metricbeat-metrics", "chart":"metricbeat-7.7.0", "heritage":"Tiller", "release":"metricbeat"}, MatchExpressions:[]v1.LabelSelectorRequirement(nil)}: field is immutable

See helm/charts#7680 for more details

…itContainers}` (elastic#637)

…tic#638)

…lastic#624)

This commit fix a bug introduced in elastic#572 where Metricbeat deployment doesn't start after an upgrade from a previous version when using a custom metricbeatConfig.

* Add ability to set the file permissions when mounting a secret

* Added test for defaultMode on secret mount

Common labels were moved to helpers template to have only one source of truth of common/added labels shared between all Kibana resources.

Also, this extends the capability to add a custom label and this will be common between all the resources.

* add CI tests for GKE 1.16
* test Elasticsearch upgrade from 7.4.0 on K8S 1.16 due to previous version of Elasticsearch chart not compatible with K8S 1.16 (see elastic#635 (comment))
* move Elasticsearch upgrade test logic to dedicated shell script to improve error handling
* add jq to Docker image

According to https://github.com/helm/charts/blob/master/REVIEW_GUIDELINES.md, service selector should not contain heritage.

It would break (future) migration from helm 2 to helm 3 (during the rolling update only, there could be a downtime when only old nodes are ready but new services is there).

This commit bump the 7.x branch which will be dedicated to the 7.x.x releases for the Helm Charts. It will allow to:

- test this branch with the daily Stack Docker images 7.9.0-SNAPSHOT via dedicated Jenkins jobs
- test the staging 7.9.x Docker images before a release

This is also backporting some updates in README files that were made in other branches and fixing the links to Elastic documentation.

…mes (elastic#542)

Prevents very long startup times when the namespace contains many services. Only valid for kubernetes versions >1.13

This commit makes probes customizable using values.
The values where already partly existing but weren't used
in the deployment template.

This commit add a security example to use Logstash Helm chart and Elasticsearch Helm chart with TLS encryption.

…elastic#655)

Co-authored-by: Julien Mailleret <8582351+jmlrt@users.noreply.github.com>

This commit fixes the expected version in security goss test.

…to its volumeClaimTemplate (elastic#665)

Co-authored-by: Maxime Gréau <maxime.greau@elastic.co>

This commit add a mandatory headless service for Logstash statefulset.

Headless service is required for Statefulsets.
While Helm 2 allowed to deploy Statefulsets without a serviceName, Helm 3 enforce this requirement and fails if serviceName is missing.

Note: Statefulsets don't accept serviceName field update during release upgrades. This change is therefore considered as a breaking change and will require using `helm upgrade --force` for upgrades.

This commit add permission to list nodes. 
This is required when using `add_resource_metadata: node.enabled: true`.

…lastic#715)

If the `--namespace` flag isn't provided to Helm, then it will use whatever the local configured namespace is, which could be different.

This can lead to tests failing that expect the `.Release.Namespace` to resolve to `default`

…astic#713)

Spotted that the `apm-server` chart isn't being tested by PR suite.

So add it to the `CHART` matrix.

…elastic#712)

Co-authored-by: Gavin Williams <fatmcgav@gmail.com>

This commit document the workaround to work with Filebeat output which don't support testing.

This is required as the default readiness probe use `filebeat test output` command.

In the most cases kube-state-metrics is already installed on the
cluster, so let's just re-use it, instead of installing another
one copy. By default, kube-state-metrics are installed as dependency,
so this PR doesn't change the default behaviour

Signed-off-by: Sergiy Kulanov <sergey@kulanov.org.ua>

…search.uname (elastic#670)

This addressing an issue where nodes are unable to locate the masters when fullnameOverride is used, due to the cluster.initial_master_nodes having the wrong name of the nodes.

…astic#723)

- Update oss docker image links to new Elastic registry
- Fix some other links

change
https://github.com/elastic/helm-charts/tree/master/kibana/examples/security/security.yaml
to be
https://github.com/elastic/helm-charts/tree/master/kibana/examples/security/security.yml

This commit bump the 7.x branch which will be dedicated to the 7.x.x releases for the Helm Charts. It will allow to:

- test this branch with the daily Stack Docker images 7.10.0-SNAPSHOT via dedicated Jenkins jobs

This commit add Slack notifications to Elastic Release team Slack channel for helm-charts branch and staging job templates.

This PR add Helm 3 support in preview as the main blockers were fixed in previous PR.

Note that adding automated tests with Helm 3 is still required to add full Helm 3 support.

These jobs are replaced by a single job which can manage every branch in 47a45cf

This PR fix CI builds failing because GKE 1.14 is no more available in GCP

Co-authored-by: Julien Mailleret <8582351+jmlrt@users.noreply.github.com>

Co-authored-by: Julien Mailleret <8582351+jmlrt@users.noreply.github.com>

Co-authored-by: Julien Mailleret <8582351+jmlrt@users.noreply.github.com>

…c#810)

Kubernetes doesn't accept `_` characters in resources names.
This commit fix the secrets names in the examples we provide by
replacing `_` by `-`which Kubernetes is accepting.

Source: helm/helm#6477

This PR disable nss dentry cache for Elasticsearch and Kibana
readinessProbe.

On affected system (nss < 3.52), the curl commands used by
readinessProbe are filling dentry cache which is observed in some
cases to be never reclaimed.

Elasticsearch and Kibana Docker images are based on CentOS 7 which
is using nss-3.44.0-7.el7_7.x86_64 and are affected by this bug.

This PR disable nss dentry cache in readinessProbe as a
workaround.

…stic#717)

* [metricbeat] support deployment/daemonset specific metrics
* chore: rename test_adding_legacy_labels to test_adding_deprecated_labels

Co-authored-by: Julien Mailleret <8582351+jmlrt@users.noreply.github.com>

This commit fix an issue introduced in 8ed75a9 where helm
install/upgrade is failing if a NodePort service is defined (see [0] for
more details).

Logstash headless service used to manage Statefulset does not anymore include
`.Values.service.ports` and include only Logstash httpPort.

This is done because headless service `ports` doesn't accept `nodePort`
values that can be included in `.Values.service.ports` when adding a
NodePort service.

[0]: elastic#807

If for daemonset/deployment is not enabled, dont generate useless config YAML.

* Streamline charts README doc

This commit add a coordinator node group to elasticsearch multi test.
This also add ml and remote_cluster_client roles to default values.

- Bump Helm version used in tests from 2.16.2 to 2.17.0
- Add CI tests on GKE 1.17