Extend yarn es: plugin support + adding secure files to es keystore

[Mpdreamz]

Summary

Adding --plugins and --secureFiles as flags to yarn es this allows kibana devs to quickly spin up development clusters with plugins. The secureFiles helps to make it easier to add remote shared aws/gcp/azure/etc repositories to restore large datasets for development.

This allows you to run e.g

$ yarn es snapshot --plugins repository-gcs --secureFiles gcs.client.secondary.credentials_file=~/.gcp

For 8.0+ the installation for e.g repository-gcs will still run but effectively be noop since its now packaged by default.

For maintainers

• This was checked for breaking API changes and was labeled appropriately

[spalger]

LGTM, couple nits but it seems to work well. I don't have a ~/.gcp file, but I created one and was able to get different errors from the plugin. That said, I had to replace ~/.gcp with $HOME/.gcp because bash doesn't resolve the ~ in the middle of the argument, but I don't think that's a big deal.

[Mpdreamz]

Thanks for the reviews @spalger!

That said, I had to replace ~/.gcp with $HOME/.gcp because bash doesn't resolve the ~ in the middle of the argument, but I don't think that's a big deal.

Sorry bout that, I tested with the full path to my home and replaced with ~ while writing the commit message 🙂

[kibana-ci]

💚 Build Succeeded

• Buildkite Build
• Commit: c151436
• Storybooks Preview
• Webpack Bundle Analyzer

Metrics [docs]

✅ unchanged

History

• 💚 Build #28086 succeeded ba58242
• 💔 Build #28002 failed 56c6107
• 💔 Build #27999 failed df0940f
• 💔 Build #27852 failed 10bd560
• 💔 Build #27757 failed f996c45
• 💔 Build #27753 failed 1f49f47755f63310093ae7aff665f0329a8c67a2

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

[kibanamachine]

Friendly reminder: Looks like this PR hasn’t been backported yet.
To create backports run node scripts/backport --pr 126938 or prevent reminders by adding the backport:skip label.