This repository has been archived by the owner on Mar 30, 2023. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 162
Add Logstash to the Marketplace UI and ARM template #223
Merged
Merged
Changes from all commits
Commits
Show all changes
32 commits
Select commit
Hold shift + click to select a range
2c7242c
Separate out java installation into script
russcam 229d861
Rename Kibana script
russcam fd8d9e7
Start of add logstash to template
russcam 025034b
Add common Logstash configuration
russcam 7b7bfbb
Add logstash linked template
russcam d81ad98
Update links
russcam e107592
Change default Logstash size
russcam 91628e8
Use ES version for Logstash version
russcam ca043e4
Unique OS disk names
russcam 429bd66
Closing quote
russcam 425c78a
Use correct script name
russcam fbcb4a6
Set path.settings when calling logstash scripts
russcam b4def4e
Check if logstash.yml exists before trying to move
russcam 3438622
Persist environment variables in /etc/sysconfig/logstash
russcam 059c73f
create /etc/sysconfig dir
russcam a9c2c7a
Add parameter descriptions to Logstash script
russcam 23510a0
logstash integration test
russcam 8ea13f0
Generate logstash keystore password if not provided
russcam 62adb09
Poll for logstash event index
russcam ee8ea36
Configure monitoring only when possible
russcam e7b320a
patch logstash VM values
russcam 323c9f7
Replace security password in test logstash conf files
russcam bf2eeb8
Update README
russcam c2f390c
Update README
russcam 865f910
Check Kibana monitoring endpoint
russcam b52abae
Configure Logstash monitoring for 6.3.0+ or X-Pack installed
russcam b86ee76
Consistent default versions and log message casing
russcam da93307
Set default conf file dir
russcam 6e573d8
Add Logstash to UI definition
russcam b32c829
Rename External Access section to Kibana & Logstash
russcam ae1f3dd
Documentation for Logstash
russcam 732af9a
Merge branch 'master' into feature/logstash
russcam File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,23 @@ | ||
{ | ||
"description": "1 data node cluster with logstash", | ||
"isValid" : true, | ||
"deploy" : true, | ||
"why" : "", | ||
"location" : "westeurope", | ||
"parameters" : { | ||
"loadBalancerType":{"value":"external"}, | ||
"kibana":{"value":"Yes"}, | ||
"vmSizeKibana":{"value":"Standard_DS1_v2"}, | ||
"logstash":{"value":"Yes"}, | ||
"vmSizeLogstash":{"value":"Standard_DS1_v2"}, | ||
"logstashAdditionalPlugins":{"value":"logstash-input-heartbeat"}, | ||
"logstashConf":{"value":"conf/logstash.conf"}, | ||
"vmSizeDataNodes":{"value":"Standard_DS1_v2"}, | ||
"vmDataNodeCount":{"value":1}, | ||
"vmDataDiskCount":{"value":1}, | ||
"vmDataDiskSize":{"value":"Small"}, | ||
"storageAccountType":{"value":"Default"}, | ||
"dataNodesAreMasterEligible":{"value":"Yes"}, | ||
"authenticationType":{"value":"password"} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,30 @@ | ||
{ | ||
"description": "1 data node cluster with logstash", | ||
"notes": "the use of xpack.monitoring.collection.enabled requires version to be 6.3.0+", | ||
"isValid" : true, | ||
"deploy" : true, | ||
"why" : "", | ||
"location" : "westeurope", | ||
"parameters" : { | ||
"loadBalancerType":{"value":"external"}, | ||
"esAdditionalYaml":{"value":"xpack.monitoring.collection.enabled: true"}, | ||
"esHttpCaCertBlob":{"value":"certs/ca-cert-with-password.pfx"}, | ||
"esHttpCaCertPassword":{"value":"Password123"}, | ||
"esTransportCaCertBlob":{"value":"certs/ca-cert-with-password.pfx"}, | ||
"esTransportCaCertPassword":{"value":"Password123"}, | ||
"esTransportCertPassword":{"value":"Password1234"}, | ||
"kibana":{"value":"Yes"}, | ||
"vmSizeKibana":{"value":"Standard_DS1_v2"}, | ||
"logstash":{"value":"Yes"}, | ||
"vmSizeLogstash":{"value":"Standard_DS1_v2"}, | ||
"logstashAdditionalPlugins":{"value":"logstash-input-heartbeat"}, | ||
"logstashConf":{"value":"conf/logstash-tls.conf"}, | ||
"vmSizeDataNodes":{"value":"Standard_DS1_v2"}, | ||
"vmDataNodeCount":{"value":1}, | ||
"vmDataDiskCount":{"value":1}, | ||
"vmDataDiskSize":{"value":"Small"}, | ||
"storageAccountType":{"value":"Default"}, | ||
"dataNodesAreMasterEligible":{"value":"Yes"}, | ||
"authenticationType":{"value":"password"} | ||
} | ||
} |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do we need to expose this? Since logstash always deploys on a dedicated VM can we just do the right thing™?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Do you mean the heap size? If so, I wasn't sure what might be a sensible default, beyond the default in JVM.options (which I think is 1GB?). Thoughts?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@russcam mind opening an issue for whether we can rid of the parameter?