Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: adding support for cloud logs #137

Merged
merged 56 commits into from
Sep 20, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
56 commits
Select commit Hold shift + click to select a range
9c3e349
feat: adding support for cloud logs
Aug 6, 2024
2f013fb
Merge branch 'main' of https://github.com/terraform-ibm-modules/terra…
Aug 6, 2024
6162ca3
fix: added existing en support
Aug 7, 2024
237b3ed
Merge branch 'main' into 9802-cl
iamar7 Aug 9, 2024
4deee3a
fix: pre-commit issues
Aug 9, 2024
3d8415a
Merge branch '9802-cl' of https://github.com/terraform-ibm-modules/te…
Aug 9, 2024
903e74c
fix: update module condition
Aug 9, 2024
b7ce2d3
fix: update condition
Aug 9, 2024
ecfb136
Merge branch 'main' into 9802-cl
iamar7 Aug 12, 2024
3426eb7
Merge branch 'main' into 9802-cl
iamar7 Aug 12, 2024
3dc8faa
fix: update test
Aug 12, 2024
bb3e194
fix: resolve comments
Aug 13, 2024
4909586
fix: update bucket logic
Aug 19, 2024
235712a
fix: remove commented code
Aug 19, 2024
3171fa0
fix:remove common-dev-assets changes
Aug 19, 2024
cd6f96a
fix: resolve conflicts
Aug 19, 2024
f1e2b2c
Merge branch 'main' into 9802-cl
iamar7 Aug 19, 2024
27a2b7d
fix: update variables.tf
Aug 19, 2024
5b6db6f
Merge branch '9802-cl' of https://github.com/terraform-ibm-modules/te…
Aug 19, 2024
0c3cb12
fix: update variables.tf
Aug 19, 2024
5f114d6
fix: updated cloud logs condition
Aug 21, 2024
8c348a7
fix: update cos kms key condition
Aug 21, 2024
4a1107d
fix: pre-commit resolve
Aug 22, 2024
6c84299
fix: update existing kms condition
Aug 22, 2024
46457d9
Merge branch 'main' into 9802-cl
iamar7 Aug 22, 2024
acc2528
fix: resolve pipeline errors
Aug 22, 2024
b326c37
Merge branch 'main' into 9802-cl
iamar7 Aug 26, 2024
8d02b58
fix: resolve comments
Sep 2, 2024
5e30a9f
Merge branch '9802-cl' of https://github.com/terraform-ibm-modules/te…
Sep 2, 2024
faacfa8
Merge branch 'main' of https://github.com/terraform-ibm-modules/terra…
Sep 2, 2024
a5cef03
fix: resolve comments
Sep 4, 2024
d073771
fix: resolve comments
Sep 4, 2024
6a04a77
fix: update validation condition
Sep 4, 2024
39861e7
fix: resolve pipeline issue
Sep 4, 2024
3f25f08
fix: update variables default
Sep 4, 2024
04ba898
fix: resolve comments
Sep 5, 2024
16e49ee
fix: resolve comments
Sep 5, 2024
8992243
fix: resolve comments
Sep 6, 2024
7d59c81
fix: resolve comments
Sep 6, 2024
d2e91c3
fix: resolve comments
Sep 6, 2024
3d37a61
fix: update enable_archive to false
Sep 6, 2024
74b9946
Merge branch 'main' into 9802-cl
maheshwarishikha Sep 9, 2024
fdb7746
Merge branch 'main' into 9802-cl
iamar7 Sep 16, 2024
f1954dc
fix: update cloud logs support
Sep 16, 2024
f07948e
fix: resolve comments
Sep 16, 2024
6b3be1a
fix: update ibm_catalog
Sep 16, 2024
3abfbe7
fix: update log routing tenant region
Sep 16, 2024
2397218
fix: update log routing tenant region
Sep 16, 2024
d2f632d
SKIP UPGRADE TEST
Sep 16, 2024
9c1f3ae
fix: resolve comments
Sep 18, 2024
8657668
fix: resolve comments
Sep 18, 2024
1e348bc
fix: update pr_test
Sep 19, 2024
847a662
fix: added log_routing_tenant_region variable
Sep 19, 2024
c671c63
Merge branch 'main' of https://github.com/terraform-ibm-modules/terra…
Sep 19, 2024
f361771
fix: resolve comments
Sep 19, 2024
8f515ab
fix: update ibm_catalog
Sep 20, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
125 changes: 112 additions & 13 deletions ibm_catalog.json
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@
"solution",
"observability",
"observability instances",
"cloud logs",
"log analysis",
"cloud monitoring",
"ATracker",
Expand All @@ -30,6 +31,10 @@
"offering_icon_url": "https://raw.githubusercontent.com/terraform-ibm-modules/terraform-ibm-observability-da/main/images/observability-icon.svg",
"provider_name": "IBM",
"features": [
{
"title": "Configures IBM Cloud Logs",
"description": "Configures an IBM Cloud Logs instance."
},
{
"title": "Configures IBM Log Analysis",
"description": "Configures the IBM Log Analysis instance and logging agents."
Expand All @@ -41,7 +46,7 @@
{

"title": "Configures IBM Cloud Activity Tracker Event Routing",
"description": "Configures an IBM Cloud Activity Tracker route with a Cloud Object Storage and Log Analysis target."
"description": "Configures an IBM Cloud Activity Tracker route with a Cloud Object Storage, Log Analysis and Cloud Logs target."
}
],
"support_details": "This product is in the community registry and support is handled in the source repo. You can open an issue at [https://github.com/terraform-ibm-modules/terraform-ibm-observability-da/issues](https://github.com/terraform-ibm-modules/terraform-ibm-observability-da/issues). Support is not offered through IBM Cloud Support.",
Expand Down Expand Up @@ -93,6 +98,13 @@
"crn:v1:bluemix:public:iam::::role:Editor"
],
"service_name": "cloud-object-storage"
},
{
"role_crns": [
"crn:v1:bluemix:public:iam::::serviceRole:Manager",
"crn:v1:bluemix:public:iam::::role:Editor"
],
"service_name": "logs"
}
],
"compliance": {
Expand Down Expand Up @@ -155,6 +167,58 @@
}
]
},
{
"key": "cloud_logs_provision"
},
{
"key": "cloud_logs_instance_name"
},
{
"key": "cloud_logs_tags"
},
{
"key": "cloud_logs_access_tags"
},
{
"key": "cloud_logs_retention_period",
"options": [
{
"displayname": "7-days",
"value": "7"
},
{
"displayname": "14-days",
"value": "14"
},
{
"displayname": "30-days",
"value": "30"
},
{
"displayname": "60-days",
"value": "60"
},
{
"displayname": "90-days",
"value": "90"
}
]
},
{
"key": "existing_en_instance_crn"
},
{
"key": "en_integration_name"
},
{
"key": "skip_en_auth_policy"
},
{
"key": "skip_logs_routing_auth_policy"
},
{
"key": "logs_routing_tenant_regions"
},
{
"key": "log_analysis_provision"
},
Expand Down Expand Up @@ -221,6 +285,9 @@
{
"key": "enable_at_event_routing_to_cos_bucket"
},
{
"key": "enable_at_event_routing_to_cloud_logs"
},
{
"key": "cloud_monitoring_provision"
},
Expand All @@ -243,15 +310,6 @@
}
]
},
{
"key": "cloud_monitoring_service_endpoints",
"options": [
{
"displayname": "public-and-private",
"value": "public-and-private"
}
]
},
{
"key": "cloud_monitoring_tags"
},
Expand Down Expand Up @@ -332,6 +390,37 @@
}
]
},
{
"key": "cloud_log_data_bucket_name"
},
{
"key": "cloud_log_data_bucket_class",
"options": [
{
"displayname": "standard",
"value": "standard"
},
{
"displayname": "vault",
"value": "vault"
},
{
"displayname": "cold",
"value": "cold"
},
{
"displayname": "smart",
"value": "smart"
},
{
"displayname": "onerate_active",
"value": "onerate_active"
}
]
},
{
"key": "cloud_log_data_bucket_access_tag"
},
{
"key": "management_endpoint_type_for_bucket",
"options": [
Expand Down Expand Up @@ -364,6 +453,12 @@
{
"key": "existing_at_cos_target_bucket_endpoint"
},
{
"key": "existing_cloud_logs_data_bucket_crn"
},
{
"key": "existing_cloud_logs_data_bucket_endpoint"
},
{
"key": "skip_cos_kms_auth_policy"
},
Expand Down Expand Up @@ -396,9 +491,13 @@
],
"architecture": {

"descriptions": "This architecture supports the deployment of IBM Log Analysis and IBM Cloud Monitoring instances on IBM Cloud. It also supports the deployment of IBM Cloud Activity Tracker Event Routing to an Object Storage bucket and Log Analysis target.",
"descriptions": "This architecture supports the deployment of IBM Log Analysis, IBM Cloud Monitoring and IBM Cloud Logs instances on IBM Cloud. It also supports the deployment of IBM Cloud Activity Tracker Event Routing to an Object Storage bucket, Log Analysis and Cloud Logs target.",

"features": [
{
"title": "Creates a Cloud Logs instance",
"description": "Creates and configures the IBM Cloud Logs instance."
},
{
"title": "Creates a Log Analysis instance",
"description": "Creates and configures the IBM Cloud Log Analysis instance."
Expand All @@ -413,7 +512,7 @@
},
{
"title": "Creates an IBM Cloud Activity Tracker event route to an Object Storage bucket and Log Analysis target",
"description": "Creates and configures the IBM Cloud Activity Tracker Event Routing to an IBM Cloud Object Storage bucket and IBM Cloud Log Analysis target."
"description": "Creates and configures the IBM Cloud Activity Tracker Event Routing to an IBM Cloud Object Storage bucket, IBM Cloud Log Analysis and IBM Cloud Logs target."
}
],
"diagrams": [
Expand All @@ -424,7 +523,7 @@
"type": "image/svg+xml"
},

"description": "This architecture supports creating and configuring IBM Cloud Observability instances and IBM Cloud Activity Tracker Event Routing to an Object Storage bucket and Log Analysis instance."
"description": "This architecture supports creating and configuring IBM Cloud Observability instances and IBM Cloud Activity Tracker Event Routing to an Object Storage bucket, Log Analysis and Cloud Logs instance."

}
]
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
5 changes: 4 additions & 1 deletion solutions/instances/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -5,11 +5,14 @@ This deployable architecture creates observability instances in IBM Cloud and su
* A resource group, if one is not passed in.
* An IBM Cloud Log Analysis instance.
* An IBM Cloud Monitoring instance.
* An IBM Cloud Logs instance.
* An IBM Cloud Object Storage instance, if one does not exist.
* The root keys in an existing key management service (KMS) if the keys do not exist. These keys are used when Object Storage buckets are created.
* A KMS-encrypted Object Storage bucket to store archived logs, if one is not passed in.
* A KMS-encrypted Object Storage bucket for Activity Tracker event routing, if one is not passed in.
* An Activity Tracker event route to an Object Storage and Log Analysis target.
* A KMS-encrypted Object Storage bucket for Cloud Logs data, if one is not passed in.
* An Activity Tracker event route to an Object Storage, Log Analysis and Cloud Logs target.
* An option to integrate Cloud Logs with existing event notification instance.

![observability-instances-deployable-architecture](../../reference-architecture/deployable-architecture-observability-instances.svg)

Expand Down
Loading