Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add GPU-enabled node group - development cluster #4253

Closed
wants to merge 60 commits into from

Conversation

AntFMoJ
Copy link
Contributor

@AntFMoJ AntFMoJ commented May 1, 2024

Pull Request Objective

This piece of work is being tracked in this GitHub Issue.

The changes in this PR add a GPU-enable node group to the cluster in analytical-platform-development.

Note: Static analysis has been overridden as the issues flagged in the development cluster are historic and not arising from the changes made in this PR.

Closed due to complete merge conflicts! Replaced by #4341

Copy link
Contributor

github-actions bot commented May 1, 2024

Terraform Component 🧱: aws-analytical-platform-development-cluster

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-development/cluster, Workflow: Terraform, Marker: aws-analytical-platform-development-cluster_plan

Copy link
Contributor

github-actions bot commented May 1, 2024

Terraform Component 🧱: aws-analytical-platform-development-cluster

Checkov 🛂: failure

Trivy 🛂: failure

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-development/cluster, Workflow: Terraform, Marker: aws-analytical-platform-development-cluster_static_analysis

@AntFMoJ AntFMoJ changed the title Testing changes to add gpu_node_pool Add GPU-enabled node group - development cluster May 1, 2024
julialawrence and others added 9 commits May 2, 2024 11:12
* Defining engineering buckets.

* Linting fixes.

* Removed unused locals and code.

* Linting fixes

* Changing local name to snake_case

* After conversation with DE, removing replication config.

* Amending tags

* Adding ingestion bucket policies

* Post-manual apply, removing imports

* Removing locals only used in import statements
This commit enables streaming to the Operations Engineering AWS account in Mod Platform. By enabling this streaming, we are allowing Operations Engineering to identify users who only use GitHub to auth to various services, avoiding unnecessary account removal due to inactivity.
Replace unused log stream

Signed-off-by: GitHub <noreply@github.com>
….0 to 12.2731.0 (#4263)

:dependabot: github-actions(deps): Bump bridgecrewio/checkov-action

Bumps [bridgecrewio/checkov-action](https://github.com/bridgecrewio/checkov-action) from 12.2726.0 to 12.2731.0.
- [Release notes](https://github.com/bridgecrewio/checkov-action/releases)
- [Commits](bridgecrewio/checkov-action@e5aec87...80c58e6)

---
updated-dependencies:
- dependency-name: bridgecrewio/checkov-action
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
dependabot bot and others added 9 commits May 7, 2024 08:17
Signed-off-by: Jacob Woffenden <jacob.woffenden@digital.justice.gov.uk>
Signed-off-by: Jacob Woffenden <jacob.woffenden@digital.justice.gov.uk>
Signed-off-by: Jacob Woffenden <jacob.woffenden@digital.justice.gov.uk>
…form/auth0/ministryofjustice-data-platform-development (#4283)
…form/aws/analytical-platform-data-engineering-production/10ds (#4284)
@github-actions github-actions bot added the github-workflow Pull requests that update workflows label May 17, 2024
Copy link
Contributor

Terraform Component 🧱: auth0-alpha-analytics-moj

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/alpha-analytics-moj, Workflow: Terraform, Marker: auth0-alpha-analytics-moj_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-engineering-sandbox-a-airflow-hmcts-sdp-load

Checkov 🛂: failure

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-engineering-sandbox-a/airflow-hmcts-sdp-load, Workflow: Terraform, Marker: aws-analytical-platform-data-engineering-sandbox-a-airflow-hmcts-sdp-load_static_analysis

Copy link
Contributor

Terraform Component 🧱: auth0-dev-analytics-moj

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/dev-analytics-moj, Workflow: Terraform, Marker: auth0-dev-analytics-moj_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-tooling-iam

Checkov 🛂: failure

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/tooling-iam, Workflow: Terraform, Marker: aws-analytical-platform-data-production-tooling-iam_static_analysis

Copy link
Contributor

Terraform Component 🧱: pagerduty

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/pagerduty, Workflow: Terraform, Marker: pagerduty_static_analysis

Copy link
Contributor

Terraform Component 🧱: auth0-ministryofjustice-data-platform

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/ministryofjustice-data-platform, Workflow: Terraform, Marker: auth0-ministryofjustice-data-platform_static_analysis

Copy link
Contributor

Terraform Component 🧱: auth0-ministryofjustice-data-platform-development

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/ministryofjustice-data-platform-development, Workflow: Terraform, Marker: auth0-ministryofjustice-data-platform-development_static_analysis

Copy link
Contributor

Terraform Component 🧱: dpat-eks-production-actions-runners

Checkov 🛂: success

Trivy 🛂: success

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/dpat-eks/production/actions-runners, Workflow: Terraform, Marker: dpat-eks-production-actions-runners_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-engineering-production-10ds

Checkov 🛂: failure

Trivy 🛂: failure

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-engineering-production/10ds, Workflow: Terraform, Marker: aws-analytical-platform-data-engineering-production-10ds_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-data-engineering-pipelines

Checkov 🛂: failure

Trivy 🛂: failure

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/data-engineering-pipelines, Workflow: Terraform, Marker: aws-analytical-platform-data-production-data-engineering-pipelines_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-airflow

Checkov 🛂: failure

Trivy 🛂: failure

Static Analysis Override Label 🏷️: true

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/airflow, Workflow: Terraform, Marker: aws-analytical-platform-data-production-airflow_static_analysis

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-engineering-sandbox-a-airflow-hmcts-sdp-load

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-engineering-sandbox-a/airflow-hmcts-sdp-load, Workflow: Terraform, Marker: aws-analytical-platform-data-engineering-sandbox-a-airflow-hmcts-sdp-load_plan

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-tooling-iam

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/tooling-iam, Workflow: Terraform, Marker: aws-analytical-platform-data-production-tooling-iam_plan

Copy link
Contributor

Terraform Component 🧱: auth0-alpha-analytics-moj

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/alpha-analytics-moj, Workflow: Terraform, Marker: auth0-alpha-analytics-moj_plan

Copy link
Contributor

Terraform Component 🧱: auth0-ministryofjustice-data-platform-development

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/ministryofjustice-data-platform-development, Workflow: Terraform, Marker: auth0-ministryofjustice-data-platform-development_plan

Copy link
Contributor

Terraform Component 🧱: auth0-ministryofjustice-data-platform

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/ministryofjustice-data-platform, Workflow: Terraform, Marker: auth0-ministryofjustice-data-platform_plan

Copy link
Contributor

Terraform Component 🧱: auth0-dev-analytics-moj

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/auth0/dev-analytics-moj, Workflow: Terraform, Marker: auth0-dev-analytics-moj_plan

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-engineering-production-10ds

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-engineering-production/10ds, Workflow: Terraform, Marker: aws-analytical-platform-data-engineering-production-10ds_plan

Copy link
Contributor

Terraform Component 🧱: dpat-eks-production-actions-runners

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/dpat-eks/production/actions-runners, Workflow: Terraform, Marker: dpat-eks-production-actions-runners_plan

Copy link
Contributor

Terraform Component 🧱: pagerduty

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/pagerduty, Workflow: Terraform, Marker: pagerduty_plan

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-data-engineering-pipelines

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/data-engineering-pipelines, Workflow: Terraform, Marker: aws-analytical-platform-data-production-data-engineering-pipelines_plan

Copy link
Contributor

Terraform Component 🧱: aws-analytical-platform-data-production-airflow

Terraform Initialization ⚙️: success

Terraform Validation 🤖: success

Terraform Plan 🛠️: success

Pusher: @AntFMoJ, Action: pull_request, Working Directory: terraform/aws/analytical-platform-data-production/airflow, Workflow: Terraform, Marker: aws-analytical-platform-data-production-airflow_plan

@AntFMoJ AntFMoJ closed this May 17, 2024
@jacobwoffenden jacobwoffenden deleted the accelerated-compute branch May 22, 2024 20:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
github-workflow Pull requests that update workflows override-static-analysis
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants