Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Leverage ObjStore Routes for Prereq Health Checks #519

Merged
merged 1 commit into from
Feb 9, 2024

Conversation

VaniHaripriya
Copy link
Contributor

@VaniHaripriya VaniHaripriya commented Dec 18, 2023

The issue resolved by this Pull Request:

Resolves RHOAIENG-1643

Description of your changes:

Leverage the Object store external route to perform the Health check.

Testing instructions

Deploy DSPO

# git clone and checkout the PR branch
make deploy IMG=quay.io/opendatahub/data-science-pipelines-operator:pr-519

Deploy DSPA instance using dspa_healthcheck.yaml file and check the logs to see if the Minio object store health check is successful.

Note: Please create a CA bundle to avoid custom cert issues while testing and update the same under apiServer section as show in the dspa_healthcheck.yaml file. Created configmap with ca cert as shown below:
kind: ConfigMap
apiVersion: v1
metadata:
name: my-ca
data:
ca.crt: |

@dsp-developers
Copy link
Contributor

A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519
An OCP cluster where you are logged in as cluster admin is required.

To use this image run the following:

cd $(mktemp -d)
git clone git@github.com:opendatahub-io/data-science-pipelines-operator.git
cd data-science-pipelines-operator/
git fetch origin pull/519/head
git checkout -b pullrequest 098c2d020fa439a6defd1db5a4c39d5d7292c22d
make deploy IMG="quay.io/opendatahub/data-science-pipelines-operator:pr-519"

More instructions here on how to deploy and test a Data Science Pipelines Application.

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

1 similar comment
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

Copy link
Contributor

@rimolive rimolive left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes expect that the minio route is secured, so don't forget to add TLS capabilities to minio route w/ Edge termination

controllers/storage.go Outdated Show resolved Hide resolved
Copy link
Contributor

openshift-ci bot commented Dec 21, 2023

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please ask for approval from rimolive. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

1 similar comment
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@VaniHaripriya VaniHaripriya marked this pull request as ready for review December 21, 2023 23:54
Copy link
Contributor

@amadhusu amadhusu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This hits the "signed by unknown authority" issue. I believe this is normal and expected but wanted to confirm the same.

@VaniHaripriya
Copy link
Contributor Author

This hits the "signed by unknown authority" issue. I believe this is normal and expected but wanted to confirm the same.

@amadhusu It is an expected issue. Updated the testing instructions how to avoid this issue, please take a look at it.

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

1 similar comment
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@HumairAK
Copy link
Contributor

can we squash these into a single commit

controllers/storage.go Outdated Show resolved Hide resolved
controllers/storage.go Outdated Show resolved Hide resolved
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

2 similar comments
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

1 similar comment
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

Resolved pre-commit issues

Removed loggers

Added TLS capabilities to minio route and handled 503 error

Added new example to test minio healthcheck with enableExternalRoute as true

Fix Pre-commit errors

Updated error message

Updated Error message

Updated as per comments

Fixed test case issue

Fix error statement

Removed excess spaces
@dsp-developers
Copy link
Contributor

Change to PR detected. A new PR build was completed.
A new image has been built to help with testing out this PR: quay.io/opendatahub/data-science-pipelines-operator:pr-519

@@ -0,0 +1,26 @@
apiVersion: datasciencepipelinesapplications.opendatahub.io/v1alpha1
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

please put this in the v2 directory, you will need to rebase:
https://github.com/opendatahub-io/data-science-pipelines-operator/tree/main/config/samples/v2

Comment on lines +405 to +408
p.ObjectStorageConnection.ExternalRouteURL = route.Spec.Host
p.ObjectStorageConnection.Endpoint = route.Spec.Host
p.ObjectStorageConnection.Secure = util.BoolPointer(true)
p.ObjectStorageConnection.Host = route.Spec.Host
Copy link
Contributor

@HumairAK HumairAK Feb 9, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

accessing route. here looks like it's prone to error because it hasn't been created yet, have you looked into just constructing the route host? it's always the same format:

https://${route_name}-${namespace}.${api-server-hostname}

route_name/namespace you already know, just check if we can easily figure out the api-server hostname, then you don't need to do a get for a route here

@HumairAK
Copy link
Contributor

HumairAK commented Feb 9, 2024

the comment above is not a big issue as this is mostly intended for development purposes (minio usecase)

it's questionable to have the enableExternalRoute not be within minio in this case, but that might be something we can fix at a later date.

@HumairAK HumairAK merged commit 0df6ce3 into opendatahub-io:main Feb 9, 2024
5 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants