fix(csi): prevent race condition in ci tests step

[Al-Pragliola]

Description

fixes a race condition found in the ci CSI tests: https://github.com/opendatahub-io/model-registry/actions/runs/10997757515/job/30534062040#logs

How Has This Been Tested?

run the ci

Merge criteria:

• All the commits have been signed-off (To pass the DCO check)

• The commits have meaningful messages; the author will squash them after approval or in case of manual merges will ask to merge with squash.
• Testing instructions have been added in the PR body (for PRs involving changes that are not immediately obvious).
• The developer has manually tested the changes and verified that the changes work.
• Code changes follow the kubeflow contribution guidelines.

[Al-Pragliola]

cc @lampajr

[tarilabs]

thank you @Al-Pragliola this is great and cc @lampajr for awareness and in case this "pattern" of the sleep is used in other places?

/lgtm

[lampajr]

Thanks a lot @Al-Pragliola, it looks great to me!!!

@tarilabs the only other place where we could use the same approach is here

model-registry/csi/test/e2e_test.sh

Lines 171 to 175 in e0598fd

	sleep 5
	SERVICE_HOSTNAME=$(kubectl get inferenceservice sklearn-iris -n $KSERVE_TEST_NAMESPACE -o jsonpath='{.status.url}' | cut -d "/" -f 3)
	res=$(curl -s -H "Host: ${SERVICE_HOSTNAME}" -H "Content-Type: application/json" "http://${INGRESS_HOST}/v1/models/sklearn-iris:predict" -d @/tmp/iris-input.json)
	echo "Received: $res"

iirc I introduced the 5s sleep because sometimes the res was not populated.. but I don't rembember if it was failing in retrieving SERVICE_HOSTNAME or the res directly. So I think this could be done as a follow-up PR if needed.

[lampajr]

Awesome, thanks @Al-Pragliola !

/lgtm
/approve

[tarilabs]

• fix(csi): prevent race condition in ci tests step #426 (review)
• fix(csi): prevent race condition in ci tests step #426 (comment)
• fix(csi): prevent race condition in ci tests step #426 (review)

/lgtm
/approve

and many thanks again @Al-Pragliola

[google-oss-prow]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: lampajr, tarilabs

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [tarilabs]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment