Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update long running test workflow to verify manifests are registered #8298

Merged

Conversation

lakshmimsft
Copy link
Contributor

Description

Apply same verification check as was done for cloud and non-cloud tests to check for registered manifests in long running test workflow.

Type of change

  • This pull request is a minor refactor, code cleanup, test improvement, or other maintenance task and doesn't change the functionality of Radius (issue link optional).

Contributor checklist

Please verify that the PR meets the following requirements, where applicable:

  • An overview of proposed schema changes is included in a linked GitHub issue.
    • Yes
    • Not applicable
  • A design document PR is created in the design-notes repository, if new APIs are being introduced.
    • Yes
    • Not applicable
  • The design document has been reviewed and approved by Radius maintainers/approvers.
    • Yes
    • Not applicable
  • A PR for the samples repository is created, if existing samples are affected by the changes in this PR.
    • Yes
    • Not applicable
  • A PR for the documentation repository is created, if the changes in this PR affect the documentation or any user facing updates are made.
    • Yes
    • Not applicable
  • A PR for the recipes repository is created, if existing recipes are affected by the changes in this PR.
    • Yes
    • Not applicable

@radius-functional-tests
Copy link

radius-functional-tests bot commented Jan 24, 2025

Radius functional test overview

🔍 Go to test action run

Name Value
Repository lakshmimsft/radius-mainfork
Commit ref c32ff8b
Unique ID func906435a881
Image tag pr-func906435a881
Click here to see the list of tools in the current test run
  • gotestsum 1.12.0
  • KinD: v0.20.0
  • Dapr:
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.3.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-func906435a881
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-func906435a881
  • dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-func906435a881
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-func906435a881
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-func906435a881
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

Signed-off-by: lakshmimsft <ljavadekar@microsoft.com>
@lakshmimsft lakshmimsft force-pushed the lakshmimsft/updlongruntestwrkflow branch from c32ff8b to d7e2165 Compare January 24, 2025 18:24
@@ -404,6 +404,50 @@ jobs:
rad install kubernetes --reinstall \
--chart ${{ env.RADIUS_CHART_LOCATION }} \
--set rp.image=${{ env.CONTAINER_REGISTRY }}/applications-rp,rp.tag=${{ env.REL_VERSION }},dynamicrp.image=${{ env.CONTAINER_REGISTRY }}/dynamic-rp,dynamicrp.tag=${{ env.REL_VERSION }},controller.image=${{ env.CONTAINER_REGISTRY }}/controller,controller.tag=${{ env.REL_VERSION }},ucp.image=${{ env.CONTAINER_REGISTRY }}/ucpd,ucp.tag=${{ env.REL_VERSION }}

echo "*** Verify manifests are registered ***"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What I am trying to understand is why we need this step. I will try to explain below:

If this is the case why do we need to check all the logs of UCP to see if there is an error with the initializer. We are specifically looking for this error: "Service initializer terminated with error". If that is the case, that should mean that one of the services that UCP depends on was terminated. That should trigger the termination of UCP.

Please help me understand why this wouldn't make the UCP pod fail when doing the rad install.

  • rad install is run
  • if one of the services of UCP fails, then UCP will fail to get to READY state

Is this wrong?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we running an extra command after initializing the initializer service?

Copy link
Contributor Author

@lakshmimsft lakshmimsft Jan 24, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The initializer service waits for UCP server to be up and calls apis to add data for the manifests.
wait for ucp:

err = waitForServer(ctx, hostName, port, 500*time.Millisecond, 500*time.Millisecond, 5*time.Second)

The pod up, ucp is receiving requests to add these manifests.
The error we're seeing is we're trying to add groups/resources as part of the test workflow before these manifests have completed registering.
Yes, If there is an error during registering, it will cause the UCP pod to fail.
no additional/extra command is being run.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I see. Thanks for explaining. The only feedback I have is that we should make this a separate step. Like Check Manifests. We can do this in a separate PR.

Copy link

codecov bot commented Jan 24, 2025

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 59.82%. Comparing base (7797bb0) to head (d7e2165).
Report is 2 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #8298   +/-   ##
=======================================
  Coverage   59.81%   59.82%           
=======================================
  Files         590      590           
  Lines       39513    39513           
=======================================
+ Hits        23636    23639    +3     
+ Misses      14116    14114    -2     
+ Partials     1761     1760    -1     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@kachawla
Copy link
Contributor

Sample tests are failing, does this need to be added to test samples workflow as well?

@radius-functional-tests
Copy link

radius-functional-tests bot commented Jan 24, 2025

Radius functional test overview

🔍 Go to test action run

Name Value
Repository lakshmimsft/radius-mainfork
Commit ref d7e2165
Unique ID funce33d4b3a88
Image tag pr-funce33d4b3a88
Click here to see the list of tools in the current test run
  • gotestsum 1.12.0
  • KinD: v0.20.0
  • Dapr:
  • Azure KeyVault CSI driver: 1.4.2
  • Azure Workload identity webhook: 1.3.0
  • Bicep recipe location ghcr.io/radius-project/dev/test/testrecipes/test-bicep-recipes/<name>:pr-funce33d4b3a88
  • Terraform recipe location http://tf-module-server.radius-test-tf-module-server.svc.cluster.local/<name>.zip (in cluster)
  • applications-rp test image location: ghcr.io/radius-project/dev/applications-rp:pr-funce33d4b3a88
  • dynamic-rp test image location: ghcr.io/radius-project/dev/dynamic-rp:pr-funce33d4b3a88
  • controller test image location: ghcr.io/radius-project/dev/controller:pr-funce33d4b3a88
  • ucp test image location: ghcr.io/radius-project/dev/ucpd:pr-funce33d4b3a88
  • deployment-engine test image location: ghcr.io/radius-project/deployment-engine:latest

Test Status

⌛ Building Radius and pushing container images for functional tests...
✅ Container images build succeeded
⌛ Publishing Bicep Recipes for functional tests...
✅ Recipe publishing succeeded
⌛ Starting ucp-cloud functional tests...
⌛ Starting corerp-cloud functional tests...
✅ ucp-cloud functional tests succeeded
✅ corerp-cloud functional tests succeeded

@lakshmimsft lakshmimsft merged commit 4c769e9 into radius-project:main Jan 24, 2025
29 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants