Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make BMO e2e prow job required #621

Merged
merged 1 commit into from
Jan 19, 2024

Conversation

lentzi90
Copy link
Member

This removes the required status context for BMO e2e tests and instead makes the prow job required.

It also removes the report template because this is already covered by the report template set for plank. This config is currently causing double messages when a job fails (one for jenkins and one for plank).

One thing to discuss, test and decide is how to handle these required jobs.
Other required jobs that we have run automatically when needed. The e2e jobs have traditionally been manually triggered only to save some resources. I'm not sure if a required but not automatically run job will show up in the status contexts. If not, we have to decide if we

  1. Add required status contexts back for them, or
  2. Run the jobs automatically. If we choose this we can also use config like "skip if only" to not run it on all PRs, which would be quite nice!

@metal3-io-bot metal3-io-bot added the size/S Denotes a PR that changes 10-29 lines, ignoring generated files. label Jan 18, 2024
@lentzi90 lentzi90 force-pushed the lentzi90/bmo-e2e-status-checks branch from 421c765 to ad4c017 Compare January 18, 2024 12:41
This removes the required status context for BMO e2e tests and instead
makes the prow job required. It also adds another optional job.

It also removes the report template because this is already covered by
the report template set for plank. This config is currently causing
double messages when a job fails (one for jenkins and one for plank).

Signed-off-by: Lennart Jern <lennart.jern@est.tech>
@lentzi90 lentzi90 force-pushed the lentzi90/bmo-e2e-status-checks branch from ad4c017 to 916720c Compare January 19, 2024 06:57
@@ -542,7 +533,15 @@ presubmits:
agent: jenkins
# Don't run unless triggered to avoid wasting resources
always_run: false
# Until we have checked that it works, keep it optional
optional: false
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What do you think? Should we trigger it automatically instead but have

skip_if_only_changed: '(((^|/)OWNERS)|(\.md))$'

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is the way to go. We've spent quite a lot of time developing the e2e test to make BMO testing more standalone, and its rather fast and stable test, so why wouldn't we want to run it?

Copy link
Member

@Rozzii Rozzii left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

@lentzi90
Copy link
Member Author

/hold
@Rozzii what do you think about changing it to use skip_if_only_changed?

@metal3-io-bot metal3-io-bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jan 19, 2024
Copy link
Member

@tuminoid tuminoid left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/approve

@metal3-io-bot
Copy link
Collaborator

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: Rozzii, tuminoid

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@metal3-io-bot metal3-io-bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Jan 19, 2024
@Rozzii
Copy link
Member

Rozzii commented Jan 19, 2024

/hold @Rozzii what do you think about changing it to use skip_if_only_changed?

If the regexp works and it correctly skips the md and the OWNER files then I am fine with it.

@Rozzii
Copy link
Member

Rozzii commented Jan 19, 2024

/lgtm

@metal3-io-bot metal3-io-bot added the lgtm Indicates that a PR is ready to be merged. label Jan 19, 2024
@Rozzii
Copy link
Member

Rozzii commented Jan 19, 2024

/test-ubuntu-integration-main

@lentzi90
Copy link
Member Author

After offline discussion, I think we can keep the old behavior of manual trigger but required job.
After merging this I will check if we need the required status check or not and do a follow up PR if needed.
/hold cancel

@metal3-io-bot metal3-io-bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Jan 19, 2024
@metal3-io-bot metal3-io-bot merged commit 7510e4d into metal3-io:main Jan 19, 2024
5 checks passed
@metal3-io-bot
Copy link
Collaborator

@lentzi90: Updated the config configmap in namespace prow at cluster default using the following files:

  • key config.yaml using file prow/manifests/overlays/metal3/config.yaml

In response to this:

This removes the required status context for BMO e2e tests and instead makes the prow job required.

It also removes the report template because this is already covered by the report template set for plank. This config is currently causing double messages when a job fails (one for jenkins and one for plank).

One thing to discuss, test and decide is how to handle these required jobs.
Other required jobs that we have run automatically when needed. The e2e jobs have traditionally been manually triggered only to save some resources. I'm not sure if a required but not automatically run job will show up in the status contexts. If not, we have to decide if we

  1. Add required status contexts back for them, or
  2. Run the jobs automatically. If we choose this we can also use config like "skip if only" to not run it on all PRs, which would be quite nice!

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Sunnatillo Sunnatillo deleted the lentzi90/bmo-e2e-status-checks branch January 19, 2024 10:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants