[skip-ci] TMT: system tests

[lsm5]

This commit adds TMT jobs for system tests triggered via Packit for all active Fedora and CentOS Stream releases on x86_64.

TODO: enable aarch64 tests.

Official Fedora and CentOS Stream spec and gating test configs can be synced from upstream by Packit, effectively upstreaming almost all mainteenance.

What type of PR is this?

/kind other

What this PR does / why we need it:

Runs system tests using TMT. This test setup can be reused for official Fedora and CentOS-Stream packages as well as reused for upstream reverse dependency testing in c/common.

How to verify it

TMT tests in CI list.

Which issue(s) this PR fixes:

Special notes for your reviewer:

None

Does this PR introduce a user-facing change?

None

[packit-as-a-service]

Failed to load packit config file:

Cannot parse package config. ValidationError({'jobs[4].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[5].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[6].packages': 'Undefined package(s) referenced: podman-centos.', 'jobs[7].packages': 'Undefined package(s) referenced: podman-centos.'})

For more info, please check out the documentation or contact the Packit team. You can also use our CLI command validate-config or our pre-commit hooks for validation of the configuration.

[packit-as-a-service]

Failed to load packit config file:

Cannot parse package config. ValidationError({'jobs[4].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[5].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[6].packages': 'Undefined package(s) referenced: podman-centos.', 'jobs[7].packages': 'Undefined package(s) referenced: podman-centos.'})

For more info, please check out the documentation or contact the Packit team. You can also use our CLI command validate-config or our pre-commit hooks for validation of the configuration.

[packit-as-a-service]

Failed to load packit config file:

Cannot parse package config. ValidationError({'jobs[4].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[5].packages': 'Undefined package(s) referenced: podman-fedora.', 'jobs[6].packages': 'Undefined package(s) referenced: podman-centos.', 'jobs[7].packages': 'Undefined package(s) referenced: podman-centos.'})

For more info, please check out the documentation or contact the Packit team. You can also use our CLI command validate-config or our pre-commit hooks for validation of the configuration.

[lsm5]

/packit retest

[lsm5]

/packit test

[lsm5]

@flouthoc @nalind we're not testing on aarch64 yet are we?

some of the testing-farm-*-aarch64 tests added in this PR are failing on linux/arm64 vs linux/amd64 and some cases are warning on it and failing like so:

# # /usr/bin/buildah commit --signature-policy /usr/share/buildah/test/system/policy.json time="2025-02-04T13:50:22Z" level=warning msg="image platform (linux/amd64) does not match the expected platform (linux/arm64)" testdigest_v2s2-working-container new-image
# Error: too many arguments specified
# [ rc=125 (** EXPECTED 0 **) ]

[nalind]

@flouthoc @nalind we're not testing on aarch64 yet are we?

some of the testing-farm-*-aarch64 tests added in this PR are failing on linux/arm64 vs linux/amd64 and some cases are warning on it and failing like so:

# # /usr/bin/buildah commit --signature-policy /usr/share/buildah/test/system/policy.json time="2025-02-04T13:50:22Z" level=warning msg="image platform (linux/amd64) does not match the expected platform (linux/arm64)" testdigest_v2s2-working-container new-image
# Error: too many arguments specified
# [ rc=125 (** EXPECTED 0 **) ]

We're not testing on aarch64 - this looks like a previous line in the test that wanted to capture the ID of a newly-created working container captured the whole line time="2025-02-04T13:50:22Z" level=warning msg="image platform (linux/amd64) does not match the expected platform (linux/arm64)" as its name.

[nalind]

Oh, I guess the testing farm is testing natively on non-amd64. Nice!

[packit-as-a-service]

Ephemeral COPR build failed. @containers/packit-build please check.

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: flouthoc, lsm5

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [lsm5]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[flouthoc]

/hold

[flouthoc]

@nalind PTAL

[lsm5]

@nalind PTAL

[nalind]

I don't love that this scatters files throughout our tree, but it's probably too late to enforce that for every out-of-tree integration.
/lgtm

[lsm5]

/packit build
/packit test

[lsm5]

Needed a rebase .

@nalind PTAL . Thanks.

[nalind]

/lgtm

[lsm5]

Looks like this PR gets outdated by the time it gets a slash-lgtm so merges are blocked 😄 . I'll rebase it once again.

[nalind]

/lgtm

[lsm5]

/hold cancel

Thanks @nalind