Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Configure pipeline-migration-tool run for tekton manager #135

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

tkdchen
Copy link

@tkdchen tkdchen commented Jan 9, 2025

STONEBLD-2824

Executable script pipeline-migration-tool is available from the Mintmaker image.

This change works with konflux-ci/mintmaker-renovate-image#85 together.

@gnaponie
Copy link
Contributor

Gotcha. So I'm fine with this as change as it is +1

FernandesMF
FernandesMF previously approved these changes Jan 10, 2025
Copy link
Contributor

@FernandesMF FernandesMF left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me as well!
Edit: the point Riley brought up is very important, and it hadn't occurred to me before.

@qixiang
Copy link
Contributor

qixiang commented Jan 13, 2025

/retest

re-trigger the test to check if the old buildah task can pass EC checks.

@FernandesMF FernandesMF dismissed their stale review January 14, 2025 19:06

The point that Riley brought up is very important.

@tkdchen tkdchen marked this pull request as draft January 15, 2025 03:09
@tkdchen tkdchen force-pushed the STONEBLD-2824-configure-pmt branch from 8c43a26 to 9ea6c4d Compare January 15, 2025 03:10
@tkdchen tkdchen marked this pull request as ready for review January 20, 2025 10:05
@tkdchen
Copy link
Author

tkdchen commented Jan 20, 2025

Hi team, the issue has been addressed. PTAL.

@staticf0x
Copy link
Contributor

This doesn't unfortunately work, because the {{{ toJSON upgrades }}} contains apostrophes and produces

Command failed: pipeline-migration-tool --renovate-upgrades ' ...
/bin/sh: -c: line 1: syntax error near unexpected token `('
...

would it be possible to escape the apostrophes or use encodeBase64 and modify the pipeline-migration-tool?

@tkdchen
Copy link
Author

tkdchen commented Jan 20, 2025

This doesn't unfortunately work, because the {{{ toJSON upgrades }}} contains apostrophes and produces

Command failed: pipeline-migration-tool --renovate-upgrades ' ...
/bin/sh: -c: line 1: syntax error near unexpected token `('
...

would it be possible to escape the apostrophes or use encodeBase64 and modify the pipeline-migration-tool?

@staticf0x How did you run the Mintmaker and get this failure? I haven't seen it happened during my test that uses a Mintmaker image with this command.

@staticf0x
Copy link
Contributor

Have you used the MintMaker default config? https://github.com/konflux-ci/mintmaker/blob/main/config/renovate/renovate.json it's loaded on server side and used as RENOVATE_CONFIG_FILE. It contains apostrophes in https://github.com/konflux-ci/mintmaker/blob/main/config/renovate/renovate.json#L92

@tkdchen
Copy link
Author

tkdchen commented Jan 21, 2025

Have you used the MintMaker default config? https://github.com/konflux-ci/mintmaker/blob/main/config/renovate/renovate.json it's loaded on server side and used as RENOVATE_CONFIG_FILE. It contains apostrophes in https://github.com/konflux-ci/mintmaker/blob/main/config/renovate/renovate.json#L92

Yes. I've been using my topic branch https://github.com/tkdchen/mintmaker/commits/test-STONEBLD-2824-configure-pmt/ that is based on the changes within this PR.

@tkdchen tkdchen force-pushed the STONEBLD-2824-configure-pmt branch 2 times, most recently from c2732e2 to d5a928f Compare January 22, 2025 08:12
@tkdchen tkdchen requested a review from staticf0x January 22, 2025 08:13
@tkdchen
Copy link
Author

tkdchen commented Jan 22, 2025

@staticf0x PTAL

Copy link
Contributor

@staticf0x staticf0x left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

With these commas it works for me

@staticf0x
Copy link
Contributor

@tkdchen do you have any performance measurements of the pipeline-migration-tool? In my test, I had 14 upgrades, which resulted in 255 calls to fetch_migration_file, and the total run time was 7 - 9 minutes on my machine (most of it is network bound). This can be a huge issue for MintMaker, all Tekton upgrades happen on Saturday after 5 AM UTC and we have ~1000 repos to run on, unfortunately without any way to cache the results between repos.

STONEBLD-2824

Executable script pipeline-migration-tool is available from the
Mintmaker image.
@tkdchen tkdchen force-pushed the STONEBLD-2824-configure-pmt branch from d5a928f to 45ae3f5 Compare January 23, 2025 06:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants