-
Notifications
You must be signed in to change notification settings - Fork 339
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
feat(build): idempotent builds #5291
feat(build): idempotent builds #5291
Conversation
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
…dencies Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
c1d77f9
to
e151dde
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I have few suggestions
Note to self: |
I've run come commands on my mbp (intel), here are the results: # master
gtime -q -f "%e" make images
# 192.04
# 70.12
gtime -q -f "%e" make -j test/e2e/debug-fast K3D=true E2E_PKG_LIST=./test/e2e/ownership/...
# 255.82
# 261.80
# feat/make-local-builds-idempotent
gtime -q -f "%e" make images
# 131.41
# 35.25
gtime -q -f "%e" make -j test/e2e/debug-fast K3D=true E2E_PKG_LIST=./test/e2e/ownership/...
# 268.30
# 207.96 |
☝️ one note to this, running |
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
few nits, but lgtm overall
Co-authored-by: Bart Smykla <bartek@smykla.com> Signed-off-by: Krzysztof Słonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka <slonka@users.noreply.github.com>
I had to remove the "touch -mt" hack to cache the context sent do docker because it was caching too much. |
Signed-off-by: slonka <slonka@users.noreply.github.com>
Signed-off-by: slonka slonka@users.noreply.github.com
Closes #5270
EDIT:
To be more precise what I don't like about this PR:
I had a chat with Bart and we decided that we can always iterate on this.
Old notes:
Not sure what happened (maybe docker update or something on my mac) but the image build times from the issue are a lot faster when I tested them today. Anyway with this PR I managed to cut down
make images
time from ~35 seconds to ~20 seconds on my machine and even a bigger improvement ~115 seconds to ~85 seconds when running an example e2e test (gtime -q -f "%e" make -j test/e2e/debug-fast K3D=true E2E_PKG_LIST=./test/e2e/deploy/...
).Overall I'm not super happy with this change, there are a couple of hacks here, with your help I hope we can make it better.
Checklist prior to review
syscall.Mkfifo
have equivalent implementation on the other OS --UPGRADE.md
? --> Changelog:
entry here or add aci/
label to run fewer/more tests?