Skip to content

[DNM] Use zstd layers #3313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
+5 −5
Open

[DNM] Use zstd layers #3313

Changes from all commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
d983284
Use zstd layers for registry
mitchdz Aug 7, 2025
7931a92
Merge remote-tracking branch 'origin/main' into use-zstd-layers
mitchdz Aug 7, 2025
373f608
Merge branch 'main' into use-zstd-layers
mitchdz Aug 7, 2025
f8df2bd
Merge branch 'main' into use-zstd-layers
mitchdz Aug 7, 2025
d6d3c0c
Merge branch 'main' into use-zstd-layers
mitchdz Aug 7, 2025
2592eb6
Merge remote-tracking branch 'origin/main' into use-zstd-layers
mitchdz Aug 8, 2025
ddafcd2
Merge branch 'main' into use-zstd-layers
mitchdz Aug 14, 2025
40e4a84
Merge branch 'main' into use-zstd-layers
mitchdz Aug 15, 2025
633c1d2
Merge branch 'main' into use-zstd-layers
mitchdz Aug 18, 2025
5673062
Merge branch 'main' into use-zstd-layers
mitchdz Sep 28, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions .github/workflows/dev_environment.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -260,15 +260,15 @@ jobs:

if ${{ inputs.update_registry_cache != '' }}; then
registry_cache_target=$(echo ${{ inputs.update_registry_cache }} | tr / -)
build_cache="type=registry,ref=${registry_cache}-${cache_id}-${platform_id}:$registry_cache_target"
build_cache="type=registry,compression=zstd,force-compression=true,oci-mediatypes=true,compression-level=15,ref=${registry_cache}-${cache_id}-${platform_id}:$registry_cache_target"
cache_to="${build_cache},mode=max,ignore-error=false"
elif ${{ inputs.create_local_cache }}; then
# In general, using the build cache from the registry/parent branch is the quickest.
# We hence create a build cache only upon request.
build_cache="${local_buildcache_key}"
cache_to="type=local,dest=${local_buildcache_path}-new,mode=max,ignore-error=true"
else
build_cache="type=registry,ref=${registry_cache}-${cache_id}-${platform_id}:$registry_cache_base"
build_cache="type=registry,compression=zstd,force-compression=true,oci-mediatypes=true,compression-level=15,ref=${registry_cache}-${cache_id}-${platform_id}:$registry_cache_base"
fi

# Registry caches pull from a separate cache for each platform
Expand All @@ -284,10 +284,10 @@ jobs:
echo 'cache_from_registry<<multiline'
for platform_id in $platform_ids; do
if ${{ needs.metadata.outputs.pr_number != '' }}; then
echo "type=registry,ref=${registry_cache}-${cache_id}-${platform_id}:pull-request-${{ needs.metadata.outputs.pr_number }}"
echo "type=registry,compression=zstd,force-compression=true,oci-mediatypes=true,compression-level=15,ref=${registry_cache}-${cache_id}-${platform_id}:pull-request-${{ needs.metadata.outputs.pr_number }}"
fi
echo "type=registry,ref=${registry_cache}-${cache_id}-${platform_id}:${registry_cache_base}"
echo "type=registry,ref=${nvidia_registry_cache}-${cache_id}-${platform_id}:${registry_cache_base}"
echo "type=registry,compression=zstd,force-compression=true,oci-mediatypes=true,compression-level=15,ref=${registry_cache}-${cache_id}-${platform_id}:${registry_cache_base}"
echo "type=registry,compression=zstd,force-compression=true,oci-mediatypes=true,compression-level=15,ref=${nvidia_registry_cache}-${cache_id}-${platform_id}:${registry_cache_base}"
done
echo multiline
} >> $GITHUB_OUTPUT
Expand Down
Loading