Skip to content

Preflight GPU Tests #110

Preflight GPU Tests

Preflight GPU Tests #110

Triggered via schedule September 24, 2024 00:48
Status Failure
Total duration 18m 40s
Artifacts 1

preflight_gpu.yml

on: schedule
Matrix: preflight-gpu-tests
Fit to window
Zoom out
Zoom in

Annotations

24 errors and 46 warnings
flyctl error
error creating a new machine: failed to launch VM: insufficient resources to create new machine with existing volume 'vol_49k2ze6ll359em6v' (Request ID: 01J8GRH9J0KDQ889HR8HCE4FBB-lax)
preflight-gpu-tests (a100-40gb, 20, 9)
Process completed with exit code 1.
preflight-gpu-tests (a100-40gb, 20, 5)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 0)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 14)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (a100-40gb, 20, 4)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 4)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎The machine 908065d2c06e28 took more than 5m0s to reach "started"
preflight-gpu-tests (l40s, 20, 12)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 5)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 1)
Process completed with exit code 1.
preflight-gpu-tests (a100-40gb, 20, 6)
Process completed with exit code 1.
flyctl error
release command failed - aborting deployment. error finding the release_command machine 90806493f13508 exit event: timeout reached waiting for health checks to pass for machine 90806493f13508: failed to get VM 90806493f13508: Get "https://api.machines.dev/v1/apps/preflight-pf-gpu-gha-2089f70e-2024-09-kt476wiz/machines/90806493f13508": net/http: request canceled
preflight-gpu-tests (l40s, 20, 8)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 13)
Process completed with exit code 1.
flyctl error
timeout reached waiting for machine's state to change⏎Your machine was created, but never started. This could mean that your app is taking a long time to start,⏎but it could be indicative of a region issue.
preflight-gpu-tests (l40s, 20, 2)
Process completed with exit code 1.
build
You are using 'latest' as default version. Will lock to '~> v1'.
build
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 17)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 15)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 10)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 16)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 16)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 18)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 17)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 18)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 10)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 0)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 3)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 3)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 14)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 9)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 19)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 9)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 11)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 11)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 12)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 6)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 7)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 7)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 5)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 19)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 8)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 13)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 1)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 15)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (a100-40gb, 20, 15)
Back off 16.889 seconds before retry.
preflight-gpu-tests (a100-40gb, 20, 15)
Failed to download action 'https://api.github.com/repos/actions/setup-go/tarball/0a12ed9d6a96ab950c8f026ed9f722fe0da7ef32'. Error: The request was canceled due to the configured HttpClient.Timeout of 100 seconds elapsing.
preflight-gpu-tests (a100-40gb, 20, 15)
Back off 13.229 seconds before retry.
preflight-gpu-tests (a100-40gb, 20, 15)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 2)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 0)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 14)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 4)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 4)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 12)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 5)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 1)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (a100-40gb, 20, 6)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 8)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 13)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2
preflight-gpu-tests (l40s, 20, 2)
Failed to restore: "/usr/bin/tar" failed with error: The process '/usr/bin/tar' failed with exit code 2

Artifacts

Produced during runtime
Name Size
flyctl
37 MB