Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GCP] Add support for the Dynamic Workload Scheduler (GCE) #3414

Closed
colinjc opened this issue Apr 3, 2024 · 2 comments
Closed

[GCP] Add support for the Dynamic Workload Scheduler (GCE) #3414

colinjc opened this issue Apr 3, 2024 · 2 comments
Assignees

Comments

@colinjc
Copy link
Contributor

colinjc commented Apr 3, 2024

GCP recently made the dynamic workload scheduler feature available in public preview. This system works by letting you submit a request to get N number of GPU VMs and puts you in a queue to get them, only provisioning once all are ready. This increases the ability of users to get rare GPUs without needing reservations. It also decreases costs compared to grabbing 1 vm at a time until all are available.

It would be useful if when SkyPilot was provisioning GPU instances on GCE it created them through this system instead of standard node provisioning APIs.

Announcement - https://cloud.google.com/blog/products/compute/introducing-dynamic-workload-scheduler
GCE API - https://cloud.google.com/compute/docs/instance-groups/about-resize-requests-mig

@asaiacai
Copy link
Contributor

asaiacai commented Apr 4, 2024

I'd like to take this if possible. I'm trying to figure out where skypilot would fit in with Kueue currently :) I think this goes back to a discussion that was on the slack on how to make a batch job interface for k8s that treats Tasks/Jobs as first class objects instead of clusters.

@colinjc colinjc changed the title [GCP] Add support for the Dynamic Workload Scheduler [GCP] Add support for the Dynamic Workload Scheduler (GCE) Apr 4, 2024
@romilbhardwaj
Copy link
Collaborator

Closed with #3574.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants