Skip to content

Commit

Permalink
change ray version and enable auto scaling (kubeflow#2821)
Browse files Browse the repository at this point in the history
* change ray version and enable auto scaling

Signed-off-by: hansinikarunarathne <107214435+hansinikarunarathne@users.noreply.github.com>

* fix a issue

Signed-off-by: hansinikarunarathne <107214435+hansinikarunarathne@users.noreply.github.com>

* Add autoscaler options to ray

Signed-off-by: hansinikarunarathne <107214435+hansinikarunarathne@users.noreply.github.com>

---------

Signed-off-by: hansinikarunarathne <107214435+hansinikarunarathne@users.noreply.github.com>
Signed-off-by: Patrick Schönthaler <patrick.schoenthaler@itsc.de>
  • Loading branch information
hansinikarunarathne authored and pschoen-itsc committed Sep 3, 2024
1 parent d219c18 commit 14b9086
Showing 1 changed file with 13 additions and 1 deletion.
14 changes: 13 additions & 1 deletion contrib/ray/raycluster_example.yaml
Original file line number Diff line number Diff line change
@@ -1,15 +1,27 @@
apiVersion: ray.io/v1alpha1
apiVersion: ray.io/v1
kind: RayCluster
metadata:
name: kubeflow-raycluster
spec:
rayVersion: '2.23.0'
# If `enableInTreeAutoscaling` is true, the Autoscaler sidecar will be added to the Ray head pod.
enableInTreeAutoscaling: true
# `autoscalerOptions` is an OPTIONAL field specifying configuration overrides for the Ray Autoscaler.
# The example configuration shown below below represents the DEFAULT values.
# (You may delete autoscalerOptions if the defaults are suitable.)
autoscalerOptions:
# Default: Upscaling is not rate-limited. This mode adds new worker pods to handle increased workload as quiclky as possible.
upscalingMode: Default
# `idleTimeoutSeconds` is the number of seconds to wait before scaling down a worker pod which is not using Ray resources.
idleTimeoutSeconds: 60
# Ray head pod configuration
headGroupSpec:
# Kubernetes Service Type.
serviceType: ClusterIP
# The following params are used to complete the ray start: ray start --head --block --dashboard-host: '0.0.0.0' ...
rayStartParams:
# Setting "num-cpus: 0" to avoid any Ray actors or tasks being scheduled on the Ray head Pod.
num-cpus: "0"
dashboard-host: '0.0.0.0'
block: 'true'
# pod template
Expand Down

0 comments on commit 14b9086

Please sign in to comment.