Skip to content

Latest commit

 

History

History
96 lines (68 loc) · 1.86 KB

installation.md

File metadata and controls

96 lines (68 loc) · 1.86 KB
Raw

Installation Guide

Prerequisites

  • Kubernetes version >= 1.27
  • Helm 3

Install a released version

Install

helm repo add inftyai https://inftyai.github.io/llmaz
helm repo update
helm install llmaz inftyai/llmaz --namespace llmaz-system --create-namespace --version 0.0.3

Uninstall

helm uninstall llmaz
kubectl delete ns llmaz-system

If you want to delete the CRDs as well, run

kubectl delete crd \
    openmodels.llmaz.io \
    backendruntimes.inference.llmaz.io \
    playgrounds.inference.llmaz.io \
    services.inference.llmaz.io

Install from source

Install

git clone https://github.com/inftyai/llmaz.git && cd llmaz
kubectl create ns llmaz-system && kubens llmaz-system
make helm-install

Uninstall

helm uninstall llmaz
kubectl delete ns llmaz-system

If you want to delete the CRDs as well, run

kubectl delete crd \
    openmodels.llmaz.io \
    backendruntimes.inference.llmaz.io \
    playgrounds.inference.llmaz.io \
    services.inference.llmaz.io

Install in a different namespace

If you want to install llmaz controller in a different namespace, you should change the values.global.yaml like this:

controllerManager:
  manager:
    args:
      - --namespace=<your-namespace>

Then run:

kubectl create ns <your-namespace> && kubens <your-namespace>
make helm-install

Change configurations

If you want to change the default configurations, such as Replicas, please change the values in values.global.yaml, then run

make helm-install

Do you change the values in values.yaml because it's auto-generated and will be overwritten.

Upgrade

Once you changed your code, run the command to upgrade the controller:

IMG=<image-registry>:<tag> make helm-upgrade