Skip to content

Commit

Permalink
add: nim operator
Browse files Browse the repository at this point in the history
  • Loading branch information
codekow committed Jan 29, 2025
1 parent 8d0932c commit fee2c14
Show file tree
Hide file tree
Showing 6 changed files with 69 additions and 0 deletions.
7 changes: 7 additions & 0 deletions components/operators/nim-operator-certified/INFO.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# nim-operator-certified

## About this Operator
The NVIDIA NIM Operator is a Kubernetes operator designed to facilitate the deployment, management, and scaling of NVIDIA NeMo (Neural Modules) services on Kubernetes clusters. NeMo is a toolkit for building, training, and fine-tuning state-of-the-art deep learning models for a variety of applications, including speech recognition, natural language processing (NLP), and text-to-speech synthesis. The NeMo Operator streamlines the integration of these powerful AI capabilities into cloud-native environments such as Kubernetes, leveraging NVIDIA GPUs.

## Prerequisites for enabling this Operator
* Install NVIDIA GPU Operator * Install CSI Driver or Local Path Provisioner * Create necessary ImagePullSecret and NGC Auth Secrets
32 changes: 32 additions & 0 deletions components/operators/nim-operator-certified/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
# The NVIDIA NIM Operator for Kubernetes

Install The NVIDIA NIM Operator for Kubernetes.

Do not use the `base` directory directly, as you will need to patch the `channel` based on the version of OpenShift you are using, or the version of the operator you want to use.

The current *overlays* available are for the following channels:

* [stable](operator/overlays/stable)

## Usage

If you have cloned the `gitops-catalog` repository, you can install The NVIDIA NIM Operator for Kubernetes based on the overlay of your choice by running from the root (`gitops-catalog`) directory.

```sh
oc apply -k nim-operator-certified/operator/overlays/<channel>
```

Or, without cloning:

```sh
oc apply -k https://github.com/redhat-cop/gitops-catalog/nim-operator-certified/operator/overlays/<channel>
```

As part of a different overlay in your own GitOps repo:

```yaml
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization
resources:
- https://github.com/redhat-cop/gitops-catalog/nim-operator-certified/operator/overlays/<channel>?ref=main
```
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

resources:
- subscription.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
apiVersion: operators.coreos.com/v1alpha1
kind: Subscription
metadata:
name: nim-operator-certified
namespace: openshift-operators
spec:
channel: patch-me-see-overlays-dir
installPlanApproval: Automatic
name: nim-operator-certified
source: certified-operators
sourceNamespace: openshift-marketplace
Original file line number Diff line number Diff line change
@@ -0,0 +1,11 @@
apiVersion: kustomize.config.k8s.io/v1beta1
kind: Kustomization

resources:
- ../../base

patches:
- target:
kind: Subscription
name: nim-operator-certified
path: patch-channel.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
- op: replace
path: /spec/channel
value: stable

0 comments on commit fee2c14

Please sign in to comment.