Update backfill job, and setup a cronjob in prod

[severo]

No description provided.

[github-actions]

ArgoCD Diff for commit a705381

Updated at 4/26/2023, 12:09:32 PM CEST

App: datasets-server-prod
YAML generation: Success 🟢
App sync status: Synced ✅

===== batch/CronJob datasets-server/prod-datasets-server-job-backfill ======
--- /tmp/argocd-diff2569919997/prod-datasets-server-job-backfill-live.yaml	2023-04-26 10:09:31.991077823 +0000
+++ /tmp/argocd-diff2569919997/prod-datasets-server-job-backfill	2023-04-26 10:09:31.991077823 +0000
@@ -0,0 +1,77 @@
+apiVersion: batch/v1
+kind: CronJob
+metadata:
+  labels:
+    app.kubernetes.io/component: prod-datasets-server-backfill
+    app.kubernetes.io/instance: prod
+    app.kubernetes.io/managed-by: Helm
+    app.kubernetes.io/name: prod-datasets-server
+    argocd.argoproj.io/instance: datasets-server-prod
+    helm.sh/chart: datasets-server
+  name: prod-datasets-server-job-backfill
+  namespace: datasets-server
+spec:
+  jobTemplate:
+    spec:
+      template:
+        spec:
+          containers:
+          - env:
+            - name: LOG_LEVEL
+              value: INFO
+            - name: CACHE_MONGO_DATABASE
+              value: datasets_server_cache
+            - name: CACHE_MONGO_URL
+              valueFrom:
+                secretKeyRef:
+                  key: MONGO_URL
+                  name: mongo-url
+                  optional: false
+            - name: QUEUE_MONGO_DATABASE
+              value: datasets_server_queue
+            - name: QUEUE_MONGO_URL
+              valueFrom:
+                secretKeyRef:
+                  key: MONGO_URL
+                  name: mongo-url
+                  optional: false
+            - name: COMMON_HF_ENDPOINT
+              value: https://huggingface.co
+            - name: HF_ENDPOINT
+              value: https://huggingface.co
+            - name: COMMON_HF_TOKEN
+              valueFrom:
+                secretKeyRef:
+                  key: HF_TOKEN
+                  name: hf-token
+                  optional: false
+            - name: METRICS_MONGO_DATABASE
+              value: datasets_server_metrics
+            - name: METRICS_MONGO_URL
+              valueFrom:
+                secretKeyRef:
+                  key: MONGO_URL
+                  name: mongo-url
+                  optional: false
+            - name: CACHE_MAINTENANCE_ACTION
+              value: backfill
+            image: huggingface/datasets-server-jobs-cache_maintenance:sha-bdda4ed
+            imagePullPolicy: IfNotPresent
+            name: prod-datasets-server-backfill
+            resources:
+              limits:
+                cpu: 1
+                memory: 512Mi
+              requests:
+                cpu: 1
+            securityContext:
+              allowPrivilegeEscalation: false
+          nodeSelector: {}
+          restartPolicy: OnFailure
+          securityContext:
+            runAsGroup: 3000
+            runAsNonRoot: true
+            runAsUser: 1000
+          tolerations: []
+      ttlSecondsAfterFinished: 3600
+  schedule: 0 * * * *

---

Legend	Status
✅	The app is synced in ArgoCD, and diffs you see are solely from this PR.
⚠️	The app is out-of-sync in ArgoCD, and the diffs you see include those changes plus any from this PR.
🛑	There was an error generating the ArgoCD diffs due to changes in this PR.

[HuggingFaceDocBuilder]

The documentation is not available anymore as the PR was closed or merged.

[AndreaFrancis]

backfill/upgrade look better now, thanks!