This repository has been archived by the owner on Jun 6, 2024. It is now read-only.

Use alert-manager to alert/kill low GPU efficiency job #4623

Open

2 tasks

hzy46 opened this issue Jun 15, 2020 · 0 comments

Open

2 tasks

Use alert-manager to alert/kill low GPU efficiency job #4623

hzy46 opened this issue Jun 15, 2020 · 0 comments

Labels

pai-dev

Contributor

hzy46 commented Jun 15, 2020

add vc information in prometheus: modify rest-server and job exporter
forward a alert manager webhook message to kill job: https://prometheus.io/docs/alerting/latest/configuration/#webhook_config

scarlett2018 mentioned this issue

2020 June~July Release #4575

Closed

47 tasks

scarlett2018 added the pai-dev label

Binyang2014 mentioned this issue

Notify user the abnormal jobs #4228

Closed

scarlett2018 mentioned this issue

2020 July ~ Aug Release #4642

Closed

39 tasks

This was referenced Sep 10, 2020

OpenPAI Backlog #4512

Open

2020 Sept ~ Oct release plan #4898

Closed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.