Skip to content
This repository has been archived by the owner on Nov 15, 2023. It is now read-only.

.maintain/monitoring: Add alert when continuous task ends #7250

Merged
2 commits merged into from
Oct 5, 2020
Merged

.maintain/monitoring: Add alert when continuous task ends #7250

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
e96710b
.maintain/monitoring: Add alert when continuous task ends
mxinden Oct 2, 2020
d7ff86b
.maintain/monitoring: Don't hard-code task names
mxinden Oct 2, 2020
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 10 additions & 0 deletions .maintain/monitoring/alerting-rules/alerting-rules.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -126,6 +126,16 @@ groups:
# Others
##############################################################################

- alert: ContinuousTaskEnded
expr: '(polkadot_tasks_spawned_total == 1) - on(instance, task_name)
(polkadot_tasks_ended_total == 1)'
for: 5m
labels:
severity: warning
annotations:
message: 'Continuous task {{ $labels.task_name }} on node
{{ $labels.instance }} ended unexpectedly.'

- alert: AuthorityDiscoveryDiscoveryFailureHigh
expr: 'polkadot_authority_discovery_handle_value_found_event_failure /
ignoring(name)
Expand Down