Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Improve event bus squad-based alerting #539

Open
rgraber opened this issue Jan 26, 2024 · 2 comments
Open

Improve event bus squad-based alerting #539

rgraber opened this issue Jan 26, 2024 · 2 comments

Comments

@rgraber
Copy link
Contributor

rgraber commented Jan 26, 2024 •
edited
Loading

We recently had an issue where a consumer stopped working but Phoenix was not alerted.
This is probably because right now alerts are segmented by app, not topic. Since course-discovery consumes from more than one topic, it didn't fire the "No events consumed in past 24 hours" alert. We should tune the alerts/suggest that squads tune their own alerts so things like this can be caught.
@rgraber rgraber added this to Arch-BOM Jan 26, 2024
@rgraber rgraber converted this from a draft issue Jan 26, 2024
@robrap
Copy link
Contributor

robrap commented Feb 2, 2024 •
edited
Loading

How does this relate to #538 and to the alerting question in openedx/event-bus-kafka#226 (comment)?

This was referenced Feb 2, 2024
Closed
Open
@robrap
Copy link
Contributor

robrap commented Feb 5, 2024

Blocked on openedx/event-bus-kafka#226

@robrap robrap moved this to Blocked in Arch-BOM Feb 5, 2024
@jristau1984 jristau1984 moved this from Blocked to Backlog in Arch-BOM Aug 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Arch-BOM
Status: Backlog
Milestone
No milestone
Development

No branches or pull requests
2 participants
@rgraber @robrap