Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Continuous performance regression testing #208

Open
achamayou opened this issue Aug 8, 2024 · 2 comments
Open

Continuous performance regression testing #208

achamayou opened this issue Aug 8, 2024 · 2 comments
Assignees
Labels
enhancement New feature or request

Comments

@achamayou
Copy link
Member

It would be good for the project to have a few end to end benchmarks at least, and to run them regularly to at least spot performance regressions quickly, if not prevent them.

A setup similar to what CCF does may be a good place to start: bencher infra, CI job, Dashboard.

@achamayou achamayou added the enhancement New feature or request label Aug 8, 2024
@andpiccione
Copy link
Member

@achamayou We already have a few performance tests that run during the CI:

Of course it would be great to have a more thorough end-to-end benchmark suite like CCF does, but the current tests could be good enough to spot most of the performance regressions.

@achamayou
Copy link
Member Author

@andpiccione I found those but I am not sure how realistic they are compared to the scenarios we are discussing. I can try to create a bencher project and hook them up if you would like.

@vimauro vimauro self-assigned this Oct 18, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants