-
-
Notifications
You must be signed in to change notification settings - Fork 0
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add some performance-oriented testing #59
Comments
I think we need #70 for this |
We could wire up |
Can essentially do this with: https://github.com/vkottler/conntextual. |
I've been using this script to stress test performance: https://github.com/vkottler/runtimepy/blob/master/perf_test.sh. We'll need a way to sample / collect data with the program running and then store it on disk somewhere for later analysis (stream telemetry protocol) |
I wonder if the |
full end-to-end HITL performance tracking would be more worthwhile than benchmarking style testing |
It would be neat to take some of the connection interfaces, and the
Protocol
andPrimitiveArray
implementations, and come up with some benchmark tests to keep track of how well they perform over time.For an interesting end-to-end test, we could test the echo connections (in isolated
ConnectionArbiter
instances) for some specified amount of time and just see how many bytes were transmitted and received by both ends.You could just send 1024-byte payloads or something.
It will also be interesting to compare performance on the different platforms.
The text was updated successfully, but these errors were encountered: