Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI/CD: Benchmarking test - using latest version #3

Merged
merged 1 commit into from
Dec 18, 2023

Conversation

kassane
Copy link
Contributor

@kassane kassane commented Sep 24, 2023

closes: #2

Note: According to this example, the C client that uses CMake eventually gets the latest version of TB downloaded and compiled, independently of the previously built source for the other clients.

preview: https://github.com/kassane/tigerbeetle-clients-benchmarks/actions

@kassane kassane marked this pull request as ready for review September 24, 2023 18:18
@kassane kassane force-pushed the upstream branch 2 times, most recently from f4b9619 to 73e7c63 Compare September 25, 2023 13:35
@kassane

This comment has been minimized.

@kassane

This comment has been minimized.

@kassane
Copy link
Contributor Author

kassane commented Dec 3, 2023

Fixed

  • Go client,
  • Zig client
  • C client

New

  • D client (BetterC [nogc]) posix style (thx @jacob-carlborg dstep bindgen)

https://github.com/kassane/tigerbeetle-clients-benchmarks/actions/runs/7078576026/job/19264212020

C result
$> [100%] Linking C executable bench
[100%] Built target bench
info(message_bus): connected to replica 0
Total time: 3113 ms
Max time per batch: 103 ms
Transfers per second: 321233

Total time: 3010 ms
Max time per batch: 26 ms
Transfers per second: 332225

Total time: 3086 ms
Max time per batch: 46 ms
Transfers per second: 324044

Total time: 3055 ms
Max time per batch: 33 ms
Transfers per second: 327332

Total time: 3027 ms
Max time per batch: 27 ms
Transfers per second: 330360

Total time: 3036 ms
Max time per batch: 35 ms
Transfers per second: 329380

Total time: 3039 ms
Max time per batch: 28 ms
Transfers per second: 329055

Total time: 3033 ms
Max time per batch: 30 ms
Transfers per second: 329706

Total time: 3028 ms
Max time per batch: 26 ms
Transfers per second: 330250

Total time: 3028 ms
Max time per batch: 27 ms
Transfers per second: 330250

[100%] Built target run
Go result
$> Run cd go
go: downloading github.com/tigerbeetle/tigerbeetle-go v0.14.167
info(message_bus): connected to replica 0
Total time: 2981 ms
Max time per batch: 98 ms
Transfers per second: 335457

Total time: 2890 ms
Max time per batch: 29 ms
Transfers per second: 346020

Total time: 2900 ms
Max time per batch: 26 ms
Transfers per second: 344827

Total time: 2898 ms
Max time per batch: 32 ms
Transfers per second: 345065

Total time: 2902 ms
Max time per batch: 26 ms
Transfers per second: 344589

Total time: 2930 ms
Max time per batch: 29 ms
Transfers per second: 341296

Total time: 2908 ms
Max time per batch: 26 ms
Transfers per second: 343878

Total time: 2891 ms
Max time per batch: 25 ms
Transfers per second: 345901

Total time: 2911 ms
Max time per batch: 33 ms
Transfers per second: 343524

Total time: 2938 ms
Max time per batch: 64 ms
Transfers per second: 340367
D result
$> Run cd d
    Starting Performing "release" build using /opt/hostedtoolcache/dc/ldc2-1.35.0/x64/ldc2-1.35.0-linux-x86_64/bin/ldc2 for x86_64.
    Building tb_client_bench ~master: building configuration [application]
     Linking tb_client_bench
     Running bin/tb_client_bench 
info(message_bus): connected to replica 0
Total time: 3110 ms
Max time per batch: 107 ms
Transfers per second: 321543

Total time: 3037 ms
Max time per batch: 32 ms
Transfers per second: 329272

Total time: 3028 ms
Max time per batch: 28 ms
Transfers per second: 330250

Total time: 3017 ms
Max time per batch: 27 ms
Transfers per second: 331455

Total time: 3019 ms
Max time per batch: 26 ms
Transfers per second: 331235

Total time: 3033 ms
Max time per batch: 30 ms
Transfers per second: 329706

Total time: 3027 ms
Max time per batch: 29 ms
Transfers per second: 330360

Total time: 3020 ms
Max time per batch: 26 ms
Transfers per second: 331125

Total time: 3025 ms
Max time per batch: 28 ms
Transfers per second: 330578

Total time: 3025 ms
Max time per batch: 27 ms
Transfers per second: 330578
Zig result
$> Run cd zig
info(message_bus): connected to replica 0
Total time: 922 ms
Max time per batch: 595 ms
Transfers per second: 1084598

Total time: 313 ms
Max time per batch: 4 ms
Transfers per second: 3194888

Total time: 326 ms
Max time per batch: 13 ms
Transfers per second: 3067484

Total time: 326 ms
Max time per batch: 11 ms
Transfers per second: 3067484

Total time: 322 ms
Max time per batch: 5 ms
Transfers per second: 3105590

Total time: 327 ms
Max time per batch: 4 ms
Transfers per second: 3058103

Total time: 317 ms
Max time per batch: 4 ms
Transfers per second: 3154574

Total time: 319 ms
Max time per batch: 4 ms
Transfers per second: 3134796

Total time: 315 ms
Max time per batch: 11 ms
Transfers per second: 3174603

Total time: 319 ms
Max time per batch: 7 ms
Transfers per second: 3134796

@kassane
Copy link
Contributor Author

kassane commented Dec 15, 2023

Finally, done all samples!! 🥳😅

@batiati
Copy link
Owner

batiati commented Dec 18, 2023

Wow!!! Impressive work, thanks so much for keeping this project updated!

@kassane kassane deleted the upstream branch December 18, 2023 12:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add CI/CD tests
2 participants