Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Wrote benchmark tests for the zPages module #1504

Merged
merged 30 commits into from
Aug 7, 2020

Conversation

williamhu99
Copy link
Contributor

@williamhu99 williamhu99 commented Aug 4, 2020

This pull request contains

  • Benchmark tests for TracezSpanBuckets, as requested here
  • Benchmark tests for TracezDataAggregator

Benchmark Results

Java version:

openjdk version "11.0.6" 2020-06-25
OpenJDK Runtime Environment (build 11.0.6+10-google-release-318347721)
OpenJDK 64-Bit Server VM (build 11.0.6+10-google-release-318347721, mixed mode, sharing)

Hardware Info

Architecture: x86_64
CPU(s): 16
Thread(s) per core: 2
Model name: Intel(R) Xeon(R) CPU @ 2.20GHz

TracezSpanBucketsBenchmark:

Benchmark                                                                       Mode  Cnt      Score     Error   Units

TracezSpanBucketsBenchmark.addToBucket_01Thread                                thrpt   10  17133.815 ± 179.117  ops/ms
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.alloc.rate                 thrpt   10    609.617 ±   6.356  MB/sec
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.alloc.rate.norm            thrpt   10     56.000 ±   0.001    B/op
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.churn.G1_Eden_Space        thrpt   10    630.842 ± 502.667  MB/sec
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.churn.G1_Eden_Space.norm   thrpt   10     57.967 ±  46.195    B/op
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.count                      thrpt   10      8.000            counts
TracezSpanBucketsBenchmark.addToBucket_01Thread:·gc.time                       thrpt   10     37.000                ms

TracezSpanBucketsBenchmark.addToBucket_05Threads                               thrpt   10   1448.734 ±  59.915  ops/ms
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.alloc.rate                thrpt   10     88.369 ±   3.629  MB/sec
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.alloc.rate.norm           thrpt   10     96.002 ±   0.001    B/op
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.churn.G1_Eden_Space       thrpt   10     78.812 ± 376.794  MB/sec
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.churn.G1_Eden_Space.norm  thrpt   10     85.257 ± 407.608    B/op
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.count                     thrpt   10      1.000            counts
TracezSpanBucketsBenchmark.addToBucket_05Threads:·gc.time                      thrpt   10      6.000                ms

TracezSpanBucketsBenchmark.addToBucket_10Threads                               thrpt   10   2435.441 ±  49.773  ops/ms
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.alloc.rate                thrpt   10    148.482 ±   3.023  MB/sec
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.alloc.rate.norm           thrpt   10     96.002 ±   0.001    B/op
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.churn.G1_Eden_Space       thrpt   10    157.433 ± 501.783  MB/sec
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.churn.G1_Eden_Space.norm  thrpt   10    102.915 ± 328.063    B/op
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.count                     thrpt   10      2.000            counts
TracezSpanBucketsBenchmark.addToBucket_10Threads:·gc.time                      thrpt   10     12.000                ms

TracezSpanBucketsBenchmark.addToBucket_20Threads                               thrpt   10   2355.800 ± 140.500  ops/ms
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.alloc.rate                thrpt   10    143.503 ±   8.528  MB/sec
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.alloc.rate.norm           thrpt   10     96.004 ±   0.001    B/op
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.churn.G1_Eden_Space       thrpt   10    157.130 ± 500.816  MB/sec
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.churn.G1_Eden_Space.norm  thrpt   10    106.904 ± 340.741    B/op
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.count                     thrpt   10      2.000            counts
TracezSpanBucketsBenchmark.addToBucket_20Threads:·gc.time                      thrpt   10     10.000                ms

TracezDataAggregatorBenchmark:

Benchmark                                                                       (numberOfSpans)   Mode  Cnt       Score       Error   Units

TracezDataAggregatorBenchmark.getCounts_01Thread                                              1  thrpt   10   14792.282 ±  3102.192  ops/ms
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate                               1  thrpt   10    2932.581 ±   614.296  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate.norm                          1  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space                      1  thrpt   10    2872.969 ±   829.405  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space.norm                 1  thrpt   10     304.446 ±    49.594    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.count                                    1  thrpt   10      30.000              counts
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.time                                     1  thrpt   10      46.000                  ms

TracezDataAggregatorBenchmark.getCounts_01Thread                                             10  thrpt   10   15679.266 ±    75.415  ops/ms
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate                              10  thrpt   10    3108.393 ±    14.967  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate.norm                         10  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space                     10  thrpt   10    3103.478 ±   618.312  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space.norm                10  thrpt   10     311.539 ±    62.521    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.count                                   10  thrpt   10      32.000              counts
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.time                                    10  thrpt   10      33.000                  ms

TracezDataAggregatorBenchmark.getCounts_01Thread                                           1000  thrpt   10   16103.333 ±    84.507  ops/ms
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate                            1000  thrpt   10    3192.435 ±    16.622  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate.norm                       1000  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space                   1000  thrpt   10    3200.333 ±   708.019  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space.norm              1000  thrpt   10     312.778 ±    69.248    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.count                                 1000  thrpt   10      33.000              counts
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.time                                  1000  thrpt   10      32.000                  ms

TracezDataAggregatorBenchmark.getCounts_01Thread                                        1000000  thrpt   10   37144.643 ±   269.123  ops/ms
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate                         1000000  thrpt   10    3398.461 ±    24.672  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.alloc.rate.norm                    1000000  thrpt   10     144.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space                1000000  thrpt   10    3391.009 ±   576.120  MB/sec
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.churn.G1_Eden_Space.norm           1000000  thrpt   10     143.678 ±    24.289    B/op
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.count                              1000000  thrpt   10      43.000              counts
TracezDataAggregatorBenchmark.getCounts_01Thread:·gc.time                               1000000  thrpt   10      41.000                  ms

TracezDataAggregatorBenchmark.getCounts_05Threads                                             1  thrpt   10   74813.371 ±   548.537  ops/ms
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate                              1  thrpt   10   14824.862 ±   108.219  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate.norm                         1  thrpt   10     311.999 ±     0.004    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space                     1  thrpt   10   14954.062 ±     1.122  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space.norm                1  thrpt   10     314.724 ±     2.309    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.count                                   1  thrpt   10      90.000              counts
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.time                                    1  thrpt   10     105.000                  ms

TracezDataAggregatorBenchmark.getCounts_05Threads                                            10  thrpt   10   79326.421 ±   606.977  ops/ms
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate                             10  thrpt   10   15718.854 ±   119.266  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate.norm                        10  thrpt   10     311.999 ±     0.004    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space                    10  thrpt   10   15702.425 ±  1283.161  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space.norm               10  thrpt   10     311.679 ±    25.548    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.count                                  10  thrpt   10      78.000              counts
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.time                                   10  thrpt   10      94.000                  ms

TracezDataAggregatorBenchmark.getCounts_05Threads                                          1000  thrpt   10   73127.398 ±  1797.815  ops/ms
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate                           1000  thrpt   10   14488.777 ±   357.274  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate.norm                      1000  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space                  1000  thrpt   10   14430.197 ±  2011.378  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space.norm             1000  thrpt   10     310.599 ±    40.134    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.count                                1000  thrpt   10      56.000              counts
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.time                                 1000  thrpt   10      96.000                  ms

TracezDataAggregatorBenchmark.getCounts_05Threads                                       1000000  thrpt   10  170512.966 ± 26345.175  ops/ms
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate                        1000000  thrpt   10   15594.783 ±  2410.690  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.alloc.rate.norm                   1000000  thrpt   10     144.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space               1000000  thrpt   10   15683.896 ±  2427.209  MB/sec
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.churn.G1_Eden_Space.norm          1000000  thrpt   10     144.972 ±     9.016    B/op
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.count                             1000000  thrpt   10      95.000              counts
TracezDataAggregatorBenchmark.getCounts_05Threads:·gc.time                              1000000  thrpt   10     111.000                  ms

TracezDataAggregatorBenchmark.getCounts_10Threads                                             1  thrpt   10  114491.682 ±  4265.189  ops/ms
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate                              1  thrpt   10   22675.116 ±   843.016  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate.norm                         1  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space                     1  thrpt   10   22755.783 ±  2479.838  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space.norm                1  thrpt   10     313.029 ±    29.734    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.count                                   1  thrpt   10      88.000              counts
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.time                                    1  thrpt   10     129.000                  ms

TracezDataAggregatorBenchmark.getCounts_10Threads                                            10  thrpt   10  118318.422 ±  3740.372  ops/ms
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate                             10  thrpt   10   23429.930 ±   739.594  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate.norm                        10  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space                    10  thrpt   10   23528.026 ±  3013.909  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space.norm               10  thrpt   10     313.345 ±    39.871    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.count                                  10  thrpt   10      57.000              counts
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.time                                   10  thrpt   10     110.000                  ms

TracezDataAggregatorBenchmark.getCounts_10Threads                                          1000  thrpt   10  120036.874 ±  5795.201  ops/ms
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate                           1000  thrpt   10   23774.585 ±  1149.054  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate.norm                      1000  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space                  1000  thrpt   10   23717.020 ±  1643.732  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space.norm             1000  thrpt   10     311.330 ±    20.127    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.count                                1000  thrpt   10      69.000              counts
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.time                                 1000  thrpt   10     116.000                  ms

TracezDataAggregatorBenchmark.getCounts_10Threads                                       1000000  thrpt   10  243987.812 ±  4435.853  ops/ms
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate                        1000000  thrpt   10   22301.989 ±   408.603  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.alloc.rate.norm                   1000000  thrpt   10     144.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space               1000000  thrpt   10   22655.038 ±  2475.186  MB/sec
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.churn.G1_Eden_Space.norm          1000000  thrpt   10     146.233 ±    14.683    B/op
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.count                             1000000  thrpt   10     121.000              counts
TracezDataAggregatorBenchmark.getCounts_10Threads:·gc.time                              1000000  thrpt   10     159.000                  ms

TracezDataAggregatorBenchmark.getCounts_20Threads                                             1  thrpt   10  124683.938 ±  2800.323  ops/ms
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate                              1  thrpt   10   24866.222 ±   550.802  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate.norm                         1  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space                     1  thrpt   10   25073.959 ±  1773.667  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space.norm                1  thrpt   10     314.588 ±    20.264    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.count                                   1  thrpt   10     103.000              counts
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.time                                    1  thrpt   10     149.000                  ms

TracezDataAggregatorBenchmark.getCounts_20Threads                                            10  thrpt   10  126747.917 ±  4223.296  ops/ms
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate                             10  thrpt   10   25298.949 ±   838.861  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate.norm                        10  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space                    10  thrpt   10   25537.112 ±  1869.991  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space.norm               10  thrpt   10     314.861 ±    17.475    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.count                                  10  thrpt   10     105.000              counts
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.time                                   10  thrpt   10     156.000                  ms

TracezDataAggregatorBenchmark.getCounts_20Threads                                          1000  thrpt   10  124157.989 ±  4308.299  ops/ms
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate                           1000  thrpt   10   24787.688 ±   885.568  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate.norm                      1000  thrpt   10     312.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space                  1000  thrpt   10   25313.217 ±  2415.536  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space.norm             1000  thrpt   10     318.707 ±    31.148    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.count                                1000  thrpt   10      68.000              counts
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.time                                 1000  thrpt   10     122.000                  ms

TracezDataAggregatorBenchmark.getCounts_20Threads                                       1000000  thrpt   10  264277.339 ±  9584.898  ops/ms
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate                        1000000  thrpt   10   24330.086 ±   874.964  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.alloc.rate.norm                   1000000  thrpt   10     144.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space               1000000  thrpt   10   24533.285 ±  1669.312  MB/sec
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.churn.G1_Eden_Space.norm          1000000  thrpt   10     145.218 ±     9.040    B/op
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.count                             1000000  thrpt   10     129.000              counts
TracezDataAggregatorBenchmark.getCounts_20Threads:·gc.time                              1000000  thrpt   10     170.000                  ms

TracezDataAggregatorBenchmark.getSpans_01Thread                                               1  thrpt   10   29669.043 ±   340.385  ops/ms
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate                                1  thrpt   10    1508.085 ±    17.371  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate.norm                           1  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space                       1  thrpt   10    1498.367 ±   377.019  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space.norm                  1  thrpt   10      79.511 ±    20.156    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet                       1  thrpt   10      ≈ 10⁻⁴              MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet.norm                  1  thrpt   10      ≈ 10⁻⁵                B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.count                                     1  thrpt   10      19.000              counts
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.time                                      1  thrpt   10      50.000                  ms

TracezDataAggregatorBenchmark.getSpans_01Thread                                              10  thrpt   10   30589.978 ±   308.822  ops/ms
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate                               10  thrpt   10    1554.894 ±    15.683  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate.norm                          10  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space                      10  thrpt   10    1577.201 ±     0.138  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space.norm                 10  thrpt   10      81.151 ±     0.815    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet                      10  thrpt   10      ≈ 10⁻⁴              MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet.norm                 10  thrpt   10      ≈ 10⁻⁵                B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.count                                    10  thrpt   10      20.000              counts
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.time                                     10  thrpt   10      49.000                  ms

TracezDataAggregatorBenchmark.getSpans_01Thread                                            1000  thrpt   10   30729.432 ±   377.905  ops/ms
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate                             1000  thrpt   10    1561.980 ±    19.222  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate.norm                        1000  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space                    1000  thrpt   10    1577.258 ±     0.070  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space.norm               1000  thrpt   10      80.787 ±     0.998    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet                    1000  thrpt   10      ≈ 10⁻⁴              MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.RememberedSet.norm               1000  thrpt   10      ≈ 10⁻⁵                B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.count                                  1000  thrpt   10      20.000              counts
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.time                                   1000  thrpt   10      47.000                  ms

TracezDataAggregatorBenchmark.getSpans_01Thread                                         1000000  thrpt   10   41980.654 ±   861.861  ops/ms
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate                          1000000  thrpt   10     640.150 ±    13.139  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.alloc.rate.norm                     1000000  thrpt   10      24.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space                 1000000  thrpt   10     630.855 ±   502.677  MB/sec
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.churn.G1_Eden_Space.norm            1000000  thrpt   10      23.689 ±    18.885    B/op
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.count                               1000000  thrpt   10       8.000              counts
TracezDataAggregatorBenchmark.getSpans_01Thread:·gc.time                                1000000  thrpt   10      39.000                  ms

TracezDataAggregatorBenchmark.getSpans_05Threads                                              1  thrpt   10  153583.721 ±  1183.387  ops/ms
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate                               1  thrpt   10    7802.605 ±    60.135  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate.norm                          1  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space                      1  thrpt   10    7872.739 ±  1097.468  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space.norm                 1  thrpt   10      80.740 ±    11.608    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.count                                    1  thrpt   10      56.000              counts
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.time                                     1  thrpt   10      66.000                  ms

TracezDataAggregatorBenchmark.getSpans_05Threads                                             10  thrpt   10  148371.599 ±   620.134  ops/ms
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate                              10  thrpt   10    7537.974 ±    31.528  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate.norm                         10  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space                     10  thrpt   10    7591.629 ±  1098.081  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space.norm                10  thrpt   10      80.582 ±    11.884    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.count                                   10  thrpt   10      54.000              counts
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.time                                    10  thrpt   10      63.000                  ms

TracezDataAggregatorBenchmark.getSpans_05Threads                                           1000  thrpt   10  153344.292 ±  1512.039  ops/ms
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate                            1000  thrpt   10    7790.644 ±    77.477  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate.norm                       1000  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space                   1000  thrpt   10    7731.843 ±  1120.331  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space.norm              1000  thrpt   10      79.397 ±    11.491    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.count                                 1000  thrpt   10      55.000              counts
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.time                                  1000  thrpt   10      69.000                  ms

TracezDataAggregatorBenchmark.getSpans_05Threads                                        1000000  thrpt   10  217758.245 ±  2983.959  ops/ms
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate                         1000000  thrpt   10    3318.994 ±    45.738  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.alloc.rate.norm                    1000000  thrpt   10      24.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space                1000000  thrpt   10    3295.297 ±   756.881  MB/sec
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.churn.G1_Eden_Space.norm           1000000  thrpt   10      23.829 ±     5.461    B/op
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.count                              1000000  thrpt   10      34.000              counts
TracezDataAggregatorBenchmark.getSpans_05Threads:·gc.time                               1000000  thrpt   10      36.000                  ms

TracezDataAggregatorBenchmark.getSpans_10Threads                                              1  thrpt   10  219368.772 ±  9691.023  ops/ms
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate                               1  thrpt   10   11138.117 ±   491.331  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate.norm                          1  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space                      1  thrpt   10   11334.881 ±  1235.227  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space.norm                 1  thrpt   10      81.434 ±     8.626    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.count                                    1  thrpt   10      67.000              counts
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.time                                     1  thrpt   10      90.000                  ms

TracezDataAggregatorBenchmark.getSpans_10Threads                                             10  thrpt   10  232144.357 ±  6292.858  ops/ms
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate                              10  thrpt   10   11787.628 ±   320.882  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate.norm                         10  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space                     10  thrpt   10   11936.821 ±  1115.213  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space.norm                10  thrpt   10      81.016 ±     7.337    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.count                                   10  thrpt   10      85.000              counts
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.time                                    10  thrpt   10      98.000                  ms

TracezDataAggregatorBenchmark.getSpans_10Threads                                           1000  thrpt   10  231495.460 ±  9337.825  ops/ms
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate                            1000  thrpt   10   11754.540 ±   474.589  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate.norm                       1000  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space                   1000  thrpt   10   11798.984 ±  1097.823  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space.norm              1000  thrpt   10      80.320 ±     7.176    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.count                                 1000  thrpt   10      84.000              counts
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.time                                  1000  thrpt   10     103.000                  ms

TracezDataAggregatorBenchmark.getSpans_10Threads                                        1000000  thrpt   10  314909.374 ±  7064.405  ops/ms
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate                         1000000  thrpt   10    4797.339 ±   107.363  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.alloc.rate.norm                    1000000  thrpt   10      24.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space                1000000  thrpt   10    4842.396 ±     0.907  MB/sec
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.churn.G1_Eden_Space.norm           1000000  thrpt   10      24.230 ±     0.551    B/op
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.count                              1000000  thrpt   10      50.000              counts
TracezDataAggregatorBenchmark.getSpans_10Threads:·gc.time                               1000000  thrpt   10      52.000                  ms

TracezDataAggregatorBenchmark.getSpans_20Threads                                              1  thrpt   10  249317.349 ±  2197.445  ops/ms
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate                               1  thrpt   10   12724.919 ±   118.374  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate.norm                          1  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space                      1  thrpt   10   12869.508 ±  1022.782  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space.norm                 1  thrpt   10      80.906 ±     6.289    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.count                                    1  thrpt   10      93.000              counts
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.time                                     1  thrpt   10     114.000                  ms

TracezDataAggregatorBenchmark.getSpans_20Threads                                             10  thrpt   10  247592.001 ±  2447.009  ops/ms
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate                              10  thrpt   10   12649.872 ±   171.812  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate.norm                         10  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space                     10  thrpt   10   12636.153 ±  1344.897  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space.norm                10  thrpt   10      79.949 ±     9.242    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.count                                   10  thrpt   10      76.000              counts
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.time                                    10  thrpt   10     105.000                  ms

TracezDataAggregatorBenchmark.getSpans_20Threads                                           1000  thrpt   10  241294.723 ±  2136.043  ops/ms
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate                            1000  thrpt   10   12339.221 ±   135.705  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate.norm                       1000  thrpt   10      80.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space                   1000  thrpt   10   12451.366 ±  1336.708  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space.norm              1000  thrpt   10      80.757 ±     9.310    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.count                                 1000  thrpt   10      75.000              counts
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.time                                  1000  thrpt   10      99.000                  ms

TracezDataAggregatorBenchmark.getSpans_20Threads                                        1000000  thrpt   10  337491.326 ± 10743.347  ops/ms
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate                         1000000  thrpt   10    5184.041 ±   166.886  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.alloc.rate.norm                    1000000  thrpt   10      24.000 ±     0.001    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space                1000000  thrpt   10    5220.505 ±   749.716  MB/sec
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.churn.G1_Eden_Space.norm           1000000  thrpt   10      24.179 ±     3.571    B/op
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.count                              1000000  thrpt   10      55.000              counts
TracezDataAggregatorBenchmark.getSpans_20Threads:·gc.time                               1000000  thrpt   10      61.000                  ms

williamhu99 and others added 25 commits July 18, 2020 00:27
* Scaffolded logic for basic benchmark tests

* Wrote benchmark tests for TracezSpanBuckets

* Updated README with benchmark tests

* Changed the wording slightly
* Scaffolded logic for basic benchmark tests

* Wrote benchmark tests for TracezSpanBuckets

* Updated README with benchmark tests

* Changed the wording slightly

* Added a set of benchmark tests for TracezDataAggregator

* Modified README formatting

* Changed benchmark test to negate dead code elimination
@codecov
Copy link

codecov bot commented Aug 5, 2020

Codecov Report

Merging #1504 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@            Coverage Diff            @@
##             master    #1504   +/-   ##
=========================================
  Coverage     92.33%   92.33%           
  Complexity      951      951           
=========================================
  Files           117      117           
  Lines          3380     3380           
  Branches        281      281           
=========================================
  Hits           3121     3121           
  Misses          172      172           
  Partials         87       87           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update c442300...18a4141. Read the comment docs.

@jkwatson jkwatson merged commit bcb1d4a into open-telemetry:master Aug 7, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants