Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump grpc versions in tests to match the current logs-backend versions #8477

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

evanchooly
Copy link
Contributor

What Does This Do

The versions here lag behind what's currently in use in logs-backed by quite some bit. This suggested PR bumps these versions up to something closer to parity with logs-backend. We have resolved the issues this caused for us with code origins so the urgency is low but thought it might be a good time/reason to bump up versions. I don't know either the policies around version bumps nor any nuances this change might cause so if it's deemed to risky or simply undesirable, that's ok. I don't have a particular need for this upgrade beyond just trying to keep dependencies relatively up to date where possible.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@evanchooly evanchooly added comp: testing Testing tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes inst: grpc gRPC instrumentation inst: java Core Java language instrumentation labels Feb 28, 2025
@evanchooly evanchooly requested a review from a team as a code owner February 28, 2025 19:25
@pr-commenter
Copy link

pr-commenter bot commented Feb 28, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/grpcVersion
git_commit_date 1740770051 1740770321
git_commit_sha c8886fb dd3dabd
release_version 1.47.0-SNAPSHOT~c8886fbcec 1.47.0-SNAPSHOT~dd3dabdbd3
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740772890 1740772890
ci_job_id 828447277 828447277
ci_pipeline_id 57391045 57391045
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cxumtg-z-project-304-concurrent-0-ww25y5cy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cxumtg-z-project-304-concurrent-0-ww25y5cy 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 66 metrics, 5 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1134764
Total [baseline] (9.275 s) : 0, 9275115
Agent [candidate] (1.14 s) : 0, 1139868
Total [candidate] (9.272 s) : 0, 9272172
section iast
Agent [baseline] (1.258 s) : 0, 1257619
Total [baseline] (9.875 s) : 0, 9875181
Agent [candidate] (1.258 s) : 0, 1257925
Total [candidate] (9.863 s) : 0, 9863288
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.26 s) : 0, 1259736
Total [baseline] (9.824 s) : 0, 9824297
Agent [candidate] (1.26 s) : 0, 1260069
Total [candidate] (9.833 s) : 0, 9832574
section iast_TELEMETRY_OFF
Agent [baseline] (1.254 s) : 0, 1254377
Total [baseline] (9.882 s) : 0, 9882257
Agent [candidate] (1.265 s) : 0, 1264637
Total [candidate] (10.025 s) : 0, 10024992
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.135 s -
Agent iast 1.258 s 122.855 ms (10.8%)
Agent iast_HARDCODED_SECRET_DISABLED 1.26 s 124.972 ms (11.0%)
Agent iast_TELEMETRY_OFF 1.254 s 119.613 ms (10.5%)
Total tracing 9.275 s -
Total iast 9.875 s 600.066 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.824 s 549.182 ms (5.9%)
Total iast_TELEMETRY_OFF 9.882 s 607.143 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.14 s -
Agent iast 1.258 s 118.057 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.26 s 120.201 ms (10.5%)
Agent iast_TELEMETRY_OFF 1.265 s 124.768 ms (10.9%)
Total tracing 9.272 s -
Total iast 9.863 s 591.116 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.833 s 560.403 ms (6.0%)
Total iast_TELEMETRY_OFF 10.025 s 752.821 ms (8.1%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.748 ms) : 0, 716748
BytebuddyAgent [candidate] (719.261 ms) : 0, 719261
GlobalTracer [baseline] (238.905 ms) : 0, 238905
GlobalTracer [candidate] (240.845 ms) : 0, 240845
AppSec [baseline] (55.5 ms) : 0, 55500
AppSec [candidate] (55.69 ms) : 0, 55690
Debugger [baseline] (95.489 ms) : 0, 95489
Debugger [candidate] (95.945 ms) : 0, 95945
Remote Config [baseline] (587.418 µs) : 0, 587
Remote Config [candidate] (576.76 µs) : 0, 577
Telemetry [baseline] (12.56 ms) : 0, 12560
Telemetry [candidate] (12.517 ms) : 0, 12517
section iast
BytebuddyAgent [baseline] (836.116 ms) : 0, 836116
BytebuddyAgent [candidate] (837.081 ms) : 0, 837081
GlobalTracer [baseline] (229.88 ms) : 0, 229880
GlobalTracer [candidate] (230.38 ms) : 0, 230380
AppSec [baseline] (57.311 ms) : 0, 57311
AppSec [candidate] (56.062 ms) : 0, 56062
Debugger [baseline] (83.606 ms) : 0, 83606
Debugger [candidate] (83.396 ms) : 0, 83396
Remote Config [baseline] (541.76 µs) : 0, 542
Remote Config [candidate] (531.069 µs) : 0, 531
Telemetry [baseline] (12.288 ms) : 0, 12288
Telemetry [candidate] (12.156 ms) : 0, 12156
IAST [baseline] (22.799 ms) : 0, 22799
IAST [candidate] (23.293 ms) : 0, 23293
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.034 ms) : 0, 837034
BytebuddyAgent [candidate] (836.847 ms) : 0, 836847
GlobalTracer [baseline] (230.727 ms) : 0, 230727
GlobalTracer [candidate] (230.66 ms) : 0, 230660
AppSec [baseline] (57.654 ms) : 0, 57654
AppSec [candidate] (57.947 ms) : 0, 57947
Debugger [baseline] (83.788 ms) : 0, 83788
Debugger [candidate] (83.712 ms) : 0, 83712
Remote Config [baseline] (533.346 µs) : 0, 533
Remote Config [candidate] (526.964 µs) : 0, 527
Telemetry [baseline] (12.184 ms) : 0, 12184
Telemetry [candidate] (12.268 ms) : 0, 12268
IAST [baseline] (22.784 ms) : 0, 22784
IAST [candidate] (23.063 ms) : 0, 23063
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.071 ms) : 0, 834071
BytebuddyAgent [candidate] (840.887 ms) : 0, 840887
GlobalTracer [baseline] (230.337 ms) : 0, 230337
GlobalTracer [candidate] (231.614 ms) : 0, 231614
AppSec [baseline] (56.064 ms) : 0, 56064
AppSec [candidate] (56.162 ms) : 0, 56162
Debugger [baseline] (83.369 ms) : 0, 83369
Debugger [candidate] (83.931 ms) : 0, 83931
Remote Config [baseline] (524.43 µs) : 0, 524
Remote Config [candidate] (527.96 µs) : 0, 528
Telemetry [baseline] (12.118 ms) : 0, 12118
Telemetry [candidate] (12.249 ms) : 0, 12249
IAST [baseline] (22.903 ms) : 0, 22903
IAST [candidate] (24.1 ms) : 0, 24100
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.143 s) : 0, 1143014
Total [baseline] (11.491 s) : 0, 11490654
Agent [candidate] (1.135 s) : 0, 1134943
Total [candidate] (11.518 s) : 0, 11517791
section appsec
Agent [baseline] (1.274 s) : 0, 1273726
Total [baseline] (11.777 s) : 0, 11776680
Agent [candidate] (1.275 s) : 0, 1275262
Total [candidate] (11.753 s) : 0, 11753372
section iast
Agent [baseline] (1.259 s) : 0, 1259408
Total [baseline] (11.987 s) : 0, 11986681
Agent [candidate] (1.263 s) : 0, 1262690
Total [candidate] (11.962 s) : 0, 11961838
section profiling
Agent [baseline] (1.38 s) : 0, 1380104
Total [baseline] (11.837 s) : 0, 11837252
Agent [candidate] (1.379 s) : 0, 1379488
Total [candidate] (11.812 s) : 0, 11811504
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.143 s -
Agent appsec 1.274 s 130.712 ms (11.4%)
Agent iast 1.259 s 116.394 ms (10.2%)
Agent profiling 1.38 s 237.09 ms (20.7%)
Total tracing 11.491 s -
Total appsec 11.777 s 286.025 ms (2.5%)
Total iast 11.987 s 496.027 ms (4.3%)
Total profiling 11.837 s 346.598 ms (3.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.135 s -
Agent appsec 1.275 s 140.319 ms (12.4%)
Agent iast 1.263 s 127.747 ms (11.3%)
Agent profiling 1.379 s 244.545 ms (21.5%)
Total tracing 11.518 s -
Total appsec 11.753 s 235.581 ms (2.0%)
Total iast 11.962 s 444.048 ms (3.9%)
Total profiling 11.812 s 293.714 ms (2.6%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (721.221 ms) : 0, 721221
BytebuddyAgent [candidate] (716.216 ms) : 0, 716216
GlobalTracer [baseline] (241.585 ms) : 0, 241585
GlobalTracer [candidate] (239.382 ms) : 0, 239382
AppSec [baseline] (56.187 ms) : 0, 56187
AppSec [candidate] (55.367 ms) : 0, 55367
Debugger [baseline] (95.725 ms) : 0, 95725
Debugger [candidate] (95.994 ms) : 0, 95994
Remote Config [baseline] (601.916 µs) : 0, 602
Remote Config [candidate] (588.05 µs) : 0, 588
Telemetry [baseline] (12.598 ms) : 0, 12598
Telemetry [candidate] (12.339 ms) : 0, 12339
section appsec
BytebuddyAgent [baseline] (734.723 ms) : 0, 734723
BytebuddyAgent [candidate] (736.694 ms) : 0, 736694
GlobalTracer [baseline] (236.296 ms) : 0, 236296
GlobalTracer [candidate] (236.919 ms) : 0, 236919
AppSec [baseline] (178.773 ms) : 0, 178773
AppSec [candidate] (178.133 ms) : 0, 178133
Debugger [baseline] (84.97 ms) : 0, 84970
Debugger [candidate] (84.54 ms) : 0, 84540
Remote Config [baseline] (637.794 µs) : 0, 638
Remote Config [candidate] (632.348 µs) : 0, 632
Telemetry [baseline] (12.384 ms) : 0, 12384
Telemetry [candidate] (12.406 ms) : 0, 12406
IAST [baseline] (21.849 ms) : 0, 21849
IAST [candidate] (21.718 ms) : 0, 21718
section iast
BytebuddyAgent [baseline] (837.344 ms) : 0, 837344
BytebuddyAgent [candidate] (840.281 ms) : 0, 840281
GlobalTracer [baseline] (230.39 ms) : 0, 230390
GlobalTracer [candidate] (229.982 ms) : 0, 229982
AppSec [baseline] (57.335 ms) : 0, 57335
AppSec [candidate] (57.425 ms) : 0, 57425
Debugger [baseline] (83.485 ms) : 0, 83485
Debugger [candidate] (84.289 ms) : 0, 84289
Remote Config [baseline] (513.13 µs) : 0, 513
Remote Config [candidate] (519.359 µs) : 0, 519
Telemetry [baseline] (12.333 ms) : 0, 12333
Telemetry [candidate] (12.237 ms) : 0, 12237
IAST [baseline] (22.889 ms) : 0, 22889
IAST [candidate] (22.829 ms) : 0, 22829
section profiling
BytebuddyAgent [baseline] (708.583 ms) : 0, 708583
BytebuddyAgent [candidate] (708.549 ms) : 0, 708549
GlobalTracer [baseline] (350.731 ms) : 0, 350731
GlobalTracer [candidate] (351.055 ms) : 0, 351055
AppSec [baseline] (55.224 ms) : 0, 55224
AppSec [candidate] (54.511 ms) : 0, 54511
Debugger [baseline] (88.626 ms) : 0, 88626
Debugger [candidate] (88.576 ms) : 0, 88576
Remote Config [baseline] (608.768 µs) : 0, 609
Remote Config [candidate] (605.674 µs) : 0, 606
Telemetry [baseline] (12.55 ms) : 0, 12550
Telemetry [candidate] (12.489 ms) : 0, 12489
ProfilingAgent [baseline] (123.405 ms) : 0, 123405
ProfilingAgent [candidate] (123.221 ms) : 0, 123221
Profiling [baseline] (123.426 ms) : 0, 123426
Profiling [candidate] (123.242 ms) : 0, 123242
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-02-28T19:29:15 2025-02-28T19:37:09
git_branch master evanchooly/grpcVersion
git_commit_date 1740770051 1740770321
git_commit_sha c8886fb dd3dabd
release_version 1.47.0-SNAPSHOT~c8886fbcec 1.47.0-SNAPSHOT~dd3dabdbd3
start_time 2025-02-28T19:29:01 2025-02-28T19:36:55
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740771837 1740771837
ci_job_id 828447278 828447278
ci_pipeline_id 57391045 57391045
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-cxumtg-z-project-304-concurrent-1-ihgfj7ov 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-cxumtg-z-project-304-concurrent-1-ihgfj7ov 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec
    dateFormat X
    axisFormat %s
section baseline
no_agent (378.811 µs) : 359, 398
.   : milestone, 379,
iast (510.524 µs) : 488, 533
.   : milestone, 511,
iast_FULL (731.521 µs) : 709, 754
.   : milestone, 732,
iast_GLOBAL (557.237 µs) : 535, 579
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (508.721 µs) : 487, 531
.   : milestone, 509,
iast_INACTIVE (458.695 µs) : 437, 480
.   : milestone, 459,
iast_TELEMETRY_OFF (505.036 µs) : 481, 529
.   : milestone, 505,
tracing (448.638 µs) : 428, 469
.   : milestone, 449,
section candidate
no_agent (378.321 µs) : 358, 398
.   : milestone, 378,
iast (517.375 µs) : 495, 539
.   : milestone, 517,
iast_FULL (733.413 µs) : 711, 756
.   : milestone, 733,
iast_GLOBAL (561.747 µs) : 540, 584
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (506.891 µs) : 485, 529
.   : milestone, 507,
iast_INACTIVE (461.514 µs) : 440, 483
.   : milestone, 462,
iast_TELEMETRY_OFF (497.305 µs) : 475, 520
.   : milestone, 497,
tracing (458.13 µs) : 437, 479
.   : milestone, 458,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.811 µs [359.275 µs, 398.348 µs] -
iast 510.524 µs [488.297 µs, 532.751 µs] 131.712 µs (34.8%)
iast_FULL 731.521 µs [709.344 µs, 753.699 µs] 352.71 µs (93.1%)
iast_GLOBAL 557.237 µs [535.473 µs, 579.001 µs] 178.425 µs (47.1%)
iast_HARDCODED_SECRET_DISABLED 508.721 µs [486.611 µs, 530.831 µs] 129.91 µs (34.3%)
iast_INACTIVE 458.695 µs [437.467 µs, 479.924 µs] 79.884 µs (21.1%)
iast_TELEMETRY_OFF 505.036 µs [481.216 µs, 528.856 µs] 126.225 µs (33.3%)
tracing 448.638 µs [427.965 µs, 469.312 µs] 69.827 µs (18.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.321 µs [358.496 µs, 398.147 µs] -
iast 517.375 µs [495.405 µs, 539.344 µs] 139.054 µs (36.8%)
iast_FULL 733.413 µs [711.288 µs, 755.539 µs] 355.092 µs (93.9%)
iast_GLOBAL 561.747 µs [539.765 µs, 583.729 µs] 183.426 µs (48.5%)
iast_HARDCODED_SECRET_DISABLED 506.891 µs [485.152 µs, 528.629 µs] 128.569 µs (34.0%)
iast_INACTIVE 461.514 µs [440.214 µs, 482.814 µs] 83.192 µs (22.0%)
iast_TELEMETRY_OFF 497.305 µs [474.978 µs, 519.633 µs] 118.984 µs (31.5%)
tracing 458.13 µs [437.309 µs, 478.95 µs] 79.808 µs (21.1%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.362 ms) : 1342, 1382
.   : milestone, 1362,
appsec (1.72 ms) : 1695, 1745
.   : milestone, 1720,
appsec_no_iast (1.722 ms) : 1698, 1746
.   : milestone, 1722,
code_origins (1.698 ms) : 1666, 1730
.   : milestone, 1698,
iast (1.509 ms) : 1484, 1534
.   : milestone, 1509,
profiling (1.514 ms) : 1490, 1539
.   : milestone, 1514,
tracing (1.504 ms) : 1479, 1529
.   : milestone, 1504,
section candidate
no_agent (1.37 ms) : 1350, 1389
.   : milestone, 1370,
appsec (1.727 ms) : 1703, 1751
.   : milestone, 1727,
appsec_no_iast (1.728 ms) : 1704, 1751
.   : milestone, 1728,
code_origins (1.694 ms) : 1662, 1726
.   : milestone, 1694,
iast (1.512 ms) : 1487, 1537
.   : milestone, 1512,
profiling (1.55 ms) : 1524, 1576
.   : milestone, 1550,
tracing (1.491 ms) : 1467, 1514
.   : milestone, 1491,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.342 ms, 1.382 ms] -
appsec 1.72 ms [1.695 ms, 1.745 ms] 358.61 µs (26.3%)
appsec_no_iast 1.722 ms [1.698 ms, 1.746 ms] 360.706 µs (26.5%)
code_origins 1.698 ms [1.666 ms, 1.73 ms] 336.053 µs (24.7%)
iast 1.509 ms [1.484 ms, 1.534 ms] 147.588 µs (10.8%)
profiling 1.514 ms [1.49 ms, 1.539 ms] 152.693 µs (11.2%)
tracing 1.504 ms [1.479 ms, 1.529 ms] 142.375 µs (10.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.35 ms, 1.389 ms] -
appsec 1.727 ms [1.703 ms, 1.751 ms] 356.997 µs (26.1%)
appsec_no_iast 1.728 ms [1.704 ms, 1.751 ms] 357.878 µs (26.1%)
code_origins 1.694 ms [1.662 ms, 1.726 ms] 324.033 µs (23.7%)
iast 1.512 ms [1.487 ms, 1.537 ms] 141.907 µs (10.4%)
profiling 1.55 ms [1.524 ms, 1.576 ms] 180.008 µs (13.1%)
tracing 1.491 ms [1.467 ms, 1.514 ms] 120.755 µs (8.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master evanchooly/grpcVersion
git_commit_date 1740770051 1740770321
git_commit_sha c8886fb dd3dabd
release_version 1.47.0-SNAPSHOT~c8886fbcec 1.47.0-SNAPSHOT~dd3dabdbd3
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740772478 1740772478
ci_job_id 828447279 828447279
ci_pipeline_id 57391045 57391045
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-8ksbllmc-project-304-concurrent-0-zkq9vx8r 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-8ksbllmc-project-304-concurrent-0-zkq9vx8r 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1457, 1480
.   : milestone, 1469,
appsec (2.331 ms) : 2288, 2375
.   : milestone, 2331,
iast (2.103 ms) : 2048, 2157
.   : milestone, 2103,
iast_GLOBAL (2.147 ms) : 2091, 2202
.   : milestone, 2147,
profiling (1.978 ms) : 1933, 2023
.   : milestone, 1978,
tracing (1.925 ms) : 1883, 1966
.   : milestone, 1925,
section candidate
no_agent (1.468 ms) : 1456, 1479
.   : milestone, 1468,
appsec (2.327 ms) : 2284, 2370
.   : milestone, 2327,
iast (2.1 ms) : 2045, 2155
.   : milestone, 2100,
iast_GLOBAL (2.145 ms) : 2089, 2200
.   : milestone, 2145,
profiling (2.43 ms) : 2255, 2605
.   : milestone, 2430,
tracing (1.933 ms) : 1892, 1975
.   : milestone, 1933,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.457 ms, 1.48 ms] -
appsec 2.331 ms [2.288 ms, 2.375 ms] 862.64 µs (58.7%)
iast 2.103 ms [2.048 ms, 2.157 ms] 633.995 µs (43.2%)
iast_GLOBAL 2.147 ms [2.091 ms, 2.202 ms] 678.278 µs (46.2%)
profiling 1.978 ms [1.933 ms, 2.023 ms] 509.256 µs (34.7%)
tracing 1.925 ms [1.883 ms, 1.966 ms] 456.089 µs (31.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.456 ms, 1.479 ms] -
appsec 2.327 ms [2.284 ms, 2.37 ms] 859.375 µs (58.6%)
iast 2.1 ms [2.045 ms, 2.155 ms] 632.623 µs (43.1%)
iast_GLOBAL 2.145 ms [2.089 ms, 2.2 ms] 677.042 µs (46.1%)
profiling 2.43 ms [2.255 ms, 2.605 ms] 962.547 µs (65.6%)
tracing 1.933 ms [1.892 ms, 1.975 ms] 465.897 µs (31.7%)
Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~dd3dabdbd3, baseline=1.47.0-SNAPSHOT~c8886fbcec
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.292 s) : 15292000, 15292000
.   : milestone, 15292000,
appsec (14.838 s) : 14838000, 14838000
.   : milestone, 14838000,
iast (18.98 s) : 18980000, 18980000
.   : milestone, 18980000,
iast_GLOBAL (18.075 s) : 18075000, 18075000
.   : milestone, 18075000,
profiling (14.882 s) : 14882000, 14882000
.   : milestone, 14882000,
tracing (15.17 s) : 15170000, 15170000
.   : milestone, 15170000,
section candidate
no_agent (15.568 s) : 15568000, 15568000
.   : milestone, 15568000,
appsec (15.052 s) : 15052000, 15052000
.   : milestone, 15052000,
iast (18.721 s) : 18721000, 18721000
.   : milestone, 18721000,
iast_GLOBAL (17.888 s) : 17888000, 17888000
.   : milestone, 17888000,
profiling (14.864 s) : 14864000, 14864000
.   : milestone, 14864000,
tracing (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.292 s [15.292 s, 15.292 s] -
appsec 14.838 s [14.838 s, 14.838 s] -454.0 ms (-3.0%)
iast 18.98 s [18.98 s, 18.98 s] 3.688 s (24.1%)
iast_GLOBAL 18.075 s [18.075 s, 18.075 s] 2.783 s (18.2%)
profiling 14.882 s [14.882 s, 14.882 s] -410.0 ms (-2.7%)
tracing 15.17 s [15.17 s, 15.17 s] -122.0 ms (-0.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.568 s [15.568 s, 15.568 s] -
appsec 15.052 s [15.052 s, 15.052 s] -516.0 ms (-3.3%)
iast 18.721 s [18.721 s, 18.721 s] 3.153 s (20.3%)
iast_GLOBAL 17.888 s [17.888 s, 17.888 s] 2.32 s (14.9%)
profiling 14.864 s [14.864 s, 14.864 s] -704.0 ms (-4.5%)
tracing 14.969 s [14.969 s, 14.969 s] -599.0 ms (-3.8%)

@@ -14,12 +14,12 @@ apply from: "$rootDir/gradle/java.gradle"
apply plugin: 'idea'

// First version with Mac M1 support
def grpcVersion = '1.42.2'
def grpcVersion = '1.62.2'
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We claim to support 1.42.2 (at least 1.5) so if you raise that version we loose this guarantee.
In general, for instrumentation, we test the version we compile with and we test the latest.

If you want to add a specific test for 1.62 you can just leave the base version as it and add a test suite for this specific version

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: testing Testing inst: grpc gRPC instrumentation inst: java Core Java language instrumentation tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants