Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gary/llmobs java sdk integration #8519

Draft
wants to merge 17 commits into
base: master
Choose a base branch
from
Draft

Gary/llmobs java sdk integration #8519

wants to merge 17 commits into from

Conversation

gary-huang
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

@pr-commenter
Copy link

pr-commenter bot commented Mar 7, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/llmobs-java-sdk-integration
git_commit_date 1741356784 1741356536
git_commit_sha 2575c71 48b1a07
release_version 1.48.0-SNAPSHOT~2575c713ad 1.48.0-SNAPSHOT~48b1a07b21
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741359158 1741359158
ci_job_id 837869642 837869642
ci_pipeline_id 58087590 58087590
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-emffvtj5-project-304-concurrent-0-yz9ieocv 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-emffvtj5-project-304-concurrent-0-yz9ieocv 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1038885
Total [baseline] (10.463 s) : 0, 10462652
Agent [candidate] (1.055 s) : 0, 1054525
Total [candidate] (10.429 s) : 0, 10429460
section appsec
Agent [baseline] (1.183 s) : 0, 1183450
Total [baseline] (10.758 s) : 0, 10757694
Agent [candidate] (1.192 s) : 0, 1191595
Total [candidate] (10.758 s) : 0, 10757828
section iast
Agent [baseline] (1.174 s) : 0, 1174051
Total [baseline] (11.055 s) : 0, 11055043
Agent [candidate] (1.168 s) : 0, 1168164
Total [candidate] (10.943 s) : 0, 10942918
section profiling
Agent [baseline] (1.257 s) : 0, 1257004
Total [baseline] (10.871 s) : 0, 10871315
Agent [candidate] (1.261 s) : 0, 1260585
Total [candidate] (10.849 s) : 0, 10848834
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent appsec 1.183 s 144.565 ms (13.9%)
Agent iast 1.174 s 135.166 ms (13.0%)
Agent profiling 1.257 s 218.119 ms (21.0%)
Total tracing 10.463 s -
Total appsec 10.758 s 295.042 ms (2.8%)
Total iast 11.055 s 592.391 ms (5.7%)
Total profiling 10.871 s 408.663 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.055 s -
Agent appsec 1.192 s 137.07 ms (13.0%)
Agent iast 1.168 s 113.64 ms (10.8%)
Agent profiling 1.261 s 206.061 ms (19.5%)
Total tracing 10.429 s -
Total appsec 10.758 s 328.369 ms (3.1%)
Total iast 10.943 s 513.458 ms (4.9%)
Total profiling 10.849 s 419.374 ms (4.0%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.048 ms) : 0, 717048
BytebuddyAgent [candidate] (728.138 ms) : 0, 728138
GlobalTracer [baseline] (239.423 ms) : 0, 239423
GlobalTracer [candidate] (242.527 ms) : 0, 242527
AppSec [baseline] (55.62 ms) : 0, 55620
AppSec [candidate] (55.838 ms) : 0, 55838
Remote Config [baseline] (691.09 µs) : 0, 691
Remote Config [candidate] (692.721 µs) : 0, 693
Telemetry [baseline] (11.252 ms) : 0, 11252
Telemetry [candidate] (12.229 ms) : 0, 12229
section appsec
BytebuddyAgent [baseline] (735.559 ms) : 0, 735559
BytebuddyAgent [candidate] (740.792 ms) : 0, 740792
GlobalTracer [baseline] (236.39 ms) : 0, 236390
GlobalTracer [candidate] (238.19 ms) : 0, 238190
IAST [baseline] (21.286 ms) : 0, 21286
IAST [candidate] (21.742 ms) : 0, 21742
AppSec [baseline] (177.009 ms) : 0, 177009
AppSec [candidate] (177.667 ms) : 0, 177667
Remote Config [baseline] (658.264 µs) : 0, 658
Remote Config [candidate] (671.96 µs) : 0, 672
Telemetry [baseline] (8.281 ms) : 0, 8281
Telemetry [candidate] (8.345 ms) : 0, 8345
section iast
BytebuddyAgent [baseline] (838.21 ms) : 0, 838210
BytebuddyAgent [candidate] (834.73 ms) : 0, 834730
GlobalTracer [baseline] (231.526 ms) : 0, 231526
GlobalTracer [candidate] (229.781 ms) : 0, 229781
IAST [baseline] (22.992 ms) : 0, 22992
IAST [candidate] (22.742 ms) : 0, 22742
AppSec [baseline] (56.876 ms) : 0, 56876
AppSec [candidate] (56.661 ms) : 0, 56661
Remote Config [baseline] (620.662 µs) : 0, 621
Remote Config [candidate] (615.655 µs) : 0, 616
Telemetry [baseline] (8.772 ms) : 0, 8772
Telemetry [candidate] (8.707 ms) : 0, 8707
section profiling
BytebuddyAgent [baseline] (708.615 ms) : 0, 708615
BytebuddyAgent [candidate] (710.094 ms) : 0, 710094
GlobalTracer [baseline] (347.664 ms) : 0, 347664
GlobalTracer [candidate] (350.366 ms) : 0, 350366
AppSec [baseline] (55.067 ms) : 0, 55067
AppSec [candidate] (54.149 ms) : 0, 54149
Remote Config [baseline] (678.421 µs) : 0, 678
Remote Config [candidate] (676.669 µs) : 0, 677
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (8.963 ms) : 0, 8963
ProfilingAgent [baseline] (95.877 ms) : 0, 95877
ProfilingAgent [candidate] (95.864 ms) : 0, 95864
Profiling [baseline] (95.902 ms) : 0, 95902
Profiling [candidate] (95.887 ms) : 0, 95887
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1037071
Total [baseline] (8.694 s) : 0, 8694118
Agent [candidate] (1.041 s) : 0, 1041352
Total [candidate] (8.659 s) : 0, 8659203
section iast
Agent [baseline] (1.185 s) : 0, 1185492
Total [baseline] (9.255 s) : 0, 9254775
Agent [candidate] (1.178 s) : 0, 1177609
Total [candidate] (9.226 s) : 0, 9226189
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.171 s) : 0, 1171045
Total [baseline] (9.187 s) : 0, 9187382
Agent [candidate] (1.179 s) : 0, 1178852
Total [candidate] (9.22 s) : 0, 9219649
section iast_TELEMETRY_OFF
Agent [baseline] (1.165 s) : 0, 1165279
Total [baseline] (9.23 s) : 0, 9230281
Agent [candidate] (1.167 s) : 0, 1166573
Total [candidate] (9.239 s) : 0, 9239393
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.185 s 148.421 ms (14.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 133.974 ms (12.9%)
Agent iast_TELEMETRY_OFF 1.165 s 128.208 ms (12.4%)
Total tracing 8.694 s -
Total iast 9.255 s 560.657 ms (6.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.187 s 493.264 ms (5.7%)
Total iast_TELEMETRY_OFF 9.23 s 536.163 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent iast 1.178 s 136.256 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.179 s 137.5 ms (13.2%)
Agent iast_TELEMETRY_OFF 1.167 s 125.221 ms (12.0%)
Total tracing 8.659 s -
Total iast 9.226 s 566.986 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.22 s 560.446 ms (6.5%)
Total iast_TELEMETRY_OFF 9.239 s 580.19 ms (6.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.461 ms) : 0, 716461
BytebuddyAgent [candidate] (717.579 ms) : 0, 717579
GlobalTracer [baseline] (239.259 ms) : 0, 239259
GlobalTracer [candidate] (239.705 ms) : 0, 239705
AppSec [baseline] (55.13 ms) : 0, 55130
AppSec [candidate] (55.539 ms) : 0, 55539
Remote Config [baseline] (688.391 µs) : 0, 688
Remote Config [candidate] (688.08 µs) : 0, 688
Telemetry [baseline] (10.63 ms) : 0, 10630
Telemetry [candidate] (12.867 ms) : 0, 12867
section iast
BytebuddyAgent [baseline] (848.472 ms) : 0, 848472
BytebuddyAgent [candidate] (842.131 ms) : 0, 842131
GlobalTracer [baseline] (232.23 ms) : 0, 232230
GlobalTracer [candidate] (231.249 ms) : 0, 231249
IAST [baseline] (23.203 ms) : 0, 23203
IAST [candidate] (23.063 ms) : 0, 23063
AppSec [baseline] (57.023 ms) : 0, 57023
AppSec [candidate] (56.681 ms) : 0, 56681
Remote Config [baseline] (630.216 µs) : 0, 630
Remote Config [candidate] (611.353 µs) : 0, 611
Telemetry [baseline] (8.813 ms) : 0, 8813
Telemetry [candidate] (8.723 ms) : 0, 8723
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.259 ms) : 0, 837259
BytebuddyAgent [candidate] (842.78 ms) : 0, 842780
GlobalTracer [baseline] (230.414 ms) : 0, 230414
GlobalTracer [candidate] (231.392 ms) : 0, 231392
IAST [baseline] (22.818 ms) : 0, 22818
IAST [candidate] (23.275 ms) : 0, 23275
AppSec [baseline] (56.297 ms) : 0, 56297
AppSec [candidate] (56.941 ms) : 0, 56941
Remote Config [baseline] (603.598 µs) : 0, 604
Remote Config [candidate] (615.397 µs) : 0, 615
Telemetry [baseline] (8.605 ms) : 0, 8605
Telemetry [candidate] (8.771 ms) : 0, 8771
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (832.254 ms) : 0, 832254
BytebuddyAgent [candidate] (832.57 ms) : 0, 832570
GlobalTracer [baseline] (229.731 ms) : 0, 229731
GlobalTracer [candidate] (230.21 ms) : 0, 230210
IAST [baseline] (22.373 ms) : 0, 22373
IAST [candidate] (23.311 ms) : 0, 23311
AppSec [baseline] (56.902 ms) : 0, 56902
AppSec [candidate] (56.209 ms) : 0, 56209
Remote Config [baseline] (617.822 µs) : 0, 618
Remote Config [candidate] (621.887 µs) : 0, 622
Telemetry [baseline] (8.544 ms) : 0, 8544
Telemetry [candidate] (8.725 ms) : 0, 8725
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-07T14:22:25 2025-03-07T14:30:08
git_branch master gary/llmobs-java-sdk-integration
git_commit_date 1741356784 1741356536
git_commit_sha 2575c71 48b1a07
release_version 1.48.0-SNAPSHOT~2575c713ad 1.48.0-SNAPSHOT~48b1a07b21
start_time 2025-03-07T14:22:11 2025-03-07T14:29:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741358205 1741358205
ci_job_id 837869644 837869644
ci_pipeline_id 58087590 58087590
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-vpimou3u-project-304-concurrent-0-1m24y96x 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-vpimou3u-project-304-concurrent-0-1m24y96x 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.003 µs) : 363, 403
.   : milestone, 383,
iast (513.112 µs) : 491, 535
.   : milestone, 513,
iast_FULL (726.798 µs) : 705, 749
.   : milestone, 727,
iast_GLOBAL (567.041 µs) : 544, 590
.   : milestone, 567,
iast_HARDCODED_SECRET_DISABLED (510.134 µs) : 489, 532
.   : milestone, 510,
iast_INACTIVE (469.879 µs) : 448, 491
.   : milestone, 470,
iast_TELEMETRY_OFF (492.564 µs) : 470, 515
.   : milestone, 493,
tracing (454.138 µs) : 433, 475
.   : milestone, 454,
section candidate
no_agent (377.179 µs) : 358, 397
.   : milestone, 377,
iast (511.356 µs) : 489, 533
.   : milestone, 511,
iast_FULL (728.194 µs) : 706, 750
.   : milestone, 728,
iast_GLOBAL (551.544 µs) : 530, 573
.   : milestone, 552,
iast_HARDCODED_SECRET_DISABLED (509.838 µs) : 488, 532
.   : milestone, 510,
iast_INACTIVE (463.844 µs) : 442, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (494.462 µs) : 473, 516
.   : milestone, 494,
tracing (455.075 µs) : 434, 476
.   : milestone, 455,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.003 µs [363.363 µs, 402.644 µs] -
iast 513.112 µs [491.31 µs, 534.913 µs] 130.108 µs (34.0%)
iast_FULL 726.798 µs [704.916 µs, 748.679 µs] 343.794 µs (89.8%)
iast_GLOBAL 567.041 µs [543.838 µs, 590.244 µs] 184.038 µs (48.1%)
iast_HARDCODED_SECRET_DISABLED 510.134 µs [488.58 µs, 531.688 µs] 127.131 µs (33.2%)
iast_INACTIVE 469.879 µs [448.331 µs, 491.428 µs] 86.876 µs (22.7%)
iast_TELEMETRY_OFF 492.564 µs [470.333 µs, 514.795 µs] 109.561 µs (28.6%)
tracing 454.138 µs [433.427 µs, 474.848 µs] 71.134 µs (18.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 377.179 µs [357.641 µs, 396.718 µs] -
iast 511.356 µs [489.382 µs, 533.329 µs] 134.176 µs (35.6%)
iast_FULL 728.194 µs [706.188 µs, 750.199 µs] 351.015 µs (93.1%)
iast_GLOBAL 551.544 µs [529.758 µs, 573.33 µs] 174.365 µs (46.2%)
iast_HARDCODED_SECRET_DISABLED 509.838 µs [487.716 µs, 531.96 µs] 132.659 µs (35.2%)
iast_INACTIVE 463.844 µs [442.078 µs, 485.609 µs] 86.665 µs (23.0%)
iast_TELEMETRY_OFF 494.462 µs [473.133 µs, 515.792 µs] 117.283 µs (31.1%)
tracing 455.075 µs [433.979 µs, 476.171 µs] 77.896 µs (20.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.345 ms) : 1325, 1364
.   : milestone, 1345,
appsec (1.719 ms) : 1696, 1743
.   : milestone, 1719,
appsec_no_iast (1.733 ms) : 1707, 1758
.   : milestone, 1733,
code_origins (1.675 ms) : 1640, 1710
.   : milestone, 1675,
iast (1.499 ms) : 1474, 1525
.   : milestone, 1499,
profiling (1.528 ms) : 1503, 1554
.   : milestone, 1528,
tracing (1.477 ms) : 1453, 1501
.   : milestone, 1477,
section candidate
no_agent (1.347 ms) : 1328, 1366
.   : milestone, 1347,
appsec (1.711 ms) : 1688, 1735
.   : milestone, 1711,
appsec_no_iast (1.72 ms) : 1695, 1744
.   : milestone, 1720,
code_origins (1.689 ms) : 1656, 1722
.   : milestone, 1689,
iast (1.527 ms) : 1502, 1551
.   : milestone, 1527,
profiling (1.533 ms) : 1508, 1558
.   : milestone, 1533,
tracing (1.495 ms) : 1470, 1521
.   : milestone, 1495,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.345 ms [1.325 ms, 1.364 ms] -
appsec 1.719 ms [1.696 ms, 1.743 ms] 374.575 µs (27.9%)
appsec_no_iast 1.733 ms [1.707 ms, 1.758 ms] 388.105 µs (28.9%)
code_origins 1.675 ms [1.64 ms, 1.71 ms] 330.384 µs (24.6%)
iast 1.499 ms [1.474 ms, 1.525 ms] 154.848 µs (11.5%)
profiling 1.528 ms [1.503 ms, 1.554 ms] 183.847 µs (13.7%)
tracing 1.477 ms [1.453 ms, 1.501 ms] 132.118 µs (9.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.347 ms [1.328 ms, 1.366 ms] -
appsec 1.711 ms [1.688 ms, 1.735 ms] 364.36 µs (27.0%)
appsec_no_iast 1.72 ms [1.695 ms, 1.744 ms] 372.517 µs (27.7%)
code_origins 1.689 ms [1.656 ms, 1.722 ms] 342.039 µs (25.4%)
iast 1.527 ms [1.502 ms, 1.551 ms] 179.556 µs (13.3%)
profiling 1.533 ms [1.508 ms, 1.558 ms] 186.294 µs (13.8%)
tracing 1.495 ms [1.47 ms, 1.521 ms] 148.401 µs (11.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/llmobs-java-sdk-integration
git_commit_date 1741356784 1741356536
git_commit_sha 2575c71 48b1a07
release_version 1.48.0-SNAPSHOT~2575c713ad 1.48.0-SNAPSHOT~48b1a07b21
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741358516 1741358516
ci_job_id 837869646 837869646
ci_pipeline_id 58087590 58087590
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zlbmypnu-project-304-concurrent-0-8ftipg8j 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zlbmypnu-project-304-concurrent-0-8ftipg8j 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.458 s) : 15458000, 15458000
.   : milestone, 15458000,
appsec (14.93 s) : 14930000, 14930000
.   : milestone, 14930000,
iast (18.336 s) : 18336000, 18336000
.   : milestone, 18336000,
iast_GLOBAL (18.236 s) : 18236000, 18236000
.   : milestone, 18236000,
profiling (15.094 s) : 15094000, 15094000
.   : milestone, 15094000,
tracing (15.01 s) : 15010000, 15010000
.   : milestone, 15010000,
section candidate
no_agent (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
appsec (14.939 s) : 14939000, 14939000
.   : milestone, 14939000,
iast (18.689 s) : 18689000, 18689000
.   : milestone, 18689000,
iast_GLOBAL (18.056 s) : 18056000, 18056000
.   : milestone, 18056000,
profiling (15.596 s) : 15596000, 15596000
.   : milestone, 15596000,
tracing (14.81 s) : 14810000, 14810000
.   : milestone, 14810000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.458 s [15.458 s, 15.458 s] -
appsec 14.93 s [14.93 s, 14.93 s] -528.0 ms (-3.4%)
iast 18.336 s [18.336 s, 18.336 s] 2.878 s (18.6%)
iast_GLOBAL 18.236 s [18.236 s, 18.236 s] 2.778 s (18.0%)
profiling 15.094 s [15.094 s, 15.094 s] -364.0 ms (-2.4%)
tracing 15.01 s [15.01 s, 15.01 s] -448.0 ms (-2.9%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.957 s [14.957 s, 14.957 s] -
appsec 14.939 s [14.939 s, 14.939 s] -18.0 ms (-0.1%)
iast 18.689 s [18.689 s, 18.689 s] 3.732 s (25.0%)
iast_GLOBAL 18.056 s [18.056 s, 18.056 s] 3.099 s (20.7%)
profiling 15.596 s [15.596 s, 15.596 s] 639.0 ms (4.3%)
tracing 14.81 s [14.81 s, 14.81 s] -147.0 ms (-1.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~48b1a07b21, baseline=1.48.0-SNAPSHOT~2575c713ad
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.322 ms) : 2279, 2365
.   : milestone, 2322,
iast (2.105 ms) : 2050, 2160
.   : milestone, 2105,
iast_GLOBAL (2.153 ms) : 2097, 2208
.   : milestone, 2153,
profiling (1.971 ms) : 1927, 2016
.   : milestone, 1971,
tracing (1.946 ms) : 1904, 1988
.   : milestone, 1946,
section candidate
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.314 ms) : 2271, 2357
.   : milestone, 2314,
iast (2.103 ms) : 2048, 2158
.   : milestone, 2103,
iast_GLOBAL (2.15 ms) : 2095, 2205
.   : milestone, 2150,
profiling (1.977 ms) : 1932, 2021
.   : milestone, 1977,
tracing (1.944 ms) : 1902, 1986
.   : milestone, 1944,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.322 ms [2.279 ms, 2.365 ms] 851.946 µs (57.9%)
iast 2.105 ms [2.05 ms, 2.16 ms] 635.141 µs (43.2%)
iast_GLOBAL 2.153 ms [2.097 ms, 2.208 ms] 682.426 µs (46.4%)
profiling 1.971 ms [1.927 ms, 2.016 ms] 500.869 µs (34.1%)
tracing 1.946 ms [1.904 ms, 1.988 ms] 475.862 µs (32.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.314 ms [2.271 ms, 2.357 ms] 843.591 µs (57.4%)
iast 2.103 ms [2.048 ms, 2.158 ms] 632.94 µs (43.1%)
iast_GLOBAL 2.15 ms [2.095 ms, 2.205 ms] 679.795 µs (46.2%)
profiling 1.977 ms [1.932 ms, 2.021 ms] 506.665 µs (34.5%)
tracing 1.944 ms [1.902 ms, 1.986 ms] 473.735 µs (32.2%)

@gary-huang gary-huang force-pushed the gary/llmobs-java-sdk-integration branch from 058de60 to 612fd71 Compare March 7, 2025 03:37
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

2 similar comments
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

@gary-huang gary-huang force-pushed the gary/llmobs-java-sdk-integration branch from e320771 to b14ebed Compare March 7, 2025 12:36
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

gary-huang added 16 commits March 7, 2025 08:34
@gary-huang
add llm message class to support llm spans
6e250a2
@gary-huang
add llm message class to support llm spans
4bb9235
@gary-huang
impl llmobs agent and llmobs apis
860fb45
@gary-huang
support llm messages with tool calls
d9a57b3
@gary-huang
impl llmobs agent
8e14214
@gary-huang
working writer
de38297
@gary-huang
add support for llm message and tool calls
dad55c7
@gary-huang
working writer
fd81dc7
@gary-huang
working writer
aa5502d
@gary-huang
working writer
0f0936f
@gary-huang
working writer
f3f9682
@gary-huang
use trace ID to map to individual stacks of active contexts
c390963
@gary-huang
Merge branch 'gary/add-llm-obs-api' into gary/llmobs-java-sdk-integra…
63a5ad2 
…tion
@gary-huang
Merge branch 'gary/impl-llm-obs-api' into gary/llmobs-java-sdk-integr…
98fb7a4 
…ation
@gary-huang
Merge branch 'gary/add-llm-obs-writer' into gary/llmobs-java-sdk-inte…
dc0ca86 
…gration
@gary-huang
Merge branch 'gary/add-llmobs-svc-functionalities-traceid' into gary/…
48b1a07 
…llmobs-java-sdk-integration
@gary-huang gary-huang force-pushed the gary/llmobs-java-sdk-integration branch from b14ebed to 48b1a07 Compare March 7, 2025 14:09
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Mar 7, 2025

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gary-huang