Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gary/add llmobs svc functionalities traceid #8505

Draft
wants to merge 5 commits into
base: gary/add-llm-obs-writer
Choose a base branch
from
Draft

Gary/add llmobs svc functionalities traceid #8505

wants to merge 5 commits into from

Conversation

gary-huang
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0b4f8a8 to 738eb77 Compare March 4, 2025 16:17
@pr-commenter
Copy link

pr-commenter bot commented Mar 4, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1741344572 1741356473
git_commit_sha b34cd6d c390963
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~c390963ea7
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741358773 1741358773
ci_job_id 837865769 837865769
ci_pipeline_id 58087282 58087282
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-tqhmghwg-project-304-concurrent-0-csxic0l6 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-tqhmghwg-project-304-concurrent-0-csxic0l6 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 5 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1042667
Total [baseline] (10.467 s) : 0, 10467453
Agent [candidate] (1.04 s) : 0, 1039913
Total [candidate] (10.539 s) : 0, 10539051
section appsec
Agent [baseline] (1.185 s) : 0, 1184546
Total [baseline] (10.782 s) : 0, 10781987
Agent [candidate] (1.184 s) : 0, 1184145
Total [candidate] (10.76 s) : 0, 10759535
section iast
Agent [baseline] (1.187 s) : 0, 1187350
Total [baseline] (11.087 s) : 0, 11086880
Agent [candidate] (1.181 s) : 0, 1181463
Total [candidate] (10.996 s) : 0, 10995697
section profiling
Agent [baseline] (1.265 s) : 0, 1265094
Total [baseline] (10.86 s) : 0, 10860398
Agent [candidate] (1.264 s) : 0, 1263772
Total [candidate] (10.99 s) : 0, 10990294
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.185 s 141.879 ms (13.6%)
Agent iast 1.187 s 144.683 ms (13.9%)
Agent profiling 1.265 s 222.426 ms (21.3%)
Total tracing 10.467 s -
Total appsec 10.782 s 314.534 ms (3.0%)
Total iast 11.087 s 619.427 ms (5.9%)
Total profiling 10.86 s 392.945 ms (3.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.184 s 144.231 ms (13.9%)
Agent iast 1.181 s 141.55 ms (13.6%)
Agent profiling 1.264 s 223.858 ms (21.5%)
Total tracing 10.539 s -
Total appsec 10.76 s 220.484 ms (2.1%)
Total iast 10.996 s 456.646 ms (4.3%)
Total profiling 10.99 s 451.244 ms (4.3%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.108 ms) : 0, 718108
BytebuddyAgent [candidate] (717.291 ms) : 0, 717291
GlobalTracer [baseline] (239.933 ms) : 0, 239933
GlobalTracer [candidate] (240.261 ms) : 0, 240261
AppSec [baseline] (55.348 ms) : 0, 55348
AppSec [candidate] (55.181 ms) : 0, 55181
Remote Config [baseline] (695.696 µs) : 0, 696
Remote Config [candidate] (691.068 µs) : 0, 691
Telemetry [baseline] (13.665 ms) : 0, 13665
Telemetry [candidate] (11.54 ms) : 0, 11540
section appsec
BytebuddyAgent [baseline] (736.789 ms) : 0, 736789
BytebuddyAgent [candidate] (735.453 ms) : 0, 735453
GlobalTracer [baseline] (236.599 ms) : 0, 236599
GlobalTracer [candidate] (236.58 ms) : 0, 236580
IAST [baseline] (21.524 ms) : 0, 21524
IAST [candidate] (21.654 ms) : 0, 21654
AppSec [baseline] (176.467 ms) : 0, 176467
AppSec [candidate] (177.36 ms) : 0, 177360
Remote Config [baseline] (658.84 µs) : 0, 659
Remote Config [candidate] (663.213 µs) : 0, 663
Telemetry [baseline] (8.259 ms) : 0, 8259
Telemetry [candidate] (8.293 ms) : 0, 8293
section iast
BytebuddyAgent [baseline] (849.278 ms) : 0, 849278
BytebuddyAgent [candidate] (845.028 ms) : 0, 845028
GlobalTracer [baseline] (232.917 ms) : 0, 232917
GlobalTracer [candidate] (231.798 ms) : 0, 231798
IAST [baseline] (23.112 ms) : 0, 23112
IAST [candidate] (23.236 ms) : 0, 23236
AppSec [baseline] (57.482 ms) : 0, 57482
AppSec [candidate] (56.942 ms) : 0, 56942
Remote Config [baseline] (625.346 µs) : 0, 625
Remote Config [candidate] (624.927 µs) : 0, 625
Telemetry [baseline] (8.823 ms) : 0, 8823
Telemetry [candidate] (8.702 ms) : 0, 8702
section profiling
BytebuddyAgent [baseline] (710.51 ms) : 0, 710510
BytebuddyAgent [candidate] (710.849 ms) : 0, 710849
GlobalTracer [baseline] (352.263 ms) : 0, 352263
GlobalTracer [candidate] (351.311 ms) : 0, 351311
AppSec [baseline] (55.228 ms) : 0, 55228
AppSec [candidate] (54.59 ms) : 0, 54590
Remote Config [baseline] (672.68 µs) : 0, 673
Remote Config [candidate] (679.487 µs) : 0, 679
Telemetry [baseline] (9.008 ms) : 0, 9008
Telemetry [candidate] (9.016 ms) : 0, 9016
ProfilingAgent [baseline] (96.957 ms) : 0, 96957
ProfilingAgent [candidate] (96.901 ms) : 0, 96901
Profiling [baseline] (96.982 ms) : 0, 96982
Profiling [candidate] (96.925 ms) : 0, 96925
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.037 s) : 0, 1037185
Total [baseline] (8.681 s) : 0, 8681047
Agent [candidate] (1.042 s) : 0, 1041973
Total [candidate] (8.681 s) : 0, 8680633
section iast
Agent [baseline] (1.173 s) : 0, 1172909
Total [baseline] (9.281 s) : 0, 9280655
Agent [candidate] (1.171 s) : 0, 1170987
Total [candidate] (9.267 s) : 0, 9267274
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.172 s) : 0, 1172049
Total [baseline] (9.267 s) : 0, 9266750
Agent [candidate] (1.171 s) : 0, 1171266
Total [candidate] (9.23 s) : 0, 9230386
section iast_TELEMETRY_OFF
Agent [baseline] (1.167 s) : 0, 1166953
Total [baseline] (9.272 s) : 0, 9271715
Agent [candidate] (1.177 s) : 0, 1176775
Total [candidate] (9.322 s) : 0, 9322459
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.037 s -
Agent iast 1.173 s 135.724 ms (13.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 134.864 ms (13.0%)
Agent iast_TELEMETRY_OFF 1.167 s 129.769 ms (12.5%)
Total tracing 8.681 s -
Total iast 9.281 s 599.608 ms (6.9%)
Total iast_HARDCODED_SECRET_DISABLED 9.267 s 585.703 ms (6.7%)
Total iast_TELEMETRY_OFF 9.272 s 590.668 ms (6.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.171 s 129.015 ms (12.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 129.293 ms (12.4%)
Agent iast_TELEMETRY_OFF 1.177 s 134.802 ms (12.9%)
Total tracing 8.681 s -
Total iast 9.267 s 586.641 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.23 s 549.752 ms (6.3%)
Total iast_TELEMETRY_OFF 9.322 s 641.826 ms (7.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.976 ms) : 0, 715976
BytebuddyAgent [candidate] (717.83 ms) : 0, 717830
GlobalTracer [baseline] (239.16 ms) : 0, 239160
GlobalTracer [candidate] (239.784 ms) : 0, 239784
AppSec [baseline] (54.991 ms) : 0, 54991
AppSec [candidate] (55.175 ms) : 0, 55175
Remote Config [baseline] (681.598 µs) : 0, 682
Remote Config [candidate] (701.848 µs) : 0, 702
Telemetry [baseline] (11.422 ms) : 0, 11422
Telemetry [candidate] (13.524 ms) : 0, 13524
section iast
BytebuddyAgent [baseline] (838.01 ms) : 0, 838010
BytebuddyAgent [candidate] (836.937 ms) : 0, 836937
GlobalTracer [baseline] (230.431 ms) : 0, 230431
GlobalTracer [candidate] (230.151 ms) : 0, 230151
IAST [baseline] (23.791 ms) : 0, 23791
IAST [candidate] (22.729 ms) : 0, 22729
AppSec [baseline] (56.222 ms) : 0, 56222
AppSec [candidate] (56.759 ms) : 0, 56759
Remote Config [baseline] (617.171 µs) : 0, 617
Remote Config [candidate] (618.864 µs) : 0, 619
Telemetry [baseline] (8.846 ms) : 0, 8846
Telemetry [candidate] (8.765 ms) : 0, 8765
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (837.269 ms) : 0, 837269
BytebuddyAgent [candidate] (837.095 ms) : 0, 837095
GlobalTracer [baseline] (230.936 ms) : 0, 230936
GlobalTracer [candidate] (229.854 ms) : 0, 229854
IAST [baseline] (22.839 ms) : 0, 22839
IAST [candidate] (23.085 ms) : 0, 23085
AppSec [baseline] (56.695 ms) : 0, 56695
AppSec [candidate] (56.694 ms) : 0, 56694
Remote Config [baseline] (610.502 µs) : 0, 611
Remote Config [candidate] (615.865 µs) : 0, 616
Telemetry [baseline] (8.702 ms) : 0, 8702
Telemetry [candidate] (8.797 ms) : 0, 8797
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (833.375 ms) : 0, 833375
BytebuddyAgent [candidate] (839.635 ms) : 0, 839635
GlobalTracer [baseline] (230.48 ms) : 0, 230480
GlobalTracer [candidate] (232.529 ms) : 0, 232529
IAST [baseline] (23.16 ms) : 0, 23160
IAST [candidate] (22.86 ms) : 0, 22860
AppSec [baseline] (55.757 ms) : 0, 55757
AppSec [candidate] (57.256 ms) : 0, 57256
Remote Config [baseline] (608.347 µs) : 0, 608
Remote Config [candidate] (626.508 µs) : 0, 627
Telemetry [baseline] (8.597 ms) : 0, 8597
Telemetry [candidate] (8.8 ms) : 0, 8800
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-07T14:16:23 2025-03-07T14:24:08
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1741344572 1741356473
git_commit_sha b34cd6d c390963
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~c390963ea7
start_time 2025-03-07T14:16:09 2025-03-07T14:23:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741357847 1741357847
ci_job_id 837865771 837865771
ci_pipeline_id 58087282 58087282
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-tqhmghwg-project-304-concurrent-2-k8yyj1jc 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-tqhmghwg-project-304-concurrent-2-k8yyj1jc 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.169 µs) : 364, 404
.   : milestone, 384,
iast (512.885 µs) : 491, 535
.   : milestone, 513,
iast_FULL (725.352 µs) : 703, 747
.   : milestone, 725,
iast_GLOBAL (556.727 µs) : 535, 578
.   : milestone, 557,
iast_HARDCODED_SECRET_DISABLED (509.925 µs) : 488, 532
.   : milestone, 510,
iast_INACTIVE (463.737 µs) : 442, 486
.   : milestone, 464,
iast_TELEMETRY_OFF (498.887 µs) : 477, 521
.   : milestone, 499,
tracing (456.41 µs) : 435, 478
.   : milestone, 456,
section candidate
no_agent (374.627 µs) : 355, 395
.   : milestone, 375,
iast (514.669 µs) : 492, 538
.   : milestone, 515,
iast_FULL (730.464 µs) : 708, 753
.   : milestone, 730,
iast_GLOBAL (563.068 µs) : 540, 586
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (518.172 µs) : 496, 540
.   : milestone, 518,
iast_INACTIVE (461.469 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (494.911 µs) : 472, 517
.   : milestone, 495,
tracing (459.576 µs) : 438, 481
.   : milestone, 460,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.169 µs [364.43 µs, 403.909 µs] -
iast 512.885 µs [491.04 µs, 534.73 µs] 128.716 µs (33.5%)
iast_FULL 725.352 µs [703.444 µs, 747.26 µs] 341.183 µs (88.8%)
iast_GLOBAL 556.727 µs [535.113 µs, 578.341 µs] 172.557 µs (44.9%)
iast_HARDCODED_SECRET_DISABLED 509.925 µs [488.207 µs, 531.644 µs] 125.756 µs (32.7%)
iast_INACTIVE 463.737 µs [441.937 µs, 485.537 µs] 79.567 µs (20.7%)
iast_TELEMETRY_OFF 498.887 µs [476.999 µs, 520.774 µs] 114.717 µs (29.9%)
tracing 456.41 µs [434.947 µs, 477.872 µs] 72.24 µs (18.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.627 µs [354.654 µs, 394.6 µs] -
iast 514.669 µs [491.505 µs, 537.832 µs] 140.042 µs (37.4%)
iast_FULL 730.464 µs [708.254 µs, 752.673 µs] 355.837 µs (95.0%)
iast_GLOBAL 563.068 µs [540.08 µs, 586.055 µs] 188.441 µs (50.3%)
iast_HARDCODED_SECRET_DISABLED 518.172 µs [496.372 µs, 539.972 µs] 143.545 µs (38.3%)
iast_INACTIVE 461.469 µs [440.017 µs, 482.922 µs] 86.843 µs (23.2%)
iast_TELEMETRY_OFF 494.911 µs [472.457 µs, 517.365 µs] 120.284 µs (32.1%)
tracing 459.576 µs [437.845 µs, 481.306 µs] 84.949 µs (22.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.34 ms) : 1320, 1360
.   : milestone, 1340,
appsec (1.747 ms) : 1724, 1770
.   : milestone, 1747,
appsec_no_iast (1.724 ms) : 1699, 1750
.   : milestone, 1724,
code_origins (1.684 ms) : 1651, 1718
.   : milestone, 1684,
iast (1.525 ms) : 1501, 1549
.   : milestone, 1525,
profiling (1.547 ms) : 1522, 1572
.   : milestone, 1547,
tracing (1.485 ms) : 1460, 1510
.   : milestone, 1485,
section candidate
no_agent (1.353 ms) : 1333, 1373
.   : milestone, 1353,
appsec (1.742 ms) : 1717, 1767
.   : milestone, 1742,
appsec_no_iast (1.746 ms) : 1722, 1770
.   : milestone, 1746,
code_origins (1.684 ms) : 1651, 1718
.   : milestone, 1684,
iast (1.508 ms) : 1483, 1533
.   : milestone, 1508,
profiling (1.556 ms) : 1530, 1581
.   : milestone, 1556,
tracing (1.501 ms) : 1475, 1526
.   : milestone, 1501,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.34 ms [1.32 ms, 1.36 ms] -
appsec 1.747 ms [1.724 ms, 1.77 ms] 407.212 µs (30.4%)
appsec_no_iast 1.724 ms [1.699 ms, 1.75 ms] 384.209 µs (28.7%)
code_origins 1.684 ms [1.651 ms, 1.718 ms] 344.33 µs (25.7%)
iast 1.525 ms [1.501 ms, 1.549 ms] 184.886 µs (13.8%)
profiling 1.547 ms [1.522 ms, 1.572 ms] 207.146 µs (15.5%)
tracing 1.485 ms [1.46 ms, 1.51 ms] 144.916 µs (10.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.353 ms [1.333 ms, 1.373 ms] -
appsec 1.742 ms [1.717 ms, 1.767 ms] 388.635 µs (28.7%)
appsec_no_iast 1.746 ms [1.722 ms, 1.77 ms] 393.171 µs (29.1%)
code_origins 1.684 ms [1.651 ms, 1.718 ms] 331.3 µs (24.5%)
iast 1.508 ms [1.483 ms, 1.533 ms] 154.699 µs (11.4%)
profiling 1.556 ms [1.53 ms, 1.581 ms] 202.607 µs (15.0%)
tracing 1.501 ms [1.475 ms, 1.526 ms] 147.438 µs (10.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/add-llmobs-svc-functionalities-traceid
git_commit_date 1741344572 1741356473
git_commit_sha b34cd6d c390963
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~c390963ea7
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741358331 1741358331
ci_job_id 837865772 837865772
ci_pipeline_id 58087282 58087282
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-tqhmghwg-project-304-concurrent-4-a01k7l7b 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-tqhmghwg-project-304-concurrent-4-a01k7l7b 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.063 s) : 15063000, 15063000
.   : milestone, 15063000,
appsec (15.063 s) : 15063000, 15063000
.   : milestone, 15063000,
iast (19.05 s) : 19050000, 19050000
.   : milestone, 19050000,
iast_GLOBAL (18.31 s) : 18310000, 18310000
.   : milestone, 18310000,
profiling (14.992 s) : 14992000, 14992000
.   : milestone, 14992000,
tracing (14.824 s) : 14824000, 14824000
.   : milestone, 14824000,
section candidate
no_agent (14.955 s) : 14955000, 14955000
.   : milestone, 14955000,
appsec (14.898 s) : 14898000, 14898000
.   : milestone, 14898000,
iast (19.202 s) : 19202000, 19202000
.   : milestone, 19202000,
iast_GLOBAL (17.634 s) : 17634000, 17634000
.   : milestone, 17634000,
profiling (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
tracing (14.907 s) : 14907000, 14907000
.   : milestone, 14907000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.063 s [15.063 s, 15.063 s] -
appsec 15.063 s [15.063 s, 15.063 s] 0.0 µs (0.0%)
iast 19.05 s [19.05 s, 19.05 s] 3.987 s (26.5%)
iast_GLOBAL 18.31 s [18.31 s, 18.31 s] 3.247 s (21.6%)
profiling 14.992 s [14.992 s, 14.992 s] -71.0 ms (-0.5%)
tracing 14.824 s [14.824 s, 14.824 s] -239.0 ms (-1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.955 s [14.955 s, 14.955 s] -
appsec 14.898 s [14.898 s, 14.898 s] -57.0 ms (-0.4%)
iast 19.202 s [19.202 s, 19.202 s] 4.247 s (28.4%)
iast_GLOBAL 17.634 s [17.634 s, 17.634 s] 2.679 s (17.9%)
profiling 15.041 s [15.041 s, 15.041 s] 86.0 ms (0.6%)
tracing 14.907 s [14.907 s, 14.907 s] -48.0 ms (-0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~c390963ea7, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.344 ms) : 2301, 2388
.   : milestone, 2344,
iast (2.108 ms) : 2053, 2163
.   : milestone, 2108,
iast_GLOBAL (2.162 ms) : 2106, 2218
.   : milestone, 2162,
profiling (1.959 ms) : 1916, 2002
.   : milestone, 1959,
tracing (1.957 ms) : 1914, 1999
.   : milestone, 1957,
section candidate
no_agent (1.475 ms) : 1463, 1487
.   : milestone, 1475,
appsec (2.339 ms) : 2296, 2382
.   : milestone, 2339,
iast (2.113 ms) : 2058, 2168
.   : milestone, 2113,
iast_GLOBAL (2.156 ms) : 2100, 2211
.   : milestone, 2156,
profiling (1.971 ms) : 1926, 2015
.   : milestone, 1971,
tracing (1.957 ms) : 1915, 2000
.   : milestone, 1957,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.344 ms [2.301 ms, 2.388 ms] 874.228 µs (59.5%)
iast 2.108 ms [2.053 ms, 2.163 ms] 637.798 µs (43.4%)
iast_GLOBAL 2.162 ms [2.106 ms, 2.218 ms] 691.575 µs (47.0%)
profiling 1.959 ms [1.916 ms, 2.002 ms] 488.749 µs (33.2%)
tracing 1.957 ms [1.914 ms, 1.999 ms] 486.528 µs (33.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.487 ms] -
appsec 2.339 ms [2.296 ms, 2.382 ms] 864.015 µs (58.6%)
iast 2.113 ms [2.058 ms, 2.168 ms] 637.987 µs (43.3%)
iast_GLOBAL 2.156 ms [2.1 ms, 2.211 ms] 680.493 µs (46.1%)
profiling 1.971 ms [1.926 ms, 2.015 ms] 495.704 µs (33.6%)
tracing 1.957 ms [1.915 ms, 2.0 ms] 482.081 µs (32.7%)

@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch 3 times, most recently from 707295a to ebec127 Compare March 5, 2025 19:54
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from f9a3902 to b5d1199 Compare March 5, 2025 20:14
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from ebec127 to f0215ef Compare March 5, 2025 20:35
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from 2080275 to 43a996f Compare March 5, 2025 20:40
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from f0215ef to edeca5c Compare March 5, 2025 21:32
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 3 times, most recently from 592dbc5 to d37b718 Compare March 5, 2025 21:38
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch 2 times, most recently from 0e7c1e5 to 0b04221 Compare March 7, 2025 00:02
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 2 times, most recently from d3dac5f to 1f81260 Compare March 7, 2025 00:05
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0b04221 to 0bf8eb0 Compare March 7, 2025 03:33
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch 4 times, most recently from 2a053a8 to 6f995a0 Compare March 7, 2025 12:31
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 0bf8eb0 to 1d5dcc0 Compare March 7, 2025 13:50
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch from 6f995a0 to 2a57453 Compare March 7, 2025 13:54
@gary-huang gary-huang force-pushed the gary/add-llm-obs-writer branch from 1d5dcc0 to dad55c7 Compare March 7, 2025 14:07
@gary-huang gary-huang force-pushed the gary/add-llmobs-svc-functionalities-traceid branch from 2a57453 to c390963 Compare March 7, 2025 14:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gary-huang