Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Gary/impl llm obs api #8390

Draft
wants to merge 3 commits into
base: gary/add-llm-obs-api
Choose a base branch
from
Draft

Gary/impl llm obs api #8390

wants to merge 3 commits into from

Conversation

gary-huang
Copy link
Contributor

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch from 3bcbe81 to c437b9c Compare February 19, 2025 14:47
@pr-commenter
Copy link

pr-commenter bot commented Feb 19, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/impl-llm-obs-api
git_commit_date 1741344572 1741356402
git_commit_sha b34cd6d d9a57b3
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~d9a57b3b24
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741358669 1741358669
ci_job_id 837863903 837863903
ci_pipeline_id 58087104 58087104
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-j57kgy2v-project-304-concurrent-1-1011i9ly 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-j57kgy2v-project-304-concurrent-1-1011i9ly 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 60 metrics, 3 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.04 s) : 0, 1040385
Total [baseline] (10.453 s) : 0, 10452824
Agent [candidate] (1.041 s) : 0, 1041374
Total [candidate] (10.412 s) : 0, 10412438
section appsec
Agent [baseline] (1.18 s) : 0, 1179990
Total [baseline] (10.73 s) : 0, 10729960
Agent [candidate] (1.182 s) : 0, 1182326
Total [candidate] (10.736 s) : 0, 10736479
section iast
Agent [baseline] (1.171 s) : 0, 1170970
Total [baseline] (10.952 s) : 0, 10952160
Agent [candidate] (1.193 s) : 0, 1193190
Total [candidate] (11.035 s) : 0, 11034586
section profiling
Agent [baseline] (1.257 s) : 0, 1257399
Total [baseline] (10.831 s) : 0, 10830586
Agent [candidate] (1.259 s) : 0, 1258651
Total [candidate] (10.903 s) : 0, 10903041
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.18 s 139.605 ms (13.4%)
Agent iast 1.171 s 130.584 ms (12.6%)
Agent profiling 1.257 s 217.014 ms (20.9%)
Total tracing 10.453 s -
Total appsec 10.73 s 277.137 ms (2.7%)
Total iast 10.952 s 499.336 ms (4.8%)
Total profiling 10.831 s 377.762 ms (3.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.041 s -
Agent appsec 1.182 s 140.952 ms (13.5%)
Agent iast 1.193 s 151.816 ms (14.6%)
Agent profiling 1.259 s 217.277 ms (20.9%)
Total tracing 10.412 s -
Total appsec 10.736 s 324.04 ms (3.1%)
Total iast 11.035 s 622.148 ms (6.0%)
Total profiling 10.903 s 490.603 ms (4.7%) 
gantt
    title petclinic - break down per module: candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.903 ms) : 0, 715903
BytebuddyAgent [candidate] (717.632 ms) : 0, 717632
GlobalTracer [baseline] (239.124 ms) : 0, 239124
GlobalTracer [candidate] (239.862 ms) : 0, 239862
AppSec [baseline] (55.486 ms) : 0, 55486
AppSec [candidate] (55.338 ms) : 0, 55338
Remote Config [baseline] (687.389 µs) : 0, 687
Remote Config [candidate] (689.199 µs) : 0, 689
Telemetry [baseline] (14.277 ms) : 0, 14277
Telemetry [candidate] (12.901 ms) : 0, 12901
section appsec
BytebuddyAgent [baseline] (733.137 ms) : 0, 733137
BytebuddyAgent [candidate] (735.075 ms) : 0, 735075
GlobalTracer [baseline] (236.158 ms) : 0, 236158
GlobalTracer [candidate] (236.456 ms) : 0, 236456
AppSec [baseline] (176.147 ms) : 0, 176147
AppSec [candidate] (176.1 ms) : 0, 176100
Remote Config [baseline] (651.878 µs) : 0, 652
Remote Config [candidate] (669.787 µs) : 0, 670
Telemetry [baseline] (8.265 ms) : 0, 8265
Telemetry [candidate] (8.284 ms) : 0, 8284
IAST [baseline] (21.556 ms) : 0, 21556
IAST [candidate] (21.56 ms) : 0, 21560
section iast
BytebuddyAgent [baseline] (836.338 ms) : 0, 836338
BytebuddyAgent [candidate] (852.742 ms) : 0, 852742
GlobalTracer [baseline] (230.466 ms) : 0, 230466
GlobalTracer [candidate] (234.162 ms) : 0, 234162
AppSec [baseline] (56.852 ms) : 0, 56852
AppSec [candidate] (57.749 ms) : 0, 57749
Remote Config [baseline] (616.282 µs) : 0, 616
Remote Config [candidate] (652.286 µs) : 0, 652
Telemetry [baseline] (8.759 ms) : 0, 8759
Telemetry [candidate] (8.992 ms) : 0, 8992
IAST [baseline] (23.022 ms) : 0, 23022
IAST [candidate] (23.64 ms) : 0, 23640
section profiling
BytebuddyAgent [baseline] (708.241 ms) : 0, 708241
BytebuddyAgent [candidate] (709.357 ms) : 0, 709357
GlobalTracer [baseline] (349.086 ms) : 0, 349086
GlobalTracer [candidate] (349.414 ms) : 0, 349414
AppSec [baseline] (54.515 ms) : 0, 54515
AppSec [candidate] (53.951 ms) : 0, 53951
Remote Config [baseline] (668.605 µs) : 0, 669
Remote Config [candidate] (685.587 µs) : 0, 686
Telemetry [baseline] (8.929 ms) : 0, 8929
Telemetry [candidate] (9.003 ms) : 0, 9003
ProfilingAgent [baseline] (95.591 ms) : 0, 95591
ProfilingAgent [candidate] (95.674 ms) : 0, 95674
Profiling [baseline] (95.616 ms) : 0, 95616
Profiling [candidate] (95.698 ms) : 0, 95698
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.039 s) : 0, 1038696
Total [baseline] (8.646 s) : 0, 8645732
Agent [candidate] (1.047 s) : 0, 1046976
Total [candidate] (8.673 s) : 0, 8673368
section iast
Agent [baseline] (1.184 s) : 0, 1183895
Total [baseline] (9.262 s) : 0, 9261808
Agent [candidate] (1.179 s) : 0, 1179039
Total [candidate] (9.246 s) : 0, 9245804
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.178 s) : 0, 1177856
Total [baseline] (9.186 s) : 0, 9185816
Agent [candidate] (1.18 s) : 0, 1179648
Total [candidate] (9.222 s) : 0, 9221933
section iast_TELEMETRY_OFF
Agent [baseline] (1.171 s) : 0, 1171107
Total [baseline] (9.221 s) : 0, 9221325
Agent [candidate] (1.168 s) : 0, 1167539
Total [candidate] (9.231 s) : 0, 9231284
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent iast 1.184 s 145.199 ms (14.0%)
Agent iast_HARDCODED_SECRET_DISABLED 1.178 s 139.16 ms (13.4%)
Agent iast_TELEMETRY_OFF 1.171 s 132.411 ms (12.7%)
Total tracing 8.646 s -
Total iast 9.262 s 616.076 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.186 s 540.084 ms (6.2%)
Total iast_TELEMETRY_OFF 9.221 s 575.593 ms (6.7%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.047 s -
Agent iast 1.179 s 132.063 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.18 s 132.671 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.168 s 120.563 ms (11.5%)
Total tracing 8.673 s -
Total iast 9.246 s 572.436 ms (6.6%)
Total iast_HARDCODED_SECRET_DISABLED 9.222 s 548.564 ms (6.3%)
Total iast_TELEMETRY_OFF 9.231 s 557.916 ms (6.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (715.964 ms) : 0, 715964
BytebuddyAgent [candidate] (722.517 ms) : 0, 722517
GlobalTracer [baseline] (238.972 ms) : 0, 238972
GlobalTracer [candidate] (240.887 ms) : 0, 240887
AppSec [baseline] (55.181 ms) : 0, 55181
AppSec [candidate] (55.683 ms) : 0, 55683
Remote Config [baseline] (688.82 µs) : 0, 689
Remote Config [candidate] (694.34 µs) : 0, 694
Telemetry [baseline] (12.978 ms) : 0, 12978
Telemetry [candidate] (12.191 ms) : 0, 12191
section iast
BytebuddyAgent [baseline] (847.113 ms) : 0, 847113
BytebuddyAgent [candidate] (844.529 ms) : 0, 844529
GlobalTracer [baseline] (231.947 ms) : 0, 231947
GlobalTracer [candidate] (230.821 ms) : 0, 230821
IAST [baseline] (23.399 ms) : 0, 23399
IAST [candidate] (22.713 ms) : 0, 22713
AppSec [baseline] (56.948 ms) : 0, 56948
AppSec [candidate] (56.639 ms) : 0, 56639
Remote Config [baseline] (625.584 µs) : 0, 626
Remote Config [candidate] (621.545 µs) : 0, 622
Telemetry [baseline] (8.737 ms) : 0, 8737
Telemetry [candidate] (8.716 ms) : 0, 8716
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (842.186 ms) : 0, 842186
BytebuddyAgent [candidate] (843.423 ms) : 0, 843423
GlobalTracer [baseline] (230.796 ms) : 0, 230796
GlobalTracer [candidate] (231.577 ms) : 0, 231577
IAST [baseline] (23.208 ms) : 0, 23208
IAST [candidate] (23.057 ms) : 0, 23057
AppSec [baseline] (57.189 ms) : 0, 57189
AppSec [candidate] (57.121 ms) : 0, 57121
Remote Config [baseline] (622.448 µs) : 0, 622
Remote Config [candidate] (621.935 µs) : 0, 622
Telemetry [baseline] (8.82 ms) : 0, 8820
Telemetry [candidate] (8.812 ms) : 0, 8812
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.238 ms) : 0, 835238
BytebuddyAgent [candidate] (834.225 ms) : 0, 834225
GlobalTracer [baseline] (231.813 ms) : 0, 231813
GlobalTracer [candidate] (230.221 ms) : 0, 230221
IAST [baseline] (22.605 ms) : 0, 22605
IAST [candidate] (22.419 ms) : 0, 22419
AppSec [baseline] (57.195 ms) : 0, 57195
AppSec [candidate] (56.535 ms) : 0, 56535
Remote Config [baseline] (620.454 µs) : 0, 620
Remote Config [candidate] (612.596 µs) : 0, 613
Telemetry [baseline] (8.742 ms) : 0, 8742
Telemetry [candidate] (8.639 ms) : 0, 8639
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-07T14:16:52 2025-03-07T14:24:35
git_branch master gary/impl-llm-obs-api
git_commit_date 1741344572 1741356402
git_commit_sha b34cd6d d9a57b3
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~d9a57b3b24
start_time 2025-03-07T14:16:38 2025-03-07T14:24:22
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741357871 1741357871
ci_job_id 837863904 837863904
ci_pipeline_id 58087104 58087104
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-s3yupehv-project-304-concurrent-0-ht9cpr2q 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-s3yupehv-project-304-concurrent-0-ht9cpr2q 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 17 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.367 ms) : 1348, 1386
.   : milestone, 1367,
appsec (1.716 ms) : 1692, 1741
.   : milestone, 1716,
appsec_no_iast (1.742 ms) : 1718, 1767
.   : milestone, 1742,
code_origins (1.689 ms) : 1656, 1721
.   : milestone, 1689,
iast (1.517 ms) : 1493, 1541
.   : milestone, 1517,
profiling (1.543 ms) : 1519, 1567
.   : milestone, 1543,
tracing (1.494 ms) : 1467, 1520
.   : milestone, 1494,
section candidate
no_agent (1.355 ms) : 1335, 1374
.   : milestone, 1355,
appsec (1.722 ms) : 1699, 1746
.   : milestone, 1722,
appsec_no_iast (1.747 ms) : 1723, 1771
.   : milestone, 1747,
code_origins (1.684 ms) : 1651, 1716
.   : milestone, 1684,
iast (1.502 ms) : 1478, 1526
.   : milestone, 1502,
profiling (1.501 ms) : 1478, 1524
.   : milestone, 1501,
tracing (1.494 ms) : 1469, 1518
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.367 ms [1.348 ms, 1.386 ms] -
appsec 1.716 ms [1.692 ms, 1.741 ms] 349.106 µs (25.5%)
appsec_no_iast 1.742 ms [1.718 ms, 1.767 ms] 375.146 µs (27.4%)
code_origins 1.689 ms [1.656 ms, 1.721 ms] 321.467 µs (23.5%)
iast 1.517 ms [1.493 ms, 1.541 ms] 149.751 µs (11.0%)
profiling 1.543 ms [1.519 ms, 1.567 ms] 175.931 µs (12.9%)
tracing 1.494 ms [1.467 ms, 1.52 ms] 126.555 µs (9.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.355 ms [1.335 ms, 1.374 ms] -
appsec 1.722 ms [1.699 ms, 1.746 ms] 367.542 µs (27.1%)
appsec_no_iast 1.747 ms [1.723 ms, 1.771 ms] 392.002 µs (28.9%)
code_origins 1.684 ms [1.651 ms, 1.716 ms] 328.804 µs (24.3%)
iast 1.502 ms [1.478 ms, 1.526 ms] 147.458 µs (10.9%)
profiling 1.501 ms [1.478 ms, 1.524 ms] 145.888 µs (10.8%)
tracing 1.494 ms [1.469 ms, 1.518 ms] 138.959 µs (10.3%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (374.176 µs) : 353, 395
.   : milestone, 374,
iast (505.741 µs) : 484, 528
.   : milestone, 506,
iast_FULL (726.131 µs) : 704, 748
.   : milestone, 726,
iast_GLOBAL (550.974 µs) : 529, 573
.   : milestone, 551,
iast_HARDCODED_SECRET_DISABLED (511.618 µs) : 490, 533
.   : milestone, 512,
iast_INACTIVE (459.537 µs) : 438, 481
.   : milestone, 460,
iast_TELEMETRY_OFF (497.137 µs) : 475, 519
.   : milestone, 497,
tracing (457.187 µs) : 435, 479
.   : milestone, 457,
section candidate
no_agent (378.078 µs) : 358, 398
.   : milestone, 378,
iast (504.024 µs) : 482, 526
.   : milestone, 504,
iast_FULL (726.26 µs) : 704, 748
.   : milestone, 726,
iast_GLOBAL (552.603 µs) : 531, 575
.   : milestone, 553,
iast_HARDCODED_SECRET_DISABLED (505.776 µs) : 484, 527
.   : milestone, 506,
iast_INACTIVE (456.503 µs) : 435, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (492.996 µs) : 470, 516
.   : milestone, 493,
tracing (450.811 µs) : 430, 472
.   : milestone, 451,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 374.176 µs [353.162 µs, 395.19 µs] -
iast 505.741 µs [483.912 µs, 527.569 µs] 131.565 µs (35.2%)
iast_FULL 726.131 µs [704.133 µs, 748.13 µs] 351.956 µs (94.1%)
iast_GLOBAL 550.974 µs [529.238 µs, 572.711 µs] 176.798 µs (47.3%)
iast_HARDCODED_SECRET_DISABLED 511.618 µs [489.748 µs, 533.488 µs] 137.442 µs (36.7%)
iast_INACTIVE 459.537 µs [438.238 µs, 480.836 µs] 85.361 µs (22.8%)
iast_TELEMETRY_OFF 497.137 µs [475.142 µs, 519.132 µs] 122.961 µs (32.9%)
tracing 457.187 µs [435.443 µs, 478.93 µs] 83.011 µs (22.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 378.078 µs [358.496 µs, 397.66 µs] -
iast 504.024 µs [482.253 µs, 525.795 µs] 125.946 µs (33.3%)
iast_FULL 726.26 µs [704.26 µs, 748.26 µs] 348.182 µs (92.1%)
iast_GLOBAL 552.603 µs [530.52 µs, 574.685 µs] 174.524 µs (46.2%)
iast_HARDCODED_SECRET_DISABLED 505.776 µs [484.219 µs, 527.334 µs] 127.698 µs (33.8%)
iast_INACTIVE 456.503 µs [435.237 µs, 477.769 µs] 78.425 µs (20.7%)
iast_TELEMETRY_OFF 492.996 µs [470.218 µs, 515.774 µs] 114.918 µs (30.4%)
tracing 450.811 µs [429.848 µs, 471.773 µs] 72.732 µs (19.2%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master gary/impl-llm-obs-api
git_commit_date 1741344572 1741356402
git_commit_sha b34cd6d d9a57b3
release_version 1.48.0-SNAPSHOT~b34cd6dbd9 1.48.0-SNAPSHOT~d9a57b3b24
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741358402 1741358402
ci_job_id 837863905 837863905
ci_pipeline_id 58087104 58087104
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-j57kgy2v-project-304-concurrent-2-fo1hrtdy 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-j57kgy2v-project-304-concurrent-2-fo1hrtdy 6.8.0-1023-aws #25~22.04.1-Ubuntu SMP Tue Jan 28 12:51:22 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1464, 1487
.   : milestone, 1475,
appsec (2.334 ms) : 2291, 2377
.   : milestone, 2334,
iast (2.114 ms) : 2059, 2169
.   : milestone, 2114,
iast_GLOBAL (2.153 ms) : 2098, 2209
.   : milestone, 2153,
profiling (1.949 ms) : 1907, 1992
.   : milestone, 1949,
tracing (1.952 ms) : 1910, 1994
.   : milestone, 1952,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.336 ms) : 2293, 2379
.   : milestone, 2336,
iast (2.102 ms) : 2047, 2156
.   : milestone, 2102,
iast_GLOBAL (2.155 ms) : 2100, 2210
.   : milestone, 2155,
profiling (1.962 ms) : 1918, 2005
.   : milestone, 1962,
tracing (1.945 ms) : 1903, 1987
.   : milestone, 1945,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.464 ms, 1.487 ms] -
appsec 2.334 ms [2.291 ms, 2.377 ms] 858.312 µs (58.2%)
iast 2.114 ms [2.059 ms, 2.169 ms] 638.648 µs (43.3%)
iast_GLOBAL 2.153 ms [2.098 ms, 2.209 ms] 677.944 µs (45.9%)
profiling 1.949 ms [1.907 ms, 1.992 ms] 474.046 µs (32.1%)
tracing 1.952 ms [1.91 ms, 1.994 ms] 476.324 µs (32.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.459 ms, 1.482 ms] -
appsec 2.336 ms [2.293 ms, 2.379 ms] 865.513 µs (58.9%)
iast 2.102 ms [2.047 ms, 2.156 ms] 630.969 µs (42.9%)
iast_GLOBAL 2.155 ms [2.1 ms, 2.21 ms] 683.959 µs (46.5%)
profiling 1.962 ms [1.918 ms, 2.005 ms] 490.944 µs (33.4%)
tracing 1.945 ms [1.903 ms, 1.987 ms] 474.172 µs (32.2%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.48.0-SNAPSHOT~d9a57b3b24, baseline=1.48.0-SNAPSHOT~b34cd6dbd9
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.994 s) : 14994000, 14994000
.   : milestone, 14994000,
appsec (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
iast (18.692 s) : 18692000, 18692000
.   : milestone, 18692000,
iast_GLOBAL (17.949 s) : 17949000, 17949000
.   : milestone, 17949000,
profiling (14.911 s) : 14911000, 14911000
.   : milestone, 14911000,
tracing (15.001 s) : 15001000, 15001000
.   : milestone, 15001000,
section candidate
no_agent (14.704 s) : 14704000, 14704000
.   : milestone, 14704000,
appsec (15.191 s) : 15191000, 15191000
.   : milestone, 15191000,
iast (18.498 s) : 18498000, 18498000
.   : milestone, 18498000,
iast_GLOBAL (17.826 s) : 17826000, 17826000
.   : milestone, 17826000,
profiling (15.196 s) : 15196000, 15196000
.   : milestone, 15196000,
tracing (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.994 s [14.994 s, 14.994 s] -
appsec 15.082 s [15.082 s, 15.082 s] 88.0 ms (0.6%)
iast 18.692 s [18.692 s, 18.692 s] 3.698 s (24.7%)
iast_GLOBAL 17.949 s [17.949 s, 17.949 s] 2.955 s (19.7%)
profiling 14.911 s [14.911 s, 14.911 s] -83.0 ms (-0.6%)
tracing 15.001 s [15.001 s, 15.001 s] 7.0 ms (0.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.704 s [14.704 s, 14.704 s] -
appsec 15.191 s [15.191 s, 15.191 s] 487.0 ms (3.3%)
iast 18.498 s [18.498 s, 18.498 s] 3.794 s (25.8%)
iast_GLOBAL 17.826 s [17.826 s, 17.826 s] 3.122 s (21.2%)
profiling 15.196 s [15.196 s, 15.196 s] 492.0 ms (3.3%)
tracing 14.847 s [14.847 s, 14.847 s] 143.0 ms (1.0%)

@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch 3 times, most recently from 871d358 to 180ccf5 Compare February 20, 2025 21:17
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Looks like you updated a Git Submodule.
If this was not intentional please make sure to:

@gary-huang gary-huang changed the base branch from master to gary/add-llm-obs-api February 20, 2025 21:18
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch 5 times, most recently from 94136c5 to 7064f57 Compare February 20, 2025 23:13
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch 2 times, most recently from 9cb3e0a to 76a4b2f Compare March 5, 2025 19:00
@gary-huang gary-huang force-pushed the gary/add-llm-obs-api branch from 77ddec8 to cb95fbb Compare March 5, 2025 19:04
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch 5 times, most recently from a55367c to 40dcdfe Compare March 6, 2025 20:51
@gary-huang gary-huang force-pushed the gary/add-llm-obs-api branch from 7f41706 to a9ec5dd Compare March 6, 2025 21:05
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch from 40dcdfe to acde475 Compare March 6, 2025 21:07
@gary-huang gary-huang force-pushed the gary/add-llm-obs-api branch from a9ec5dd to c75df4b Compare March 6, 2025 23:01
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch from acde475 to 829ffb1 Compare March 7, 2025 00:00
@gary-huang gary-huang force-pushed the gary/add-llm-obs-api branch 2 times, most recently from c1f63dc to 6e250a2 Compare March 7, 2025 13:34
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch 2 times, most recently from 7bfbfdb to e4aef34 Compare March 7, 2025 13:38
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch from e4aef34 to d548421 Compare March 7, 2025 13:46
@gary-huang gary-huang force-pushed the gary/impl-llm-obs-api branch from d548421 to d9a57b3 Compare March 7, 2025 14:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@gary-huang