Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add setUser to user monitoring SDK #8482

Draft
wants to merge 3 commits into
base: malvarez/waf-sdk-appsec-inactive
Choose a base branch
from

Conversation

manuel-alvarez-alvarez
Copy link
Member

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@manuel-alvarez-alvarez manuel-alvarez-alvarez added type: enhancement comp: asm waf Application Security Management (WAF) labels Mar 3, 2025
@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/waf-set-user-sdk branch 2 times, most recently from 5eaffba to b3dcd02 Compare March 3, 2025 09:31
@pr-commenter
Copy link

pr-commenter bot commented Mar 3, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/waf-set-user-sdk
git_commit_date 1740987863 1740997768
git_commit_sha 6502eeb 0723431
release_version 1.47.0-SNAPSHOT~6502eeb8e2 1.47.0-SNAPSHOT~0723431572
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741000268 1741000268
ci_job_id 829376466 829376466
ci_pipeline_id 57473519 57473519
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ozdivcxc-project-304-concurrent-0-sdk0q7v8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ozdivcxc-project-304-concurrent-0-sdk0q7v8 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 23 performance improvements and 8 performance regressions! Performance is the same for 26 metrics, 6 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent better
[-673.288ms; -521.516ms] or [-6.831%; -5.291%]
9.259s 9.856s
scenario:startup:insecure-bank:iast:Agent.start better
[-103.339ms; -82.393ms] or [-8.180%; -6.522%]
1.170s 1.263s
scenario:startup:insecure-bank:iast:Remote Config worse
[+73.947µs; +109.236µs] or [+14.427%; +21.311%]
604.159µs 512.568µs
scenario:startup:insecure-bank:iast:Telemetry better
[-3.755ms; -3.445ms] or [-30.819%; -28.272%]
8.585ms 12.185ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent better
[-707.007ms; -622.395ms] or [-7.184%; -6.325%]
9.176s 9.841s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Agent.start better
[-88.164ms; -81.546ms] or [-7.016%; -6.489%]
1.172s 1.257s
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Remote Config worse
[+84.534µs; +109.009µs] or [+16.412%; +21.163%]
611.855µs 515.084µs
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Telemetry better
[-3.681ms; -3.361ms] or [-29.952%; -27.351%]
8.769ms 12.290ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent better
[-659.006ms; -554.127ms] or [-6.687%; -5.623%]
9.248s 9.855s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Agent.start better
[-91.528ms; -82.453ms] or [-7.293%; -6.570%]
1.168s 1.255s
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config worse
[+76.847µs; +116.096µs] or [+14.694%; +22.198%]
619.466µs 522.994µs
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Telemetry better
[-3.609ms; -3.158ms] or [-29.919%; -26.177%]
8.680ms 12.064ms
scenario:startup:insecure-bank:tracing:Agent better
[-677.568ms; -597.316ms] or [-7.297%; -6.433%]
8.648s 9.285s
scenario:startup:insecure-bank:tracing:Agent.start better
[-101.641ms; -92.415ms] or [-8.945%; -8.133%]
1.039s 1.136s
scenario:startup:insecure-bank:tracing:Remote Config worse
[+98.129µs; +138.807µs] or [+16.655%; +23.558%]
707.668µs 589.201µs
scenario:startup:petclinic:appsec:Agent better
[-1009.744ms; -810.305ms] or [-8.651%; -6.942%]
10.762s 11.672s
scenario:startup:petclinic:appsec:Agent.start better
[-100.941ms; -78.622ms] or [-7.917%; -6.166%]
1.185s 1.275s
scenario:startup:petclinic:appsec:Remote Config worse
[+14.839µs; +57.258µs] or [+2.382%; +9.191%]
659.052µs 623.004µs
scenario:startup:petclinic:iast:Agent better
[-1000.036ms; -871.660ms] or [-8.403%; -7.325%]
10.965s 11.901s
scenario:startup:petclinic:iast:Agent.start better
[-91.990ms; -84.051ms] or [-7.294%; -6.665%]
1.173s 1.261s
scenario:startup:petclinic:iast:Remote Config worse
[+58.905µs; +95.817µs] or [+11.160%; +18.153%]
605.203µs 527.842µs
scenario:startup:petclinic:iast:Telemetry better
[-3.910ms; -3.480ms] or [-31.739%; -28.245%]
8.625ms 12.320ms
scenario:startup:petclinic:profiling:Agent better
[-1007.485ms; -864.921ms] or [-8.548%; -7.338%]
10.850s 11.787s
scenario:startup:petclinic:profiling:Agent.start better
[-133.442ms; -94.806ms] or [-9.629%; -6.841%]
1.272s 1.386s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-27.564ms; -24.089ms] or [-22.422%; -19.596%]
97.102ms 122.928ms
scenario:startup:petclinic:profiling:Remote Config worse
[+58.130µs; +92.007µs] or [+9.634%; +15.249%]
678.434µs 603.365µs
scenario:startup:petclinic:profiling:Telemetry better
[-3.588ms; -3.165ms] or [-28.576%; -25.204%]
9.181ms 12.557ms
scenario:startup:petclinic:profiling:Profiling better
[-27.559ms; -24.086ms] or [-22.415%; -19.590%]
97.128ms 122.950ms
scenario:startup:petclinic:tracing:Agent better
[-1.136s; -0.916s] or [-9.945%; -8.014%]
10.399s 11.425s
scenario:startup:petclinic:tracing:Agent.start better
[-96.882ms; -89.618ms] or [-8.537%; -7.897%]
1.042s 1.135s
scenario:startup:petclinic:tracing:Remote Config worse
[+52.938µs; +113.228µs] or [+8.771%; +18.760%]
686.637µs 603.554µs
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1134897
Total [baseline] (11.425 s) : 0, 11425401
Agent [candidate] (1.042 s) : 0, 1041647
Total [candidate] (10.399 s) : 0, 10399456
section appsec
Agent [baseline] (1.275 s) : 0, 1275000
Total [baseline] (11.672 s) : 0, 11671969
Agent [candidate] (1.185 s) : 0, 1185218
Total [candidate] (10.762 s) : 0, 10761945
section iast
Agent [baseline] (1.261 s) : 0, 1261176
Total [baseline] (11.901 s) : 0, 11900523
Agent [candidate] (1.173 s) : 0, 1173156
Total [candidate] (10.965 s) : 0, 10964675
section profiling
Agent [baseline] (1.386 s) : 0, 1385793
Total [baseline] (11.787 s) : 0, 11786590
Agent [candidate] (1.272 s) : 0, 1271669
Total [candidate] (10.85 s) : 0, 10850386
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.135 s -
Agent appsec 1.275 s 140.102 ms (12.3%)
Agent iast 1.261 s 126.279 ms (11.1%)
Agent profiling 1.386 s 250.895 ms (22.1%)
Total tracing 11.425 s -
Total appsec 11.672 s 246.568 ms (2.2%)
Total iast 11.901 s 475.122 ms (4.2%)
Total profiling 11.787 s 361.189 ms (3.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent appsec 1.185 s 143.571 ms (13.8%)
Agent iast 1.173 s 131.509 ms (12.6%)
Agent profiling 1.272 s 230.022 ms (22.1%)
Total tracing 10.399 s -
Total appsec 10.762 s 362.489 ms (3.5%)
Total iast 10.965 s 565.219 ms (5.4%)
Total profiling 10.85 s 450.931 ms (4.3%)
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.826 ms) : 0, 716826
BytebuddyAgent [candidate] (719.06 ms) : 0, 719060
GlobalTracer [baseline] (239.941 ms) : 0, 239941
GlobalTracer [candidate] (239.48 ms) : 0, 239480
AppSec [baseline] (55.603 ms) : 0, 55603
AppSec [candidate] (55.011 ms) : 0, 55011
Remote Config [baseline] (603.554 µs) : 0, 604
Remote Config [candidate] (686.637 µs) : 0, 687
Telemetry [baseline] (12.449 ms) : 0, 12449
Telemetry [candidate] (11.335 ms) : 0, 11335
Debugger [baseline] (94.434 ms) : 0, 94434
section appsec
BytebuddyAgent [baseline] (737.618 ms) : 0, 737618
BytebuddyAgent [candidate] (735.633 ms) : 0, 735633
GlobalTracer [baseline] (236.686 ms) : 0, 236686
GlobalTracer [candidate] (236.342 ms) : 0, 236342
AppSec [baseline] (177.658 ms) : 0, 177658
AppSec [candidate] (176.965 ms) : 0, 176965
Remote Config [baseline] (623.004 µs) : 0, 623
Remote Config [candidate] (659.052 µs) : 0, 659
Telemetry [baseline] (12.316 ms) : 0, 12316
Telemetry [candidate] (8.665 ms) : 0, 8665
Debugger [baseline] (84.22 ms) : 0, 84220
IAST [baseline] (21.74 ms) : 0, 21740
IAST [candidate] (21.758 ms) : 0, 21758
section iast
BytebuddyAgent [baseline] (838.74 ms) : 0, 838740
BytebuddyAgent [candidate] (838.368 ms) : 0, 838368
GlobalTracer [baseline] (230.476 ms) : 0, 230476
GlobalTracer [candidate] (230.239 ms) : 0, 230239
AppSec [baseline] (57.434 ms) : 0, 57434
AppSec [candidate] (56.394 ms) : 0, 56394
Remote Config [baseline] (527.842 µs) : 0, 528
Remote Config [candidate] (605.203 µs) : 0, 605
Telemetry [baseline] (12.32 ms) : 0, 12320
Telemetry [candidate] (8.625 ms) : 0, 8625
Debugger [baseline] (83.807 ms) : 0, 83807
IAST [baseline] (22.816 ms) : 0, 22816
IAST [candidate] (22.842 ms) : 0, 22842
section profiling
BytebuddyAgent [baseline] (714.4 ms) : 0, 714400
BytebuddyAgent [candidate] (715.679 ms) : 0, 715679
GlobalTracer [baseline] (351.659 ms) : 0, 351659
GlobalTracer [candidate] (352.993 ms) : 0, 352993
AppSec [baseline] (55.173 ms) : 0, 55173
AppSec [candidate] (54.333 ms) : 0, 54333
Remote Config [baseline] (603.365 µs) : 0, 603
Remote Config [candidate] (678.434 µs) : 0, 678
Telemetry [baseline] (12.557 ms) : 0, 12557
Telemetry [candidate] (9.181 ms) : 0, 9181
Debugger [baseline] (87.791 ms) : 0, 87791
ProfilingAgent [baseline] (122.928 ms) : 0, 122928
ProfilingAgent [candidate] (97.102 ms) : 0, 97102
Profiling [baseline] (122.95 ms) : 0, 122950
Profiling [candidate] (97.128 ms) : 0, 97128
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.136 s) : 0, 1136314
Total [baseline] (9.285 s) : 0, 9285181
Agent [candidate] (1.039 s) : 0, 1039286
Total [candidate] (8.648 s) : 0, 8647739
section iast
Agent [baseline] (1.263 s) : 0, 1263268
Total [baseline] (9.856 s) : 0, 9856015
Agent [candidate] (1.17 s) : 0, 1170403
Total [candidate] (9.259 s) : 0, 9258613
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.257 s) : 0, 1256601
Total [baseline] (9.841 s) : 0, 9840803
Agent [candidate] (1.172 s) : 0, 1171746
Total [candidate] (9.176 s) : 0, 9176102
section iast_TELEMETRY_OFF
Agent [baseline] (1.255 s) : 0, 1254961
Total [baseline] (9.855 s) : 0, 9854673
Agent [candidate] (1.168 s) : 0, 1167971
Total [candidate] (9.248 s) : 0, 9248106
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.136 s -
Agent iast 1.263 s 126.954 ms (11.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.257 s 120.287 ms (10.6%)
Agent iast_TELEMETRY_OFF 1.255 s 118.647 ms (10.4%)
Total tracing 9.285 s -
Total iast 9.856 s 570.834 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.841 s 555.621 ms (6.0%)
Total iast_TELEMETRY_OFF 9.855 s 569.491 ms (6.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.039 s -
Agent iast 1.17 s 131.116 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.172 s 132.46 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.168 s 128.685 ms (12.4%)
Total tracing 8.648 s -
Total iast 9.259 s 610.874 ms (7.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.176 s 528.363 ms (6.1%)
Total iast_TELEMETRY_OFF 9.248 s 600.367 ms (6.9%)
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.022 ms) : 0, 718022
BytebuddyAgent [candidate] (716.313 ms) : 0, 716313
GlobalTracer [baseline] (239.579 ms) : 0, 239579
GlobalTracer [candidate] (238.934 ms) : 0, 238934
AppSec [baseline] (55.385 ms) : 0, 55385
AppSec [candidate] (55.072 ms) : 0, 55072
Remote Config [baseline] (589.201 µs) : 0, 589
Remote Config [candidate] (707.668 µs) : 0, 708
Telemetry [baseline] (12.54 ms) : 0, 12540
Telemetry [candidate] (12.206 ms) : 0, 12206
Debugger [baseline] (95.11 ms) : 0, 95110
section iast
BytebuddyAgent [baseline] (841.942 ms) : 0, 841942
BytebuddyAgent [candidate] (835.841 ms) : 0, 835841
GlobalTracer [baseline] (230.031 ms) : 0, 230031
GlobalTracer [candidate] (230.118 ms) : 0, 230118
AppSec [baseline] (57.211 ms) : 0, 57211
AppSec [candidate] (56.54 ms) : 0, 56540
Remote Config [baseline] (512.568 µs) : 0, 513
Remote Config [candidate] (604.159 µs) : 0, 604
Telemetry [baseline] (12.185 ms) : 0, 12185
Telemetry [candidate] (8.585 ms) : 0, 8585
Debugger [baseline] (83.528 ms) : 0, 83528
IAST [baseline] (22.768 ms) : 0, 22768
IAST [candidate] (22.634 ms) : 0, 22634
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (835.193 ms) : 0, 835193
BytebuddyAgent [candidate] (836.558 ms) : 0, 836558
GlobalTracer [baseline] (230.027 ms) : 0, 230027
GlobalTracer [candidate] (229.95 ms) : 0, 229950
AppSec [baseline] (56.339 ms) : 0, 56339
AppSec [candidate] (56.832 ms) : 0, 56832
Remote Config [baseline] (515.084 µs) : 0, 515
Remote Config [candidate] (611.855 µs) : 0, 612
Telemetry [baseline] (12.29 ms) : 0, 12290
Telemetry [candidate] (8.769 ms) : 0, 8769
Debugger [baseline] (83.4 ms) : 0, 83400
IAST [baseline] (23.841 ms) : 0, 23841
IAST [candidate] (22.955 ms) : 0, 22955
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (834.666 ms) : 0, 834666
BytebuddyAgent [candidate] (833.545 ms) : 0, 833545
GlobalTracer [baseline] (230.217 ms) : 0, 230217
GlobalTracer [candidate] (230.179 ms) : 0, 230179
AppSec [baseline] (54.49 ms) : 0, 54490
AppSec [candidate] (54.443 ms) : 0, 54443
Remote Config [baseline] (522.994 µs) : 0, 523
Remote Config [candidate] (619.466 µs) : 0, 619
Telemetry [baseline] (12.064 ms) : 0, 12064
Telemetry [candidate] (8.68 ms) : 0, 8680
Debugger [baseline] (83.331 ms) : 0, 83331
IAST [baseline] (24.513 ms) : 0, 24513
IAST [candidate] (23.809 ms) : 0, 23809
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-03T10:40:15 2025-03-03T10:48:08
git_branch master malvarez/waf-set-user-sdk
git_commit_date 1740987863 1740997768
git_commit_sha 6502eeb 0723431
release_version 1.47.0-SNAPSHOT~6502eeb8e2 1.47.0-SNAPSHOT~0723431572
start_time 2025-03-03T10:40:01 2025-03-03T10:47:54
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1740999286 1740999286
ci_job_id 829376467 829376467
ci_pipeline_id 57473519 57473519
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zrt-bbxu-project-304-concurrent-0-91nf53wu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zrt-bbxu-project-304-concurrent-0-91nf53wu 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.866 µs) : 364, 406
.   : milestone, 385,
iast (514.575 µs) : 492, 537
.   : milestone, 515,
iast_FULL (731.65 µs) : 709, 754
.   : milestone, 732,
iast_GLOBAL (561.824 µs) : 539, 584
.   : milestone, 562,
iast_HARDCODED_SECRET_DISABLED (514.882 µs) : 493, 537
.   : milestone, 515,
iast_INACTIVE (462.275 µs) : 440, 484
.   : milestone, 462,
iast_TELEMETRY_OFF (495.298 µs) : 473, 517
.   : milestone, 495,
tracing (469.643 µs) : 448, 491
.   : milestone, 470,
section candidate
no_agent (386.207 µs) : 364, 409
.   : milestone, 386,
iast (510.704 µs) : 488, 533
.   : milestone, 511,
iast_FULL (727.322 µs) : 706, 749
.   : milestone, 727,
iast_GLOBAL (561.078 µs) : 539, 583
.   : milestone, 561,
iast_HARDCODED_SECRET_DISABLED (516.456 µs) : 494, 539
.   : milestone, 516,
iast_INACTIVE (461.478 µs) : 440, 483
.   : milestone, 461,
iast_TELEMETRY_OFF (506.133 µs) : 483, 530
.   : milestone, 506,
tracing (455.568 µs) : 435, 476
.   : milestone, 456,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.866 µs [364.163 µs, 405.569 µs] -
iast 514.575 µs [491.869 µs, 537.281 µs] 129.709 µs (33.7%)
iast_FULL 731.65 µs [709.312 µs, 753.988 µs] 346.784 µs (90.1%)
iast_GLOBAL 561.824 µs [539.37 µs, 584.277 µs] 176.958 µs (46.0%)
iast_HARDCODED_SECRET_DISABLED 514.882 µs [492.687 µs, 537.077 µs] 130.016 µs (33.8%)
iast_INACTIVE 462.275 µs [440.473 µs, 484.078 µs] 77.41 µs (20.1%)
iast_TELEMETRY_OFF 495.298 µs [473.302 µs, 517.293 µs] 110.432 µs (28.7%)
tracing 469.643 µs [448.381 µs, 490.906 µs] 84.778 µs (22.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.207 µs [363.694 µs, 408.72 µs] -
iast 510.704 µs [488.078 µs, 533.329 µs] 124.497 µs (32.2%)
iast_FULL 727.322 µs [705.67 µs, 748.973 µs] 341.115 µs (88.3%)
iast_GLOBAL 561.078 µs [538.81 µs, 583.346 µs] 174.871 µs (45.3%)
iast_HARDCODED_SECRET_DISABLED 516.456 µs [494.177 µs, 538.735 µs] 130.249 µs (33.7%)
iast_INACTIVE 461.478 µs [440.405 µs, 482.551 µs] 75.271 µs (19.5%)
iast_TELEMETRY_OFF 506.133 µs [482.678 µs, 529.588 µs] 119.926 µs (31.1%)
tracing 455.568 µs [434.657 µs, 476.48 µs] 69.362 µs (18.0%)
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.37 ms) : 1351, 1390
.   : milestone, 1370,
appsec (1.733 ms) : 1709, 1757
.   : milestone, 1733,
appsec_no_iast (1.716 ms) : 1692, 1741
.   : milestone, 1716,
code_origins (1.676 ms) : 1643, 1710
.   : milestone, 1676,
iast (1.515 ms) : 1490, 1539
.   : milestone, 1515,
profiling (1.519 ms) : 1494, 1545
.   : milestone, 1519,
tracing (1.497 ms) : 1474, 1520
.   : milestone, 1497,
section candidate
no_agent (1.358 ms) : 1337, 1378
.   : milestone, 1358,
appsec (1.723 ms) : 1699, 1747
.   : milestone, 1723,
appsec_no_iast (1.751 ms) : 1727, 1776
.   : milestone, 1751,
code_origins (1.666 ms) : 1632, 1699
.   : milestone, 1666,
iast (1.522 ms) : 1498, 1546
.   : milestone, 1522,
profiling (1.527 ms) : 1504, 1550
.   : milestone, 1527,
tracing (1.493 ms) : 1468, 1517
.   : milestone, 1493,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.351 ms, 1.39 ms] -
appsec 1.733 ms [1.709 ms, 1.757 ms] 362.383 µs (26.4%)
appsec_no_iast 1.716 ms [1.692 ms, 1.741 ms] 345.915 µs (25.2%)
code_origins 1.676 ms [1.643 ms, 1.71 ms] 305.852 µs (22.3%)
iast 1.515 ms [1.49 ms, 1.539 ms] 144.433 µs (10.5%)
profiling 1.519 ms [1.494 ms, 1.545 ms] 148.962 µs (10.9%)
tracing 1.497 ms [1.474 ms, 1.52 ms] 126.39 µs (9.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.358 ms [1.337 ms, 1.378 ms] -
appsec 1.723 ms [1.699 ms, 1.747 ms] 365.402 µs (26.9%)
appsec_no_iast 1.751 ms [1.727 ms, 1.776 ms] 393.605 µs (29.0%)
code_origins 1.666 ms [1.632 ms, 1.699 ms] 307.959 µs (22.7%)
iast 1.522 ms [1.498 ms, 1.546 ms] 164.515 µs (12.1%)
profiling 1.527 ms [1.504 ms, 1.55 ms] 169.071 µs (12.5%)
tracing 1.493 ms [1.468 ms, 1.517 ms] 135.177 µs (10.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/waf-set-user-sdk
git_commit_date 1740987863 1740997768
git_commit_sha 6502eeb 0723431
release_version 1.47.0-SNAPSHOT~6502eeb8e2 1.47.0-SNAPSHOT~0723431572
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1740999750 1740999750
ci_job_id 829376468 829376468
ci_pipeline_id 57473519 57473519
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o43fkuxv-project-304-concurrent-0-m2wkb3ag 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o43fkuxv-project-304-concurrent-0-m2wkb3ag 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.231 s) : 15231000, 15231000
.   : milestone, 15231000,
appsec (14.695 s) : 14695000, 14695000
.   : milestone, 14695000,
iast (18.883 s) : 18883000, 18883000
.   : milestone, 18883000,
iast_GLOBAL (17.785 s) : 17785000, 17785000
.   : milestone, 17785000,
profiling (14.916 s) : 14916000, 14916000
.   : milestone, 14916000,
tracing (14.923 s) : 14923000, 14923000
.   : milestone, 14923000,
section candidate
no_agent (15.551 s) : 15551000, 15551000
.   : milestone, 15551000,
appsec (14.944 s) : 14944000, 14944000
.   : milestone, 14944000,
iast (18.242 s) : 18242000, 18242000
.   : milestone, 18242000,
iast_GLOBAL (18.024 s) : 18024000, 18024000
.   : milestone, 18024000,
profiling (15.13 s) : 15130000, 15130000
.   : milestone, 15130000,
tracing (15.047 s) : 15047000, 15047000
.   : milestone, 15047000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.231 s [15.231 s, 15.231 s] -
appsec 14.695 s [14.695 s, 14.695 s] -536.0 ms (-3.5%)
iast 18.883 s [18.883 s, 18.883 s] 3.652 s (24.0%)
iast_GLOBAL 17.785 s [17.785 s, 17.785 s] 2.554 s (16.8%)
profiling 14.916 s [14.916 s, 14.916 s] -315.0 ms (-2.1%)
tracing 14.923 s [14.923 s, 14.923 s] -308.0 ms (-2.0%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.551 s [15.551 s, 15.551 s] -
appsec 14.944 s [14.944 s, 14.944 s] -607.0 ms (-3.9%)
iast 18.242 s [18.242 s, 18.242 s] 2.691 s (17.3%)
iast_GLOBAL 18.024 s [18.024 s, 18.024 s] 2.473 s (15.9%)
profiling 15.13 s [15.13 s, 15.13 s] -421.0 ms (-2.7%)
tracing 15.047 s [15.047 s, 15.047 s] -504.0 ms (-3.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~0723431572, baseline=1.47.0-SNAPSHOT~6502eeb8e2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.349 ms) : 2305, 2393
.   : milestone, 2349,
iast (2.124 ms) : 2069, 2180
.   : milestone, 2124,
iast_GLOBAL (2.164 ms) : 2109, 2220
.   : milestone, 2164,
profiling (1.961 ms) : 1918, 2005
.   : milestone, 1961,
tracing (1.954 ms) : 1911, 1996
.   : milestone, 1954,
section candidate
no_agent (1.473 ms) : 1461, 1484
.   : milestone, 1473,
appsec (2.349 ms) : 2306, 2392
.   : milestone, 2349,
iast (2.127 ms) : 2072, 2183
.   : milestone, 2127,
iast_GLOBAL (2.159 ms) : 2103, 2214
.   : milestone, 2159,
profiling (1.984 ms) : 1940, 2027
.   : milestone, 1984,
tracing (1.947 ms) : 1905, 1989
.   : milestone, 1947,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.349 ms [2.305 ms, 2.393 ms] 874.935 µs (59.3%)
iast 2.124 ms [2.069 ms, 2.18 ms] 649.986 µs (44.1%)
iast_GLOBAL 2.164 ms [2.109 ms, 2.22 ms] 690.126 µs (46.8%)
profiling 1.961 ms [1.918 ms, 2.005 ms] 487.158 µs (33.0%)
tracing 1.954 ms [1.911 ms, 1.996 ms] 479.468 µs (32.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.473 ms [1.461 ms, 1.484 ms] -
appsec 2.349 ms [2.306 ms, 2.392 ms] 876.576 µs (59.5%)
iast 2.127 ms [2.072 ms, 2.183 ms] 654.779 µs (44.5%)
iast_GLOBAL 2.159 ms [2.103 ms, 2.214 ms] 686.192 µs (46.6%)
profiling 1.984 ms [1.94 ms, 2.027 ms] 511.11 µs (34.7%)
tracing 1.947 ms [1.905 ms, 1.989 ms] 474.161 µs (32.2%)

@manuel-alvarez-alvarez manuel-alvarez-alvarez force-pushed the malvarez/waf-sdk-appsec-inactive branch from d0b259b to f420acc Compare March 7, 2025 13:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: asm waf Application Security Management (WAF) type: enhancement
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant