Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migrate "checks" jobs to Gitlab #8466

Merged
merged 8 commits into from
Mar 6, 2025
Merged

Migrate "checks" jobs to Gitlab #8466

merged 8 commits into from
Mar 6, 2025

Conversation

randomanderson
Copy link
Contributor

@randomanderson randomanderson commented Feb 27, 2025 •
edited
Loading

What Does This Do

Migrates all check_* jobs from CircleCI to Gitlab

Motivation

Eventually, all jobs will be migrated to Gitlab from CircleCI.

Additional Notes

I left the CircleCI jobs in place because that was done for previous migrations.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@pr-commenter
Copy link

pr-commenter bot commented Feb 27, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/gitlab-checks-migration
git_commit_date 1741018276 1741021094
git_commit_sha 31fb383 5870de6
release_version 1.47.0-SNAPSHOT~31fb383838 1.47.0-SNAPSHOT~5870de682c
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741023628 1741023628
ci_job_id 830232889 830232889
ci_pipeline_id 57533089 57533089
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ozdivcxc-project-304-concurrent-1-d7yfr1ny 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ozdivcxc-project-304-concurrent-1-d7yfr1ny 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 70 metrics, 1 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.135 s) : 0, 1135239
Total [baseline] (11.555 s) : 0, 11555271
Agent [candidate] (1.136 s) : 0, 1136492
Total [candidate] (11.534 s) : 0, 11533841
section appsec
Agent [baseline] (1.275 s) : 0, 1275155
Total [baseline] (11.769 s) : 0, 11768766
Agent [candidate] (1.274 s) : 0, 1273730
Total [candidate] (11.696 s) : 0, 11695994
section iast
Agent [baseline] (1.262 s) : 0, 1262107
Total [baseline] (11.984 s) : 0, 11983608
Agent [candidate] (1.261 s) : 0, 1260916
Total [candidate] (11.916 s) : 0, 11916170
section profiling
Agent [baseline] (1.381 s) : 0, 1381314
Total [baseline] (11.844 s) : 0, 11843572
Agent [candidate] (1.383 s) : 0, 1382776
Total [candidate] (11.823 s) : 0, 11823088
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.135 s -
Agent appsec 1.275 s 139.915 ms (12.3%)
Agent iast 1.262 s 126.867 ms (11.2%)
Agent profiling 1.381 s 246.075 ms (21.7%)
Total tracing 11.555 s -
Total appsec 11.769 s 213.496 ms (1.8%)
Total iast 11.984 s 428.337 ms (3.7%)
Total profiling 11.844 s 288.301 ms (2.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.136 s -
Agent appsec 1.274 s 137.238 ms (12.1%)
Agent iast 1.261 s 124.424 ms (10.9%)
Agent profiling 1.383 s 246.284 ms (21.7%)
Total tracing 11.534 s -
Total appsec 11.696 s 162.153 ms (1.4%)
Total iast 11.916 s 382.329 ms (3.3%)
Total profiling 11.823 s 289.247 ms (2.5%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (716.614 ms) : 0, 716614
BytebuddyAgent [candidate] (718.097 ms) : 0, 718097
GlobalTracer [baseline] (239.791 ms) : 0, 239791
GlobalTracer [candidate] (239.535 ms) : 0, 239535
AppSec [baseline] (55.579 ms) : 0, 55579
AppSec [candidate] (55.369 ms) : 0, 55369
Debugger [baseline] (95.161 ms) : 0, 95161
Debugger [candidate] (95.531 ms) : 0, 95531
Remote Config [baseline] (591.685 µs) : 0, 592
Remote Config [candidate] (596.606 µs) : 0, 597
Telemetry [baseline] (12.448 ms) : 0, 12448
Telemetry [candidate] (12.329 ms) : 0, 12329
section appsec
BytebuddyAgent [baseline] (736.748 ms) : 0, 736748
BytebuddyAgent [candidate] (735.89 ms) : 0, 735890
GlobalTracer [baseline] (237.017 ms) : 0, 237017
GlobalTracer [candidate] (236.59 ms) : 0, 236590
IAST [baseline] (21.709 ms) : 0, 21709
IAST [candidate] (21.534 ms) : 0, 21534
AppSec [baseline] (177.229 ms) : 0, 177229
AppSec [candidate] (178.121 ms) : 0, 178121
Debugger [baseline] (85.258 ms) : 0, 85258
Debugger [candidate] (84.413 ms) : 0, 84413
Remote Config [baseline] (639.406 µs) : 0, 639
Remote Config [candidate] (625.264 µs) : 0, 625
Telemetry [baseline] (12.399 ms) : 0, 12399
Telemetry [candidate] (12.257 ms) : 0, 12257
section iast
BytebuddyAgent [baseline] (838.531 ms) : 0, 838531
BytebuddyAgent [candidate] (839.217 ms) : 0, 839217
GlobalTracer [baseline] (230.95 ms) : 0, 230950
GlobalTracer [candidate] (230.663 ms) : 0, 230663
IAST [baseline] (23.091 ms) : 0, 23091
IAST [candidate] (22.696 ms) : 0, 22696
AppSec [baseline] (57.604 ms) : 0, 57604
AppSec [candidate] (57.165 ms) : 0, 57165
Debugger [baseline] (83.976 ms) : 0, 83976
Debugger [candidate] (83.226 ms) : 0, 83226
Remote Config [baseline] (533.36 µs) : 0, 533
Remote Config [candidate] (522.831 µs) : 0, 523
Telemetry [baseline] (12.342 ms) : 0, 12342
Telemetry [candidate] (12.299 ms) : 0, 12299
section profiling
BytebuddyAgent [baseline] (709.183 ms) : 0, 709183
BytebuddyAgent [candidate] (710.836 ms) : 0, 710836
GlobalTracer [baseline] (350.806 ms) : 0, 350806
GlobalTracer [candidate] (352.147 ms) : 0, 352147
AppSec [baseline] (55.425 ms) : 0, 55425
AppSec [candidate] (54.606 ms) : 0, 54606
Debugger [baseline] (88.586 ms) : 0, 88586
Debugger [candidate] (88.673 ms) : 0, 88673
Remote Config [baseline] (606.204 µs) : 0, 606
Remote Config [candidate] (617.029 µs) : 0, 617
Telemetry [baseline] (12.701 ms) : 0, 12701
Telemetry [candidate] (12.519 ms) : 0, 12519
ProfilingAgent [baseline] (123.476 ms) : 0, 123476
ProfilingAgent [candidate] (123.063 ms) : 0, 123063
Profiling [baseline] (123.497 ms) : 0, 123497
Profiling [candidate] (123.083 ms) : 0, 123083
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.143 s) : 0, 1143489
Total [baseline] (9.299 s) : 0, 9299105
Agent [candidate] (1.138 s) : 0, 1138332
Total [candidate] (9.339 s) : 0, 9338580
section iast
Agent [baseline] (1.275 s) : 0, 1274659
Total [baseline] (10.043 s) : 0, 10043080
Agent [candidate] (1.257 s) : 0, 1256758
Total [candidate] (9.92 s) : 0, 9920390
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.258 s) : 0, 1258342
Total [baseline] (9.85 s) : 0, 9850383
Agent [candidate] (1.266 s) : 0, 1266233
Total [candidate] (9.912 s) : 0, 9912248
section iast_TELEMETRY_OFF
Agent [baseline] (1.256 s) : 0, 1255808
Total [baseline] (9.876 s) : 0, 9876245
Agent [candidate] (1.256 s) : 0, 1255508
Total [candidate] (9.942 s) : 0, 9941958
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.143 s -
Agent iast 1.275 s 131.17 ms (11.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.258 s 114.853 ms (10.0%)
Agent iast_TELEMETRY_OFF 1.256 s 112.319 ms (9.8%)
Total tracing 9.299 s -
Total iast 10.043 s 743.974 ms (8.0%)
Total iast_HARDCODED_SECRET_DISABLED 9.85 s 551.278 ms (5.9%)
Total iast_TELEMETRY_OFF 9.876 s 577.139 ms (6.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.138 s -
Agent iast 1.257 s 118.426 ms (10.4%)
Agent iast_HARDCODED_SECRET_DISABLED 1.266 s 127.901 ms (11.2%)
Agent iast_TELEMETRY_OFF 1.256 s 117.176 ms (10.3%)
Total tracing 9.339 s -
Total iast 9.92 s 581.81 ms (6.2%)
Total iast_HARDCODED_SECRET_DISABLED 9.912 s 573.668 ms (6.1%)
Total iast_TELEMETRY_OFF 9.942 s 603.378 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (722.63 ms) : 0, 722630
BytebuddyAgent [candidate] (718.162 ms) : 0, 718162
GlobalTracer [baseline] (241.342 ms) : 0, 241342
GlobalTracer [candidate] (241.066 ms) : 0, 241066
AppSec [baseline] (55.565 ms) : 0, 55565
AppSec [candidate] (55.757 ms) : 0, 55757
Debugger [baseline] (95.758 ms) : 0, 95758
Debugger [candidate] (95.265 ms) : 0, 95265
Remote Config [baseline] (602.629 µs) : 0, 603
Remote Config [candidate] (592.647 µs) : 0, 593
Telemetry [baseline] (12.451 ms) : 0, 12451
Telemetry [candidate] (12.481 ms) : 0, 12481
section iast
BytebuddyAgent [baseline] (845.561 ms) : 0, 845561
BytebuddyAgent [candidate] (835.181 ms) : 0, 835181
GlobalTracer [baseline] (234.302 ms) : 0, 234302
GlobalTracer [candidate] (230.194 ms) : 0, 230194
IAST [baseline] (23.656 ms) : 0, 23656
IAST [candidate] (22.889 ms) : 0, 22889
AppSec [baseline] (58.141 ms) : 0, 58141
AppSec [candidate] (57.683 ms) : 0, 57683
Debugger [baseline] (84.747 ms) : 0, 84747
Debugger [candidate] (83.091 ms) : 0, 83091
Remote Config [baseline] (536.875 µs) : 0, 537
Remote Config [candidate] (523.453 µs) : 0, 523
Telemetry [baseline] (12.517 ms) : 0, 12517
Telemetry [candidate] (12.208 ms) : 0, 12208
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.402 ms) : 0, 836402
BytebuddyAgent [candidate] (842.46 ms) : 0, 842460
GlobalTracer [baseline] (230.154 ms) : 0, 230154
GlobalTracer [candidate] (231.076 ms) : 0, 231076
IAST [baseline] (22.948 ms) : 0, 22948
IAST [candidate] (22.995 ms) : 0, 22995
AppSec [baseline] (57.451 ms) : 0, 57451
AppSec [candidate] (57.576 ms) : 0, 57576
Debugger [baseline] (83.629 ms) : 0, 83629
Debugger [candidate] (84.087 ms) : 0, 84087
Remote Config [baseline] (517.544 µs) : 0, 518
Remote Config [candidate] (525.204 µs) : 0, 525
Telemetry [baseline] (12.241 ms) : 0, 12241
Telemetry [candidate] (12.245 ms) : 0, 12245
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (835.597 ms) : 0, 835597
BytebuddyAgent [candidate] (834.576 ms) : 0, 834576
GlobalTracer [baseline] (229.554 ms) : 0, 229554
GlobalTracer [candidate] (230.69 ms) : 0, 230690
IAST [baseline] (22.311 ms) : 0, 22311
IAST [candidate] (24.017 ms) : 0, 24017
AppSec [baseline] (56.619 ms) : 0, 56619
AppSec [candidate] (55.548 ms) : 0, 55548
Debugger [baseline] (83.452 ms) : 0, 83452
Debugger [candidate] (83.084 ms) : 0, 83084
Remote Config [baseline] (524.474 µs) : 0, 524
Remote Config [candidate] (522.465 µs) : 0, 522
Telemetry [baseline] (12.015 ms) : 0, 12015
Telemetry [candidate] (12.12 ms) : 0, 12120
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-03T17:10:06 2025-03-03T17:18:02
git_branch master landerson/gitlab-checks-migration
git_commit_date 1741018276 1741021094
git_commit_sha 31fb383 5870de6
release_version 1.47.0-SNAPSHOT~31fb383838 1.47.0-SNAPSHOT~5870de682c
start_time 2025-03-03T17:09:52 2025-03-03T17:17:48
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741022689 1741022689
ci_job_id 830232890 830232890
ci_pipeline_id 57533089 57533089
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zrt-bbxu-project-304-concurrent-1-rjmnt0e5 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zrt-bbxu-project-304-concurrent-1-rjmnt0e5 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838
    dateFormat X
    axisFormat %s
section baseline
no_agent (384.303 µs) : 364, 404
.   : milestone, 384,
iast (512.777 µs) : 491, 535
.   : milestone, 513,
iast_FULL (730.166 µs) : 708, 752
.   : milestone, 730,
iast_GLOBAL (576.984 µs) : 552, 602
.   : milestone, 577,
iast_HARDCODED_SECRET_DISABLED (517.098 µs) : 495, 539
.   : milestone, 517,
iast_INACTIVE (464.559 µs) : 443, 486
.   : milestone, 465,
iast_TELEMETRY_OFF (504.689 µs) : 483, 526
.   : milestone, 505,
tracing (460.438 µs) : 439, 482
.   : milestone, 460,
section candidate
no_agent (381.671 µs) : 361, 402
.   : milestone, 382,
iast (524.159 µs) : 502, 546
.   : milestone, 524,
iast_FULL (737.906 µs) : 716, 760
.   : milestone, 738,
iast_GLOBAL (562.581 µs) : 540, 585
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (520.082 µs) : 498, 542
.   : milestone, 520,
iast_INACTIVE (466.298 µs) : 445, 488
.   : milestone, 466,
iast_TELEMETRY_OFF (496.9 µs) : 475, 518
.   : milestone, 497,
tracing (463.666 µs) : 443, 485
.   : milestone, 464,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 384.303 µs [364.373 µs, 404.232 µs] -
iast 512.777 µs [490.969 µs, 534.584 µs] 128.474 µs (33.4%)
iast_FULL 730.166 µs [708.299 µs, 752.033 µs] 345.863 µs (90.0%)
iast_GLOBAL 576.984 µs [552.418 µs, 601.551 µs] 192.682 µs (50.1%)
iast_HARDCODED_SECRET_DISABLED 517.098 µs [494.847 µs, 539.35 µs] 132.796 µs (34.6%)
iast_INACTIVE 464.559 µs [443.287 µs, 485.831 µs] 80.256 µs (20.9%)
iast_TELEMETRY_OFF 504.689 µs [483.082 µs, 526.297 µs] 120.387 µs (31.3%)
tracing 460.438 µs [438.776 µs, 482.1 µs] 76.135 µs (19.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 381.671 µs [360.891 µs, 402.45 µs] -
iast 524.159 µs [502.252 µs, 546.066 µs] 142.488 µs (37.3%)
iast_FULL 737.906 µs [715.645 µs, 760.167 µs] 356.235 µs (93.3%)
iast_GLOBAL 562.581 µs [540.473 µs, 584.688 µs] 180.91 µs (47.4%)
iast_HARDCODED_SECRET_DISABLED 520.082 µs [498.112 µs, 542.052 µs] 138.411 µs (36.3%)
iast_INACTIVE 466.298 µs [444.956 µs, 487.64 µs] 84.627 µs (22.2%)
iast_TELEMETRY_OFF 496.9 µs [475.495 µs, 518.306 µs] 115.229 µs (30.2%)
tracing 463.666 µs [442.734 µs, 484.597 µs] 81.995 µs (21.5%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.366 ms) : 1346, 1385
.   : milestone, 1366,
appsec (1.738 ms) : 1714, 1762
.   : milestone, 1738,
appsec_no_iast (1.727 ms) : 1703, 1752
.   : milestone, 1727,
code_origins (1.689 ms) : 1655, 1723
.   : milestone, 1689,
iast (1.517 ms) : 1492, 1542
.   : milestone, 1517,
profiling (1.528 ms) : 1503, 1553
.   : milestone, 1528,
tracing (1.501 ms) : 1478, 1525
.   : milestone, 1501,
section candidate
no_agent (1.37 ms) : 1350, 1390
.   : milestone, 1370,
appsec (1.736 ms) : 1712, 1759
.   : milestone, 1736,
appsec_no_iast (1.743 ms) : 1720, 1766
.   : milestone, 1743,
code_origins (1.683 ms) : 1649, 1717
.   : milestone, 1683,
iast (1.519 ms) : 1494, 1543
.   : milestone, 1519,
profiling (1.516 ms) : 1491, 1540
.   : milestone, 1516,
tracing (1.48 ms) : 1456, 1504
.   : milestone, 1480,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.346 ms, 1.385 ms] -
appsec 1.738 ms [1.714 ms, 1.762 ms] 372.518 µs (27.3%)
appsec_no_iast 1.727 ms [1.703 ms, 1.752 ms] 361.671 µs (26.5%)
code_origins 1.689 ms [1.655 ms, 1.723 ms] 323.137 µs (23.7%)
iast 1.517 ms [1.492 ms, 1.542 ms] 151.435 µs (11.1%)
profiling 1.528 ms [1.503 ms, 1.553 ms] 162.44 µs (11.9%)
tracing 1.501 ms [1.478 ms, 1.525 ms] 135.674 µs (9.9%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.37 ms [1.35 ms, 1.39 ms] -
appsec 1.736 ms [1.712 ms, 1.759 ms] 365.298 µs (26.7%)
appsec_no_iast 1.743 ms [1.72 ms, 1.766 ms] 372.822 µs (27.2%)
code_origins 1.683 ms [1.649 ms, 1.717 ms] 313.108 µs (22.8%)
iast 1.519 ms [1.494 ms, 1.543 ms] 148.227 µs (10.8%)
profiling 1.516 ms [1.491 ms, 1.54 ms] 145.345 µs (10.6%)
tracing 1.48 ms [1.456 ms, 1.504 ms] 109.76 µs (8.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master landerson/gitlab-checks-migration
git_commit_date 1741018276 1741021094
git_commit_sha 31fb383 5870de6
release_version 1.47.0-SNAPSHOT~31fb383838 1.47.0-SNAPSHOT~5870de682c
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741023244 1741023244
ci_job_id 830232891 830232891
ci_pipeline_id 57533089 57533089
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-o43fkuxv-project-304-concurrent-2-l25fr99t 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-o43fkuxv-project-304-concurrent-2-l25fr99t 6.8.0-1021-aws #23~22.04.1-Ubuntu SMP Tue Dec 10 16:50:46 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.581 s) : 15581000, 15581000
.   : milestone, 15581000,
appsec (14.999 s) : 14999000, 14999000
.   : milestone, 14999000,
iast (18.888 s) : 18888000, 18888000
.   : milestone, 18888000,
iast_GLOBAL (18.147 s) : 18147000, 18147000
.   : milestone, 18147000,
profiling (15.504 s) : 15504000, 15504000
.   : milestone, 15504000,
tracing (15.007 s) : 15007000, 15007000
.   : milestone, 15007000,
section candidate
no_agent (15.257 s) : 15257000, 15257000
.   : milestone, 15257000,
appsec (14.847 s) : 14847000, 14847000
.   : milestone, 14847000,
iast (18.875 s) : 18875000, 18875000
.   : milestone, 18875000,
iast_GLOBAL (18.167 s) : 18167000, 18167000
.   : milestone, 18167000,
profiling (15.201 s) : 15201000, 15201000
.   : milestone, 15201000,
tracing (14.656 s) : 14656000, 14656000
.   : milestone, 14656000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.581 s [15.581 s, 15.581 s] -
appsec 14.999 s [14.999 s, 14.999 s] -582.0 ms (-3.7%)
iast 18.888 s [18.888 s, 18.888 s] 3.307 s (21.2%)
iast_GLOBAL 18.147 s [18.147 s, 18.147 s] 2.566 s (16.5%)
profiling 15.504 s [15.504 s, 15.504 s] -77.0 ms (-0.5%)
tracing 15.007 s [15.007 s, 15.007 s] -574.0 ms (-3.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.257 s [15.257 s, 15.257 s] -
appsec 14.847 s [14.847 s, 14.847 s] -410.0 ms (-2.7%)
iast 18.875 s [18.875 s, 18.875 s] 3.618 s (23.7%)
iast_GLOBAL 18.167 s [18.167 s, 18.167 s] 2.91 s (19.1%)
profiling 15.201 s [15.201 s, 15.201 s] -56.0 ms (-0.4%)
tracing 14.656 s [14.656 s, 14.656 s] -601.0 ms (-3.9%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~5870de682c, baseline=1.47.0-SNAPSHOT~31fb383838
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.474 ms) : 1463, 1486
.   : milestone, 1474,
appsec (2.349 ms) : 2305, 2392
.   : milestone, 2349,
iast (2.12 ms) : 2064, 2175
.   : milestone, 2120,
iast_GLOBAL (2.17 ms) : 2115, 2226
.   : milestone, 2170,
profiling (2.011 ms) : 1965, 2057
.   : milestone, 2011,
tracing (1.947 ms) : 1905, 1989
.   : milestone, 1947,
section candidate
no_agent (1.474 ms) : 1462, 1485
.   : milestone, 1474,
appsec (2.342 ms) : 2298, 2385
.   : milestone, 2342,
iast (2.119 ms) : 2064, 2174
.   : milestone, 2119,
iast_GLOBAL (2.166 ms) : 2111, 2222
.   : milestone, 2166,
profiling (2.471 ms) : 2284, 2658
.   : milestone, 2471,
tracing (1.963 ms) : 1921, 2006
.   : milestone, 1963,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.463 ms, 1.486 ms] -
appsec 2.349 ms [2.305 ms, 2.392 ms] 874.37 µs (59.3%)
iast 2.12 ms [2.064 ms, 2.175 ms] 645.439 µs (43.8%)
iast_GLOBAL 2.17 ms [2.115 ms, 2.226 ms] 696.343 µs (47.2%)
profiling 2.011 ms [1.965 ms, 2.057 ms] 536.826 µs (36.4%)
tracing 1.947 ms [1.905 ms, 1.989 ms] 472.822 µs (32.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.474 ms [1.462 ms, 1.485 ms] -
appsec 2.342 ms [2.298 ms, 2.385 ms] 868.373 µs (58.9%)
iast 2.119 ms [2.064 ms, 2.174 ms] 645.334 µs (43.8%)
iast_GLOBAL 2.166 ms [2.111 ms, 2.222 ms] 692.566 µs (47.0%)
profiling 2.471 ms [2.284 ms, 2.658 ms] 997.545 µs (67.7%)
tracing 1.963 ms [1.921 ms, 2.006 ms] 489.747 µs (33.2%)

@randomanderson randomanderson force-pushed the landerson/gitlab-checks-migration branch from f9de4b5 to 0b8643a Compare February 28, 2025 15:50
@randomanderson randomanderson changed the title Gitlab checks migration Migrate "checks" jobs to Gitlab Mar 3, 2025
@randomanderson randomanderson added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels Mar 3, 2025
@randomanderson randomanderson marked this pull request as ready for review March 3, 2025 17:03
@randomanderson randomanderson requested a review from a team as a code owner March 3, 2025 17:03
@randomanderson randomanderson marked this pull request as draft March 3, 2025 17:22
@randomanderson
Copy link
Contributor Author

randomanderson commented Mar 3, 2025 •
edited
Loading

Move back to "draft" to verify the checks are actually running Ready ✅

@randomanderson randomanderson marked this pull request as ready for review March 3, 2025 19:08
@randomanderson randomanderson enabled auto-merge (squash) March 5, 2025 15:30
@randomanderson randomanderson merged commit d245a14 into master Mar 6, 2025
226 of 227 checks passed
@randomanderson randomanderson deleted the landerson/gitlab-checks-migration branch March 6, 2025 13:26
@github-actions github-actions bot added this to the 1.48.0 milestone Mar 6, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
1.48.0
Development

Successfully merging this pull request may close these issues.
2 participants
@randomanderson @PerfectSlayer