iframe-proxy

PerfectSlayer · 2025-07-04T03:54:38Z

What Does This Do

This PR cleans up Platform methods and the original CLIHelper component.

Follow-up to:

Motivation

The behavior moved into the dedicated environment component.

Additional Notes

This should be the last PR for the environment component for now.
Next steps would be to keep porting related features to this component.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: LANGPLAT-458

pr-commenter · 2025-07-04T04:25:42Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment-step6
git_commit_date	1751637515	1751637564
git_commit_sha	`1de42c8`	`eaf8c40`
release_version	1.51.0-SNAPSHOT~1de42c8097	1.51.0-SNAPSHOT~eaf8c40d59

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751639396	1751639396
ci_job_id	1014448367	1014448367
ci_pipeline_id	69678605	69678605
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-tc6z00hw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-tc6z00hw 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 43 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (997.35 ms) : 0, 997350
Total [baseline] (8.564 s) : 0, 8564229
Agent [candidate] (996.397 ms) : 0, 996397
Total [candidate] (8.587 s) : 0, 8586519
section iast
Agent [baseline] (1.137 s) : 0, 1137152
Total [baseline] (9.274 s) : 0, 9273669
Agent [candidate] (1.141 s) : 0, 1141159
Total [candidate] (9.306 s) : 0, 9306284

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	997.35 ms	-
Agent	iast	1.137 s	139.802 ms (14.0%)
Total	tracing	8.564 s	-
Total	iast	9.274 s	709.44 ms (8.3%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	996.397 ms	-
Agent	iast	1.141 s	144.761 ms (14.5%)
Total	tracing	8.587 s	-
Total	iast	9.306 s	719.765 ms (8.4%)

gantt
    title insecure-bank - break down per module: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.644 ms) : 0, 688644
BytebuddyAgent [candidate] (687.974 ms) : 0, 687974
GlobalTracer [baseline] (241.872 ms) : 0, 241872
GlobalTracer [candidate] (242.595 ms) : 0, 242595
AppSec [baseline] (30.393 ms) : 0, 30393
AppSec [candidate] (30.133 ms) : 0, 30133
Debugger [baseline] (6.068 ms) : 0, 6068
Debugger [candidate] (6.022 ms) : 0, 6022
Remote Config [baseline] (688.492 µs) : 0, 688
Remote Config [candidate] (677.705 µs) : 0, 678
Telemetry [baseline] (8.249 ms) : 0, 8249
Telemetry [candidate] (8.213 ms) : 0, 8213
section iast
BytebuddyAgent [baseline] (811.021 ms) : 0, 811021
BytebuddyAgent [candidate] (813.518 ms) : 0, 813518
GlobalTracer [baseline] (232.991 ms) : 0, 232991
GlobalTracer [candidate] (234.162 ms) : 0, 234162
IAST [baseline] (28.402 ms) : 0, 28402
IAST [candidate] (28.18 ms) : 0, 28180
AppSec [baseline] (27.104 ms) : 0, 27104
AppSec [candidate] (29.815 ms) : 0, 29815
Debugger [baseline] (7.623 ms) : 0, 7623
Debugger [candidate] (5.893 ms) : 0, 5893
Remote Config [baseline] (584.389 µs) : 0, 584
Remote Config [candidate] (585.112 µs) : 0, 585
Telemetry [baseline] (8.079 ms) : 0, 8079
Telemetry [candidate] (8.141 ms) : 0, 8141

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (996.997 ms) : 0, 996997
Total [baseline] (10.719 s) : 0, 10719330
Agent [candidate] (996.664 ms) : 0, 996664
Total [candidate] (10.649 s) : 0, 10648960
section appsec
Agent [baseline] (1.175 s) : 0, 1174773
Total [baseline] (10.725 s) : 0, 10724504
Agent [candidate] (1.174 s) : 0, 1174373
Total [candidate] (10.699 s) : 0, 10699017
section iast
Agent [baseline] (1.142 s) : 0, 1141740
Total [baseline] (10.944 s) : 0, 10943650
Agent [candidate] (1.135 s) : 0, 1134953
Total [candidate] (10.928 s) : 0, 10928185
section profiling
Agent [baseline] (1.245 s) : 0, 1245136
Total [baseline] (10.98 s) : 0, 10980212
Agent [candidate] (1.245 s) : 0, 1245037
Total [candidate] (11.03 s) : 0, 11029821

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	996.997 ms	-
Agent	appsec	1.175 s	177.776 ms (17.8%)
Agent	iast	1.142 s	144.743 ms (14.5%)
Agent	profiling	1.245 s	248.139 ms (24.9%)
Total	tracing	10.719 s	-
Total	appsec	10.725 s	5.173 ms (0.0%)
Total	iast	10.944 s	224.319 ms (2.1%)
Total	profiling	10.98 s	260.882 ms (2.4%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	996.664 ms	-
Agent	appsec	1.174 s	177.709 ms (17.8%)
Agent	iast	1.135 s	138.289 ms (13.9%)
Agent	profiling	1.245 s	248.373 ms (24.9%)
Total	tracing	10.649 s	-
Total	appsec	10.699 s	50.057 ms (0.5%)
Total	iast	10.928 s	279.225 ms (2.6%)
Total	profiling	11.03 s	380.861 ms (3.6%)

gantt
    title petclinic - break down per module: candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (688.258 ms) : 0, 688258
BytebuddyAgent [candidate] (688.571 ms) : 0, 688571
GlobalTracer [baseline] (242.275 ms) : 0, 242275
GlobalTracer [candidate] (242.089 ms) : 0, 242089
AppSec [baseline] (30.102 ms) : 0, 30102
AppSec [candidate] (30.32 ms) : 0, 30320
Debugger [baseline] (6.058 ms) : 0, 6058
Debugger [candidate] (6.069 ms) : 0, 6069
Remote Config [baseline] (668.609 µs) : 0, 669
Remote Config [candidate] (673.31 µs) : 0, 673
Telemetry [baseline] (8.19 ms) : 0, 8190
Telemetry [candidate] (8.214 ms) : 0, 8214
section appsec
BytebuddyAgent [baseline] (710.226 ms) : 0, 710226
BytebuddyAgent [candidate] (709.743 ms) : 0, 709743
GlobalTracer [baseline] (234.93 ms) : 0, 234930
GlobalTracer [candidate] (234.922 ms) : 0, 234922
AppSec [baseline] (170.548 ms) : 0, 170548
AppSec [candidate] (171.242 ms) : 0, 171242
Debugger [baseline] (5.719 ms) : 0, 5719
Debugger [candidate] (5.748 ms) : 0, 5748
Remote Config [baseline] (597.817 µs) : 0, 598
Remote Config [candidate] (598.096 µs) : 0, 598
Telemetry [baseline] (8.006 ms) : 0, 8006
Telemetry [candidate] (8.022 ms) : 0, 8022
IAST [baseline] (23.338 ms) : 0, 23338
IAST [candidate] (23.356 ms) : 0, 23356
section iast
BytebuddyAgent [baseline] (813.317 ms) : 0, 813317
BytebuddyAgent [candidate] (808.37 ms) : 0, 808370
GlobalTracer [baseline] (234.146 ms) : 0, 234146
GlobalTracer [candidate] (233.245 ms) : 0, 233245
AppSec [baseline] (29.086 ms) : 0, 29086
AppSec [candidate] (31.641 ms) : 0, 31641
Debugger [baseline] (6.767 ms) : 0, 6767
Debugger [candidate] (5.848 ms) : 0, 5848
Remote Config [baseline] (597.032 µs) : 0, 597
Remote Config [candidate] (582.661 µs) : 0, 583
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.092 ms) : 0, 8092
IAST [baseline] (28.214 ms) : 0, 28214
IAST [candidate] (26.311 ms) : 0, 26311
section profiling
ProfilingAgent [baseline] (103.311 ms) : 0, 103311
ProfilingAgent [candidate] (103.609 ms) : 0, 103609
BytebuddyAgent [baseline] (678.85 ms) : 0, 678850
BytebuddyAgent [candidate] (678.832 ms) : 0, 678832
GlobalTracer [baseline] (360.908 ms) : 0, 360908
GlobalTracer [candidate] (360.983 ms) : 0, 360983
AppSec [baseline] (30.877 ms) : 0, 30877
AppSec [candidate] (32.976 ms) : 0, 32976
Debugger [baseline] (13.363 ms) : 0, 13363
Debugger [candidate] (9.967 ms) : 0, 9967
Remote Config [baseline] (663.463 µs) : 0, 663
Remote Config [candidate] (659.01 µs) : 0, 659
Telemetry [baseline] (8.022 ms) : 0, 8022
Telemetry [candidate] (9.519 ms) : 0, 9519
Profiling [baseline] (103.334 ms) : 0, 103334
Profiling [candidate] (103.633 ms) : 0, 103633

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment-step6
git_commit_date	1751637515	1751637564
git_commit_sha	`1de42c8`	`eaf8c40`
release_version	1.51.0-SNAPSHOT~1de42c8097	1.51.0-SNAPSHOT~eaf8c40d59

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1751872658	1751872658
ci_job_id	1015265295	1015265295
ci_pipeline_id	69678605	69678605
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-qis2vib5 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-qis2vib5 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 7 metrics, 12 unstable metrics.

scenario	Δ mean http_req_duration	Δ mean throughput	candidate mean http_req_duration	candidate mean throughput	baseline mean http_req_duration	baseline mean throughput
scenario:load:insecure-bank:tracing:high_load	worse [+243.653µs; +476.989µs] or [+3.333%; +6.524%]	unstable [-106.015op/s; +47.140op/s] or [-16.743%; +7.445%]	7.672ms	603.750op/s	7.311ms	633.188op/s
scenario:load:petclinic:code_origins:high_load	better [-2.345ms; -1.516ms] or [-5.191%; -3.356%]	unstable [-2.827op/s; +12.077op/s] or [-2.729%; +11.659%]	43.253ms	108.213op/s	45.184ms	103.588op/s
scenario:load:petclinic:tracing:high_load	better [-2.475ms; -1.667ms] or [-5.632%; -3.794%]	unstable [-2.498op/s; +12.998op/s] or [-2.345%; +12.202%]	41.866ms	111.775op/s	43.937ms	106.525op/s
scenario:load:petclinic:profiling:high_load	better [-4.341ms; -3.416ms] or [-8.853%; -6.968%]	unstable [+1.002op/s; +15.248op/s] or [+1.049%; +15.966%]	45.151ms	103.625op/s	49.029ms	95.500op/s
scenario:load:petclinic:iast:high_load	worse [+1.599ms; +2.432ms] or [+3.690%; +5.612%]	unstable [-10.360op/s; +3.398op/s] or [-9.595%; +3.147%]	45.346ms	104.494op/s	43.331ms	107.975op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (36.745 ms) : 36443, 37047
.   : milestone, 36745,
appsec (46.636 ms) : 46210, 47062
.   : milestone, 46636,
code_origins (45.184 ms) : 44785, 45582
.   : milestone, 45184,
iast (43.331 ms) : 42956, 43705
.   : milestone, 43331,
profiling (49.029 ms) : 48567, 49492
.   : milestone, 49029,
tracing (43.937 ms) : 43540, 44334
.   : milestone, 43937,
section candidate
no_agent (36.222 ms) : 35935, 36508
.   : milestone, 36222,
appsec (45.932 ms) : 45533, 46331
.   : milestone, 45932,
code_origins (43.253 ms) : 42881, 43624
.   : milestone, 43253,
iast (45.346 ms) : 44947, 45745
.   : milestone, 45346,
profiling (45.151 ms) : 44757, 45544
.   : milestone, 45151,
tracing (41.866 ms) : 41514, 42218
.   : milestone, 41866,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.745 ms [36.443 ms, 37.047 ms]	-
appsec	46.636 ms [46.21 ms, 47.062 ms]	9.891 ms (26.9%)
code_origins	45.184 ms [44.785 ms, 45.582 ms]	8.439 ms (23.0%)
iast	43.331 ms [42.956 ms, 43.705 ms]	6.586 ms (17.9%)
profiling	49.029 ms [48.567 ms, 49.492 ms]	12.284 ms (33.4%)
tracing	43.937 ms [43.54 ms, 44.334 ms]	7.192 ms (19.6%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	36.222 ms [35.935 ms, 36.508 ms]	-
appsec	45.932 ms [45.533 ms, 46.331 ms]	9.711 ms (26.8%)
code_origins	43.253 ms [42.881 ms, 43.624 ms]	7.031 ms (19.4%)
iast	45.346 ms [44.947 ms, 45.745 ms]	9.125 ms (25.2%)
profiling	45.151 ms [44.757 ms, 45.544 ms]	8.929 ms (24.7%)
tracing	41.866 ms [41.514 ms, 42.218 ms]	5.644 ms (15.6%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.547 ms) : 4495, 4600
.   : milestone, 4547,
iast (9.314 ms) : 9154, 9473
.   : milestone, 9314,
iast_FULL (14.224 ms) : 13937, 14511
.   : milestone, 14224,
iast_GLOBAL (10.595 ms) : 10404, 10787
.   : milestone, 10595,
profiling (8.632 ms) : 8493, 8770
.   : milestone, 8632,
tracing (7.311 ms) : 7205, 7418
.   : milestone, 7311,
section candidate
no_agent (4.49 ms) : 4438, 4542
.   : milestone, 4490,
iast (9.088 ms) : 8937, 9240
.   : milestone, 9088,
iast_FULL (14.625 ms) : 14332, 14919
.   : milestone, 14625,
iast_GLOBAL (10.308 ms) : 10131, 10486
.   : milestone, 10308,
profiling (8.816 ms) : 8666, 8966
.   : milestone, 8816,
tracing (7.672 ms) : 7562, 7782
.   : milestone, 7672,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.547 ms [4.495 ms, 4.6 ms]	-
iast	9.314 ms [9.154 ms, 9.473 ms]	4.766 ms (104.8%)
iast_FULL	14.224 ms [13.937 ms, 14.511 ms]	9.677 ms (212.8%)
iast_GLOBAL	10.595 ms [10.404 ms, 10.787 ms]	6.048 ms (133.0%)
profiling	8.632 ms [8.493 ms, 8.77 ms]	4.085 ms (89.8%)
tracing	7.311 ms [7.205 ms, 7.418 ms]	2.764 ms (60.8%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	4.49 ms [4.438 ms, 4.542 ms]	-
iast	9.088 ms [8.937 ms, 9.24 ms]	4.598 ms (102.4%)
iast_FULL	14.625 ms [14.332 ms, 14.919 ms]	10.136 ms (225.8%)
iast_GLOBAL	10.308 ms [10.131 ms, 10.486 ms]	5.819 ms (129.6%)
profiling	8.816 ms [8.666 ms, 8.966 ms]	4.326 ms (96.4%)
tracing	7.672 ms [7.562 ms, 7.782 ms]	3.182 ms (70.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	bbujon/environment-step6
git_commit_date	1751637515	1751637564
git_commit_sha	`1de42c8`	`eaf8c40`
release_version	1.51.0-SNAPSHOT~1de42c8097	1.51.0-SNAPSHOT~eaf8c40d59

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1751639565	1751639565
ci_job_id	1014448387	1014448387
ci_pipeline_id	69678605	69678605
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-zh1sh5ej 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-zh1sh5ej 6.8.0-1030-aws #32~22.04.1-Ubuntu SMP Thu Jun 5 08:38:24 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.472 ms) : 1461, 1484
.   : milestone, 1472,
appsec (2.393 ms) : 2344, 2441
.   : milestone, 2393,
iast (2.179 ms) : 2118, 2241
.   : milestone, 2179,
iast_GLOBAL (2.227 ms) : 2165, 2289
.   : milestone, 2227,
profiling (2.035 ms) : 1985, 2084
.   : milestone, 2035,
tracing (2.002 ms) : 1954, 2050
.   : milestone, 2002,
section candidate
no_agent (1.471 ms) : 1459, 1482
.   : milestone, 1471,
appsec (2.392 ms) : 2343, 2441
.   : milestone, 2392,
iast (2.182 ms) : 2120, 2243
.   : milestone, 2182,
iast_GLOBAL (2.224 ms) : 2162, 2286
.   : milestone, 2224,
profiling (2.031 ms) : 1980, 2081
.   : milestone, 2031,
tracing (2.01 ms) : 1962, 2058
.   : milestone, 2010,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.472 ms [1.461 ms, 1.484 ms]	-
appsec	2.393 ms [2.344 ms, 2.441 ms]	920.389 µs (62.5%)
iast	2.179 ms [2.118 ms, 2.241 ms]	707.016 µs (48.0%)
iast_GLOBAL	2.227 ms [2.165 ms, 2.289 ms]	754.855 µs (51.3%)
profiling	2.035 ms [1.985 ms, 2.084 ms]	562.356 µs (38.2%)
tracing	2.002 ms [1.954 ms, 2.05 ms]	529.94 µs (36.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.471 ms [1.459 ms, 1.482 ms]	-
appsec	2.392 ms [2.343 ms, 2.441 ms]	921.133 µs (62.6%)
iast	2.182 ms [2.12 ms, 2.243 ms]	711.021 µs (48.3%)
iast_GLOBAL	2.224 ms [2.162 ms, 2.286 ms]	753.657 µs (51.2%)
profiling	2.031 ms [1.98 ms, 2.081 ms]	560.002 µs (38.1%)
tracing	2.01 ms [1.962 ms, 2.058 ms]	539.167 µs (36.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.51.0-SNAPSHOT~eaf8c40d59, baseline=1.51.0-SNAPSHOT~1de42c8097
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.787 s) : 15787000, 15787000
.   : milestone, 15787000,
appsec (14.858 s) : 14858000, 14858000
.   : milestone, 14858000,
iast (18.279 s) : 18279000, 18279000
.   : milestone, 18279000,
iast_GLOBAL (18.042 s) : 18042000, 18042000
.   : milestone, 18042000,
profiling (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
tracing (14.825 s) : 14825000, 14825000
.   : milestone, 14825000,
section candidate
no_agent (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
appsec (14.732 s) : 14732000, 14732000
.   : milestone, 14732000,
iast (18.174 s) : 18174000, 18174000
.   : milestone, 18174000,
iast_GLOBAL (17.879 s) : 17879000, 17879000
.   : milestone, 17879000,
profiling (15.412 s) : 15412000, 15412000
.   : milestone, 15412000,
tracing (14.765 s) : 14765000, 14765000
.   : milestone, 14765000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.787 s [15.787 s, 15.787 s]	-
appsec	14.858 s [14.858 s, 14.858 s]	-929.0 ms (-5.9%)
iast	18.279 s [18.279 s, 18.279 s]	2.492 s (15.8%)
iast_GLOBAL	18.042 s [18.042 s, 18.042 s]	2.255 s (14.3%)
profiling	15.04 s [15.04 s, 15.04 s]	-747.0 ms (-4.7%)
tracing	14.825 s [14.825 s, 14.825 s]	-962.0 ms (-6.1%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.249 s [15.249 s, 15.249 s]	-
appsec	14.732 s [14.732 s, 14.732 s]	-517.0 ms (-3.4%)
iast	18.174 s [18.174 s, 18.174 s]	2.925 s (19.2%)
iast_GLOBAL	17.879 s [17.879 s, 17.879 s]	2.63 s (17.2%)
profiling	15.412 s [15.412 s, 15.412 s]	163.0 ms (1.1%)
tracing	14.765 s [14.765 s, 14.765 s]	-484.0 ms (-3.2%)

pr-commenter · 2025-07-04T05:38:38Z

Debugger benchmarks

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
ci_job_date	1751606772	1751607155
end_time	2025-07-04T05:27:33	2025-07-04T05:33:55
git_branch	master	bbujon/environment-step6
git_commit_sha	`dd59589`	fea3156fa8b79d432948df471e247e0ff7110769
start_time	2025-07-04T05:26:13	2025-07-04T05:32:36

See matching parameters

	Baseline	Candidate
ci_job_id	1013696559	1013696559
ci_pipeline_id	69642172	69642172
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date	1751605910	1751605910

Summary

Found 6 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 6 unstable metrics.

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:basic	better [-11.729µs; -3.295µs] or [-4.170%; -1.172%]	same	same	unstable [+9.835µs; +202.784µs] or [+1.263%; +26.039%]	unstable [-71.228op/s; +193.179op/s] or [-2.920%; +7.920%]
scenario:loop	better [-654.659µs; -648.815µs] or [-6.148%; -6.093%]	better [-679.771µs; -617.779µs] or [-6.281%; -5.708%]	better [-693.821µs; -583.026µs] or [-6.358%; -5.342%]	better [-824.996µs; -475.204µs] or [-7.351%; -4.234%]	better [+4.956op/s; +6.571op/s] or [+5.426%; +7.195%]

See unchanged results

scenario	Δ mean agg_http_req_duration_min	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p75	Δ mean agg_http_req_duration_p99	Δ mean throughput
scenario:noprobe	unstable [-27.284µs; +14.046µs] or [-9.732%; +5.010%]	unstable [-38.752µs; +23.479µs] or [-12.153%; +7.363%]	unstable [-51.205µs; +32.715µs] or [-15.319%; +9.788%]	unstable [+34.917µs; +246.017µs] or [+3.898%; +27.467%]	same

Request duration reports for reports

gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (318.88 µs) : 284, 354
.   : milestone, 319,
basic (309.805 µs) : 302, 318
.   : milestone, 310,
loop (10.823 ms) : 10801, 10844
.   : milestone, 10823,
section candidate
noprobe (311.244 µs) : 288, 335
.   : milestone, 311,
basic (303.612 µs) : 295, 312
.   : milestone, 304,
loop (10.174 ms) : 10139, 10208
.   : milestone, 10174,

baseline results

Scenario	Request median duration [CI 0.99]
noprobe	318.88 µs [284.218 µs, 353.543 µs]
basic	309.805 µs [301.648 µs, 317.962 µs]
loop	10.823 ms [10.801 ms, 10.844 ms]

candidate results

PerfectSlayer added tag: no release notes Changes to exclude from release notes type: refactoring comp: platform Platform labels Jul 4, 2025

PerfectSlayer force-pushed the bbujon/environment-step5 branch from 4d467d1 to 115d3dc Compare July 4, 2025 05:12

PerfectSlayer force-pushed the bbujon/environment-step6 branch from 721cba2 to fea3156 Compare July 4, 2025 05:17

Base automatically changed from bbujon/environment-step5 to master July 4, 2025 13:58

feat(env): Clean up Platform and CLIHelper component

eaf8c40

PerfectSlayer force-pushed the bbujon/environment-step6 branch from fea3156 to eaf8c40 Compare July 4, 2025 14:00

PerfectSlayer mentioned this pull request Jul 4, 2025

Migrate smoke tests to environment component #9100

Merged

PerfectSlayer marked this pull request as ready for review July 4, 2025 14:00

PerfectSlayer requested review from a team as code owners July 4, 2025 14:00

PerfectSlayer requested review from sarahchen6 and smola and removed request for a team July 4, 2025 14:00

bric3 approved these changes Jul 4, 2025

View reviewed changes

PerfectSlayer enabled auto-merge (squash) July 4, 2025 14:10

PerfectSlayer merged commit bbdc0b7 into master Jul 7, 2025
508 of 509 checks passed

PerfectSlayer deleted the bbujon/environment-step6 branch July 7, 2025 07:24

github-actions Bot added this to the 1.51.0 milestone Jul 7, 2025

Sunbelt Computer Software

PL/B Language Development and Support

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Clean up Platform and CLIHelper component#9101

Clean up Platform and CLIHelper component#9101
PerfectSlayer merged 1 commit into
masterfrom
bbujon/environment-step6

PerfectSlayer commented Jul 4, 2025 •

edited

Loading

Uh oh!

pr-commenter Bot commented Jul 4, 2025 •

edited

Loading

Uh oh!

pr-commenter Bot commented Jul 4, 2025

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Sunbelt Computer Software

PL/B Language Development and Support

Uh oh!

Conversation

PerfectSlayer commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter Bot commented Jul 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

pr-commenter Bot commented Jul 4, 2025

Debugger benchmarks

Parameters

Summary

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

PerfectSlayer commented Jul 4, 2025 •

edited

Loading

pr-commenter Bot commented Jul 4, 2025 •

edited

Loading