Update metrics: appsec.waf.updates and appsec.waf.init #8280

Mariovido · 2025-01-24T10:53:11Z

What Does This Do

This adds a new value to some metrics which is necessary for the consolidation of ASM Span Tags, Metrics, and Logs across all supported languages. The newly value will be implemented in the following metrics:

appsec.waf.updates:
- success: Whether the update resulted in a usable WAF handle
appsec.waf.init:
- success: Whether the initialization resulted in a usable WAF handle

Motivation

Our goal is to implement all the missing ASM Span Tags, Metrics, and Logs.

Additional Notes

Also, this PR adds tests that were missing and some improvements to the previous ones.

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any usefull labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the public documentation in case of new configuration flag or behavior

Jira ticket: APPSEC-56478

pr-commenter · 2025-01-24T11:30:59Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/waf_metrics
git_commit_date	1737654035	1737715654
git_commit_sha	`56d4919`	`952ab27`
release_version	1.46.0-SNAPSHOT~56d4919491	1.46.0-SNAPSHOT~952ab277d5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737718090	1737718090
ci_job_id	779229623	779229623
ci_pipeline_id	53901683	53901683
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-fgow3nxt-project-304-concurrent-1-202v62lm 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-fgow3nxt-project-304-concurrent-1-202v62lm 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None
variant	iast	iast

Summary

Found 1 performance improvements and 9 performance regressions! Performance is the same for 51 metrics, 2 unstable metrics.

scenario	Δ mean execution_time	candidate mean execution_time	baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer	worse [+11.651ms; +18.730ms] or [+5.037%; +8.097%]	246.497ms	231.307ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracer	worse [+14.186ms; +19.272ms] or [+6.171%; +8.383%]	246.629ms	229.900ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracer	worse [+16.054ms; +18.178ms] or [+7.025%; +7.954%]	245.658ms	228.542ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:Remote Config	worse [+20.872µs; +70.256µs] or [+3.244%; +10.920%]	688.925µs	643.361µs
scenario:startup:insecure-bank:tracing:GlobalTracer	worse [+15.401ms; +23.750ms] or [+6.462%; +9.966%]	257.886ms	238.310ms
scenario:startup:petclinic:appsec:GlobalTracer	worse [+14.800ms; +19.401ms] or [+6.275%; +8.226%]	252.951ms	235.851ms
scenario:startup:petclinic:appsec:AppSec	better [-6.690ms; -4.690ms] or [-3.791%; -2.658%]	170.773ms	176.463ms
scenario:startup:petclinic:iast:GlobalTracer	worse [+17.186ms; +18.770ms] or [+7.509%; +8.201%]	246.849ms	228.870ms
scenario:startup:petclinic:tracing:GlobalTracer	worse [+16.219ms; +18.007ms] or [+6.813%; +7.564%]	255.167ms	238.055ms
scenario:startup:petclinic:tracing:Remote Config	worse [+16.675µs; +39.794µs] or [+2.363%; +5.640%]	733.759µs	705.525µs

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1035141
Total [baseline] (8.631 s) : 0, 8630998
Agent [candidate] (1.068 s) : 0, 1067656
Total [candidate] (8.639 s) : 0, 8638741
section iast
Agent [baseline] (1.178 s) : 0, 1177870
Total [baseline] (9.213 s) : 0, 9212995
Agent [candidate] (1.183 s) : 0, 1182549
Total [candidate] (9.193 s) : 0, 9192550
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.17 s) : 0, 1170180
Total [baseline] (9.178 s) : 0, 9177990
Agent [candidate] (1.183 s) : 0, 1183399
Total [candidate] (9.175 s) : 0, 9175210
section iast_TELEMETRY_OFF
Agent [baseline] (1.16 s) : 0, 1159552
Total [baseline] (9.196 s) : 0, 9196167
Agent [candidate] (1.176 s) : 0, 1176117
Total [candidate] (9.197 s) : 0, 9197419

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.035 s	-
Agent	iast	1.178 s	142.729 ms (13.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.17 s	135.039 ms (13.0%)
Agent	iast_TELEMETRY_OFF	1.16 s	124.41 ms (12.0%)
Total	tracing	8.631 s	-
Total	iast	9.213 s	581.997 ms (6.7%)
Total	iast_HARDCODED_SECRET_DISABLED	9.178 s	546.992 ms (6.3%)
Total	iast_TELEMETRY_OFF	9.196 s	565.169 ms (6.5%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.068 s	-
Agent	iast	1.183 s	114.893 ms (10.8%)
Agent	iast_HARDCODED_SECRET_DISABLED	1.183 s	115.742 ms (10.8%)
Agent	iast_TELEMETRY_OFF	1.176 s	108.461 ms (10.2%)
Total	tracing	8.639 s	-
Total	iast	9.193 s	553.81 ms (6.4%)
Total	iast_HARDCODED_SECRET_DISABLED	9.175 s	536.47 ms (6.2%)
Total	iast_TELEMETRY_OFF	9.197 s	558.679 ms (6.5%)

gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (714.117 ms) : 0, 714117
BytebuddyAgent [candidate] (723.646 ms) : 0, 723646
GlobalTracer [baseline] (238.31 ms) : 0, 238310
GlobalTracer [candidate] (257.886 ms) : 0, 257886
AppSec [baseline] (54.889 ms) : 0, 54889
AppSec [candidate] (57.413 ms) : 0, 57413
Remote Config [baseline] (713.98 µs) : 0, 714
Remote Config [candidate] (750.283 µs) : 0, 750
Telemetry [baseline] (12.089 ms) : 0, 12089
Telemetry [candidate] (12.817 ms) : 0, 12817
section iast
BytebuddyAgent [baseline] (842.865 ms) : 0, 842865
BytebuddyAgent [candidate] (831.991 ms) : 0, 831991
GlobalTracer [baseline] (231.307 ms) : 0, 231307
GlobalTracer [candidate] (246.497 ms) : 0, 246497
AppSec [baseline] (58.05 ms) : 0, 58050
AppSec [candidate] (57.887 ms) : 0, 57887
IAST [baseline] (21.264 ms) : 0, 21264
IAST [candidate] (21.678 ms) : 0, 21678
Remote Config [baseline] (650.773 µs) : 0, 651
Remote Config [candidate] (683.622 µs) : 0, 684
Telemetry [baseline] (8.571 ms) : 0, 8571
Telemetry [candidate] (8.753 ms) : 0, 8753
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (836.264 ms) : 0, 836264
BytebuddyAgent [candidate] (832.87 ms) : 0, 832870
GlobalTracer [baseline] (229.9 ms) : 0, 229900
GlobalTracer [candidate] (246.629 ms) : 0, 246629
AppSec [baseline] (58.187 ms) : 0, 58187
AppSec [candidate] (58.241 ms) : 0, 58241
IAST [baseline] (21.371 ms) : 0, 21371
IAST [candidate] (21.263 ms) : 0, 21263
Remote Config [baseline] (667.063 µs) : 0, 667
Remote Config [candidate] (664.302 µs) : 0, 664
Telemetry [baseline] (8.748 ms) : 0, 8748
Telemetry [candidate] (8.67 ms) : 0, 8670
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (828.168 ms) : 0, 828168
BytebuddyAgent [candidate] (827.515 ms) : 0, 827515
GlobalTracer [baseline] (228.542 ms) : 0, 228542
GlobalTracer [candidate] (245.658 ms) : 0, 245658
AppSec [baseline] (57.978 ms) : 0, 57978
AppSec [candidate] (57.785 ms) : 0, 57785
IAST [baseline] (20.729 ms) : 0, 20729
IAST [candidate] (20.812 ms) : 0, 20812
Remote Config [baseline] (643.361 µs) : 0, 643
Remote Config [candidate] (688.925 µs) : 0, 689
Telemetry [baseline] (8.514 ms) : 0, 8514
Telemetry [candidate] (8.658 ms) : 0, 8658

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.035 s) : 0, 1034723
Total [baseline] (10.441 s) : 0, 10441357
Agent [candidate] (1.057 s) : 0, 1056797
Total [candidate] (10.436 s) : 0, 10436069
section appsec
Agent [baseline] (1.176 s) : 0, 1175605
Total [baseline] (10.727 s) : 0, 10727366
Agent [candidate] (1.19 s) : 0, 1190058
Total [candidate] (10.704 s) : 0, 10703843
section iast
Agent [baseline] (1.165 s) : 0, 1164857
Total [baseline] (10.92 s) : 0, 10920410
Agent [candidate] (1.184 s) : 0, 1184264
Total [candidate] (10.912 s) : 0, 10912297
section profiling
Agent [baseline] (1.257 s) : 0, 1256984
Total [baseline] (10.778 s) : 0, 10777849
Agent [candidate] (1.262 s) : 0, 1261815
Total [candidate] (10.895 s) : 0, 10895075

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.035 s	-
Agent	appsec	1.176 s	140.882 ms (13.6%)
Agent	iast	1.165 s	130.134 ms (12.6%)
Agent	profiling	1.257 s	222.261 ms (21.5%)
Total	tracing	10.441 s	-
Total	appsec	10.727 s	286.009 ms (2.7%)
Total	iast	10.92 s	479.053 ms (4.6%)
Total	profiling	10.778 s	336.493 ms (3.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.057 s	-
Agent	appsec	1.19 s	133.261 ms (12.6%)
Agent	iast	1.184 s	127.468 ms (12.1%)
Agent	profiling	1.262 s	205.019 ms (19.4%)
Total	tracing	10.436 s	-
Total	appsec	10.704 s	267.775 ms (2.6%)
Total	iast	10.912 s	476.228 ms (4.6%)
Total	profiling	10.895 s	459.006 ms (4.4%)

gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (713.792 ms) : 0, 713792
BytebuddyAgent [candidate] (714.746 ms) : 0, 714746
GlobalTracer [baseline] (238.055 ms) : 0, 238055
GlobalTracer [candidate] (255.167 ms) : 0, 255167
AppSec [baseline] (56.488 ms) : 0, 56488
AppSec [candidate] (57.546 ms) : 0, 57546
Remote Config [baseline] (705.525 µs) : 0, 706
Remote Config [candidate] (733.759 µs) : 0, 734
Telemetry [baseline] (10.731 ms) : 0, 10731
Telemetry [candidate] (13.51 ms) : 0, 13510
section appsec
BytebuddyAgent [baseline] (729.871 ms) : 0, 729871
BytebuddyAgent [candidate] (732.737 ms) : 0, 732737
GlobalTracer [baseline] (235.851 ms) : 0, 235851
GlobalTracer [candidate] (252.951 ms) : 0, 252951
AppSec [baseline] (176.463 ms) : 0, 176463
AppSec [candidate] (170.773 ms) : 0, 170773
Remote Config [baseline] (664.212 µs) : 0, 664
Remote Config [candidate] (661.255 µs) : 0, 661
Telemetry [baseline] (8.21 ms) : 0, 8210
Telemetry [candidate] (8.222 ms) : 0, 8222
IAST [baseline] (19.31 ms) : 0, 19310
IAST [candidate] (19.389 ms) : 0, 19389
section iast
BytebuddyAgent [baseline] (832.28 ms) : 0, 832280
BytebuddyAgent [candidate] (833.222 ms) : 0, 833222
GlobalTracer [baseline] (228.87 ms) : 0, 228870
GlobalTracer [candidate] (246.849 ms) : 0, 246849
AppSec [baseline] (58.207 ms) : 0, 58207
AppSec [candidate] (58.176 ms) : 0, 58176
Remote Config [baseline] (657.462 µs) : 0, 657
Remote Config [candidate] (678.167 µs) : 0, 678
Telemetry [baseline] (8.688 ms) : 0, 8688
Telemetry [candidate] (8.726 ms) : 0, 8726
IAST [baseline] (21.199 ms) : 0, 21199
IAST [candidate] (21.572 ms) : 0, 21572
section profiling
BytebuddyAgent [baseline] (704.18 ms) : 0, 704180
BytebuddyAgent [candidate] (708.901 ms) : 0, 708901
GlobalTracer [baseline] (348.089 ms) : 0, 348089
GlobalTracer [candidate] (350.908 ms) : 0, 350908
AppSec [baseline] (56.168 ms) : 0, 56168
AppSec [candidate] (54.235 ms) : 0, 54235
Remote Config [baseline] (724.406 µs) : 0, 724
Remote Config [candidate] (714.517 µs) : 0, 715
Telemetry [baseline] (8.962 ms) : 0, 8962
Telemetry [candidate] (8.852 ms) : 0, 8852
ProfilingAgent [baseline] (96.782 ms) : 0, 96782
ProfilingAgent [candidate] (95.832 ms) : 0, 95832
Profiling [baseline] (96.807 ms) : 0, 96807
Profiling [candidate] (95.86 ms) : 0, 95860

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
end_time	2025-01-24T10:58:12	2025-01-24T11:05:14
git_branch	master	mario.vidal/waf_metrics
git_commit_date	1737654035	1737715654
git_commit_sha	`56d4919`	`952ab27`
release_version	1.46.0-SNAPSHOT~56d4919491	1.46.0-SNAPSHOT~952ab277d5
start_time	2025-01-24T10:57:58	2025-01-24T11:05:01

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1737717071	1737717071
ci_job_id	779229624	779229624
ci_pipeline_id	53901683	53901683
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-exthqy6x-project-304-concurrent-0-l64udb87 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-exthqy6x-project-304-concurrent-0-l64udb87 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	iast	iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (387.307 µs) : 361, 413
.   : milestone, 387,
iast (507.334 µs) : 484, 530
.   : milestone, 507,
iast_FULL (740.809 µs) : 718, 764
.   : milestone, 741,
iast_GLOBAL (560.116 µs) : 536, 584
.   : milestone, 560,
iast_HARDCODED_SECRET_DISABLED (506.885 µs) : 484, 530
.   : milestone, 507,
iast_INACTIVE (457.183 µs) : 435, 479
.   : milestone, 457,
iast_TELEMETRY_OFF (495.877 µs) : 472, 519
.   : milestone, 496,
tracing (459.103 µs) : 438, 481
.   : milestone, 459,
section candidate
no_agent (377.408 µs) : 358, 397
.   : milestone, 377,
iast (507.187 µs) : 485, 529
.   : milestone, 507,
iast_FULL (740.763 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (545.695 µs) : 524, 567
.   : milestone, 546,
iast_HARDCODED_SECRET_DISABLED (506.287 µs) : 485, 528
.   : milestone, 506,
iast_INACTIVE (460.179 µs) : 439, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (498.561 µs) : 476, 521
.   : milestone, 499,
tracing (448.675 µs) : 427, 470
.   : milestone, 449,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	387.307 µs [361.428 µs, 413.187 µs]	-
iast	507.334 µs [484.42 µs, 530.248 µs]	120.027 µs (31.0%)
iast_FULL	740.809 µs [717.747 µs, 763.871 µs]	353.502 µs (91.3%)
iast_GLOBAL	560.116 µs [536.409 µs, 583.823 µs]	172.809 µs (44.6%)
iast_HARDCODED_SECRET_DISABLED	506.885 µs [484.09 µs, 529.68 µs]	119.578 µs (30.9%)
iast_INACTIVE	457.183 µs [435.475 µs, 478.892 µs]	69.876 µs (18.0%)
iast_TELEMETRY_OFF	495.877 µs [472.319 µs, 519.435 µs]	108.57 µs (28.0%)
tracing	459.103 µs [437.515 µs, 480.691 µs]	71.796 µs (18.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	377.408 µs [357.868 µs, 396.947 µs]	-
iast	507.187 µs [485.452 µs, 528.922 µs]	129.779 µs (34.4%)
iast_FULL	740.763 µs [718.959 µs, 762.567 µs]	363.355 µs (96.3%)
iast_GLOBAL	545.695 µs [524.22 µs, 567.169 µs]	168.287 µs (44.6%)
iast_HARDCODED_SECRET_DISABLED	506.287 µs [484.51 µs, 528.064 µs]	128.879 µs (34.1%)
iast_INACTIVE	460.179 µs [438.792 µs, 481.565 µs]	82.771 µs (21.9%)
iast_TELEMETRY_OFF	498.561 µs [476.369 µs, 520.753 µs]	121.153 µs (32.1%)
tracing	448.675 µs [427.447 µs, 469.903 µs]	71.267 µs (18.9%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.345 ms) : 1326, 1365
.   : milestone, 1345,
appsec (1.768 ms) : 1745, 1792
.   : milestone, 1768,
appsec_no_iast (1.759 ms) : 1735, 1783
.   : milestone, 1759,
iast (1.507 ms) : 1483, 1530
.   : milestone, 1507,
profiling (1.521 ms) : 1497, 1544
.   : milestone, 1521,
tracing (1.471 ms) : 1446, 1496
.   : milestone, 1471,
section candidate
no_agent (1.348 ms) : 1328, 1368
.   : milestone, 1348,
appsec (1.716 ms) : 1693, 1738
.   : milestone, 1716,
appsec_no_iast (1.754 ms) : 1731, 1777
.   : milestone, 1754,
iast (1.513 ms) : 1490, 1537
.   : milestone, 1513,
profiling (1.517 ms) : 1495, 1540
.   : milestone, 1517,
tracing (1.482 ms) : 1458, 1506
.   : milestone, 1482,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.345 ms [1.326 ms, 1.365 ms]	-
appsec	1.768 ms [1.745 ms, 1.792 ms]	422.983 µs (31.4%)
appsec_no_iast	1.759 ms [1.735 ms, 1.783 ms]	413.184 µs (30.7%)
iast	1.507 ms [1.483 ms, 1.53 ms]	161.169 µs (12.0%)
profiling	1.521 ms [1.497 ms, 1.544 ms]	175.163 µs (13.0%)
tracing	1.471 ms [1.446 ms, 1.496 ms]	125.774 µs (9.3%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.348 ms [1.328 ms, 1.368 ms]	-
appsec	1.716 ms [1.693 ms, 1.738 ms]	367.658 µs (27.3%)
appsec_no_iast	1.754 ms [1.731 ms, 1.777 ms]	405.801 µs (30.1%)
iast	1.513 ms [1.49 ms, 1.537 ms]	165.289 µs (12.3%)
profiling	1.517 ms [1.495 ms, 1.54 ms]	169.269 µs (12.6%)
tracing	1.482 ms [1.458 ms, 1.506 ms]	133.624 µs (9.9%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	mario.vidal/waf_metrics
git_commit_date	1737654035	1737715654
git_commit_sha	`56d4919`	`952ab27`
release_version	1.46.0-SNAPSHOT~56d4919491	1.46.0-SNAPSHOT~952ab277d5

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1737717648	1737717648
ci_job_id	779229625	779229625
ci_pipeline_id	53901683	53901683
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-exthqy6x-project-304-concurrent-1-r2fzoace 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-exthqy6x-project-304-concurrent-1-r2fzoace 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant	appsec	appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.967 s) : 14967000, 14967000
.   : milestone, 14967000,
appsec (15.003 s) : 15003000, 15003000
.   : milestone, 15003000,
iast (18.527 s) : 18527000, 18527000
.   : milestone, 18527000,
iast_GLOBAL (17.998 s) : 17998000, 17998000
.   : milestone, 17998000,
profiling (15.017 s) : 15017000, 15017000
.   : milestone, 15017000,
tracing (14.853 s) : 14853000, 14853000
.   : milestone, 14853000,
section candidate
no_agent (14.948 s) : 14948000, 14948000
.   : milestone, 14948000,
appsec (15.142 s) : 15142000, 15142000
.   : milestone, 15142000,
iast (18.657 s) : 18657000, 18657000
.   : milestone, 18657000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
profiling (14.906 s) : 14906000, 14906000
.   : milestone, 14906000,
tracing (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.967 s [14.967 s, 14.967 s]	-
appsec	15.003 s [15.003 s, 15.003 s]	36.0 ms (0.2%)
iast	18.527 s [18.527 s, 18.527 s]	3.56 s (23.8%)
iast_GLOBAL	17.998 s [17.998 s, 17.998 s]	3.031 s (20.3%)
profiling	15.017 s [15.017 s, 15.017 s]	50.0 ms (0.3%)
tracing	14.853 s [14.853 s, 14.853 s]	-114.0 ms (-0.8%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.948 s [14.948 s, 14.948 s]	-
appsec	15.142 s [15.142 s, 15.142 s]	194.0 ms (1.3%)
iast	18.657 s [18.657 s, 18.657 s]	3.709 s (24.8%)
iast_GLOBAL	18.047 s [18.047 s, 18.047 s]	3.099 s (20.7%)
profiling	14.906 s [14.906 s, 14.906 s]	-42.0 ms (-0.3%)
tracing	14.976 s [14.976 s, 14.976 s]	28.0 ms (0.2%)

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~952ab277d5, baseline=1.46.0-SNAPSHOT~56d4919491
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.485 ms) : 1473, 1496
.   : milestone, 1485,
appsec (2.377 ms) : 2334, 2420
.   : milestone, 2377,
iast (2.122 ms) : 2068, 2176
.   : milestone, 2122,
iast_GLOBAL (2.166 ms) : 2111, 2221
.   : milestone, 2166,
profiling (1.981 ms) : 1937, 2024
.   : milestone, 1981,
tracing (1.949 ms) : 1907, 1991
.   : milestone, 1949,
section candidate
no_agent (1.481 ms) : 1469, 1493
.   : milestone, 1481,
appsec (2.38 ms) : 2337, 2424
.   : milestone, 2380,
iast (2.126 ms) : 2072, 2181
.   : milestone, 2126,
iast_GLOBAL (2.155 ms) : 2101, 2210
.   : milestone, 2155,
profiling (2.007 ms) : 1962, 2052
.   : milestone, 2007,
tracing (1.962 ms) : 1921, 2004
.   : milestone, 1962,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.485 ms [1.473 ms, 1.496 ms]	-
appsec	2.377 ms [2.334 ms, 2.42 ms]	892.021 µs (60.1%)
iast	2.122 ms [2.068 ms, 2.176 ms]	637.276 µs (42.9%)
iast_GLOBAL	2.166 ms [2.111 ms, 2.221 ms]	680.991 µs (45.9%)
profiling	1.981 ms [1.937 ms, 2.024 ms]	495.684 µs (33.4%)
tracing	1.949 ms [1.907 ms, 1.991 ms]	464.202 µs (31.3%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.481 ms [1.469 ms, 1.493 ms]	-
appsec	2.38 ms [2.337 ms, 2.424 ms]	899.48 µs (60.7%)
iast	2.126 ms [2.072 ms, 2.181 ms]	645.47 µs (43.6%)
iast_GLOBAL	2.155 ms [2.101 ms, 2.21 ms]	674.442 µs (45.5%)
profiling	2.007 ms [1.962 ms, 2.052 ms]	526.306 µs (35.5%)
tracing	1.962 ms [1.921 ms, 2.004 ms]	481.486 µs (32.5%)

Update metrics to have success value

952ab27

Mariovido added type: enhancement comp: asm iast Application Security Management (IAST) labels Jan 24, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update metrics: appsec.waf.updates and appsec.waf.init #8280

Update metrics: appsec.waf.updates and appsec.waf.init #8280

Mariovido commented Jan 24, 2025 •

edited by jira bot

Loading

pr-commenter bot commented Jan 24, 2025

Update metrics: appsec.waf.updates and appsec.waf.init #8280

Are you sure you want to change the base?

Update metrics: appsec.waf.updates and appsec.waf.init #8280

Conversation

Mariovido commented Jan 24, 2025 • edited by jira bot Loading

What Does This Do

Motivation

Additional Notes

Contributor Checklist

pr-commenter bot commented Jan 24, 2025

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Mariovido commented Jan 24, 2025 •

edited by jira bot

Loading