Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Tag profiles for serverless #8279

Merged
merged 2 commits into from
Jan 24, 2025
Merged

Tag profiles for serverless #8279

merged 2 commits into from
Jan 24, 2025
+27 −2

Conversation

jbachorik
Copy link
Contributor

@jbachorik jbachorik commented Jan 24, 2025 •
edited by jira bot
Loading

What Does This Do

Adds a tag for profiles collected on serverless

Motivation

Avoid over-billing

Additional Notes

Contributor Checklist

Jira ticket: PROF-11106

@jbachorik jbachorik requested review from a team as code owners January 24, 2025 10:15
@pr-commenter
Copy link

pr-commenter bot commented Jan 24, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/serverless_tag
git_commit_date 1737720979 1737728239
git_commit_sha 3bbea85 5328b1a
release_version 1.46.0-SNAPSHOT~3bbea8564a 1.46.0-SNAPSHOT~5328b1ae2e
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737730818 1737730818
ci_job_id 779520065 779520065
ci_pipeline_id 53921230 53921230
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-3-9koyo0nq 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-3-9koyo0nq 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 57 metrics, 6 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043054
Total [baseline] (8.629 s) : 0, 8628907
Agent [candidate] (1.042 s) : 0, 1042326
Total [candidate] (8.646 s) : 0, 8645966
section iast
Agent [baseline] (1.165 s) : 0, 1165283
Total [baseline] (9.215 s) : 0, 9214885
Agent [candidate] (1.181 s) : 0, 1180716
Total [candidate] (9.209 s) : 0, 9208816
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.165 s) : 0, 1164507
Total [baseline] (9.183 s) : 0, 9183212
Agent [candidate] (1.171 s) : 0, 1170934
Total [candidate] (9.234 s) : 0, 9234291
section iast_TELEMETRY_OFF
Agent [baseline] (1.16 s) : 0, 1159661
Total [baseline] (9.227 s) : 0, 9226930
Agent [candidate] (1.166 s) : 0, 1165541
Total [candidate] (9.244 s) : 0, 9243639
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent iast 1.165 s 122.229 ms (11.7%)
Agent iast_HARDCODED_SECRET_DISABLED 1.165 s 121.453 ms (11.6%)
Agent iast_TELEMETRY_OFF 1.16 s 116.607 ms (11.2%)
Total tracing 8.629 s -
Total iast 9.215 s 585.978 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.183 s 554.305 ms (6.4%)
Total iast_TELEMETRY_OFF 9.227 s 598.023 ms (6.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.042 s -
Agent iast 1.181 s 138.39 ms (13.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.171 s 128.609 ms (12.3%)
Agent iast_TELEMETRY_OFF 1.166 s 123.216 ms (11.8%)
Total tracing 8.646 s -
Total iast 9.209 s 562.85 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.234 s 588.325 ms (6.8%)
Total iast_TELEMETRY_OFF 9.244 s 597.674 ms (6.9%) 
gantt
    title insecure-bank - break down per module: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (717.874 ms) : 0, 717874
BytebuddyAgent [candidate] (718.358 ms) : 0, 718358
GlobalTracer [baseline] (239.514 ms) : 0, 239514
GlobalTracer [candidate] (240.345 ms) : 0, 240345
AppSec [baseline] (55.433 ms) : 0, 55433
AppSec [candidate] (55.566 ms) : 0, 55566
Remote Config [baseline] (720.705 µs) : 0, 721
Remote Config [candidate] (719.751 µs) : 0, 720
Telemetry [baseline] (14.502 ms) : 0, 14502
Telemetry [candidate] (12.324 ms) : 0, 12324
section iast
BytebuddyAgent [baseline] (832.212 ms) : 0, 832212
BytebuddyAgent [candidate] (843.391 ms) : 0, 843391
GlobalTracer [baseline] (229.449 ms) : 0, 229449
GlobalTracer [candidate] (232.106 ms) : 0, 232106
AppSec [baseline] (58.001 ms) : 0, 58001
AppSec [candidate] (57.919 ms) : 0, 57919
IAST [baseline] (21.329 ms) : 0, 21329
IAST [candidate] (22.55 ms) : 0, 22550
Remote Config [baseline] (680.616 µs) : 0, 681
Remote Config [candidate] (671.73 µs) : 0, 672
Telemetry [baseline] (8.624 ms) : 0, 8624
Telemetry [candidate] (8.837 ms) : 0, 8837
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (831.579 ms) : 0, 831579
BytebuddyAgent [candidate] (837.215 ms) : 0, 837215
GlobalTracer [baseline] (228.895 ms) : 0, 228895
GlobalTracer [candidate] (229.526 ms) : 0, 229526
AppSec [baseline] (58.298 ms) : 0, 58298
AppSec [candidate] (58.17 ms) : 0, 58170
IAST [baseline] (21.341 ms) : 0, 21341
IAST [candidate] (21.489 ms) : 0, 21489
Remote Config [baseline] (656.389 µs) : 0, 656
Remote Config [candidate] (663.208 µs) : 0, 663
Telemetry [baseline] (8.747 ms) : 0, 8747
Telemetry [candidate] (8.722 ms) : 0, 8722
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (827.36 ms) : 0, 827360
BytebuddyAgent [candidate] (831.647 ms) : 0, 831647
GlobalTracer [baseline] (229.065 ms) : 0, 229065
GlobalTracer [candidate] (230.779 ms) : 0, 230779
AppSec [baseline] (58.145 ms) : 0, 58145
AppSec [candidate] (58.002 ms) : 0, 58002
IAST [baseline] (20.802 ms) : 0, 20802
IAST [candidate] (20.828 ms) : 0, 20828
Remote Config [baseline] (649.656 µs) : 0, 650
Remote Config [candidate] (654.639 µs) : 0, 655
Telemetry [baseline] (8.631 ms) : 0, 8631
Telemetry [candidate] (8.553 ms) : 0, 8553
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.043 s) : 0, 1043127
Total [baseline] (10.471 s) : 0, 10471011
Agent [candidate] (1.04 s) : 0, 1039963
Total [candidate] (10.408 s) : 0, 10408107
section appsec
Agent [baseline] (1.175 s) : 0, 1175368
Total [baseline] (10.743 s) : 0, 10742523
Agent [candidate] (1.179 s) : 0, 1179352
Total [candidate] (10.734 s) : 0, 10734105
section iast
Agent [baseline] (1.165 s) : 0, 1165386
Total [baseline] (10.988 s) : 0, 10987759
Agent [candidate] (1.164 s) : 0, 1163781
Total [candidate] (10.916 s) : 0, 10915808
section profiling
Agent [baseline] (1.251 s) : 0, 1250748
Total [baseline] (10.795 s) : 0, 10795092
Agent [candidate] (1.256 s) : 0, 1256003
Total [candidate] (10.827 s) : 0, 10826834
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.175 s 132.241 ms (12.7%)
Agent iast 1.165 s 122.259 ms (11.7%)
Agent profiling 1.251 s 207.62 ms (19.9%)
Total tracing 10.471 s -
Total appsec 10.743 s 271.512 ms (2.6%)
Total iast 10.988 s 516.748 ms (4.9%)
Total profiling 10.795 s 324.081 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.04 s -
Agent appsec 1.179 s 139.389 ms (13.4%)
Agent iast 1.164 s 123.818 ms (11.9%)
Agent profiling 1.256 s 216.04 ms (20.8%)
Total tracing 10.408 s -
Total appsec 10.734 s 325.997 ms (3.1%)
Total iast 10.916 s 507.701 ms (4.9%)
Total profiling 10.827 s 418.727 ms (4.0%) 
gantt
    title petclinic - break down per module: candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (718.697 ms) : 0, 718697
BytebuddyAgent [candidate] (715.472 ms) : 0, 715472
GlobalTracer [baseline] (239.77 ms) : 0, 239770
GlobalTracer [candidate] (239.696 ms) : 0, 239696
AppSec [baseline] (55.236 ms) : 0, 55236
AppSec [candidate] (55.315 ms) : 0, 55315
Remote Config [baseline] (731.404 µs) : 0, 731
Remote Config [candidate] (710.141 µs) : 0, 710
Telemetry [baseline] (13.71 ms) : 0, 13710
Telemetry [candidate] (13.665 ms) : 0, 13665
section appsec
BytebuddyAgent [baseline] (729.797 ms) : 0, 729797
BytebuddyAgent [candidate] (732.781 ms) : 0, 732781
GlobalTracer [baseline] (235.708 ms) : 0, 235708
GlobalTracer [candidate] (236.604 ms) : 0, 236604
AppSec [baseline] (176.115 ms) : 0, 176115
AppSec [candidate] (176.453 ms) : 0, 176453
IAST [baseline] (19.251 ms) : 0, 19251
IAST [candidate] (19.269 ms) : 0, 19269
Remote Config [baseline] (679.58 µs) : 0, 680
Remote Config [candidate] (670.987 µs) : 0, 671
Telemetry [baseline] (8.513 ms) : 0, 8513
Telemetry [candidate] (8.194 ms) : 0, 8194
section iast
BytebuddyAgent [baseline] (831.005 ms) : 0, 831005
BytebuddyAgent [candidate] (831.13 ms) : 0, 831130
GlobalTracer [baseline] (230.509 ms) : 0, 230509
GlobalTracer [candidate] (228.955 ms) : 0, 228955
AppSec [baseline] (57.972 ms) : 0, 57972
AppSec [candidate] (58.145 ms) : 0, 58145
IAST [baseline] (21.562 ms) : 0, 21562
IAST [candidate] (21.244 ms) : 0, 21244
Remote Config [baseline] (660.702 µs) : 0, 661
Remote Config [candidate] (642.065 µs) : 0, 642
Telemetry [baseline] (8.675 ms) : 0, 8675
Telemetry [candidate] (8.669 ms) : 0, 8669
section profiling
BytebuddyAgent [baseline] (702.84 ms) : 0, 702840
BytebuddyAgent [candidate] (704.651 ms) : 0, 704651
GlobalTracer [baseline] (346.574 ms) : 0, 346574
GlobalTracer [candidate] (349.241 ms) : 0, 349241
AppSec [baseline] (55.036 ms) : 0, 55036
AppSec [candidate] (54.707 ms) : 0, 54707
Remote Config [baseline] (716.679 µs) : 0, 717
Remote Config [candidate] (726.132 µs) : 0, 726
Telemetry [baseline] (8.787 ms) : 0, 8787
Telemetry [candidate] (8.893 ms) : 0, 8893
ProfilingAgent [baseline] (94.878 ms) : 0, 94878
ProfilingAgent [candidate] (95.75 ms) : 0, 95750
Profiling [baseline] (94.902 ms) : 0, 94902
Profiling [candidate] (95.774 ms) : 0, 95774
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-01-24T14:32:14 2025-01-24T14:39:16
git_branch master jb/serverless_tag
git_commit_date 1737720979 1737728239
git_commit_sha 3bbea85 5328b1a
release_version 1.46.0-SNAPSHOT~3bbea8564a 1.46.0-SNAPSHOT~5328b1ae2e
start_time 2025-01-24T14:32:00 2025-01-24T14:39:03
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1737729913 1737729913
ci_job_id 779520066 779520066
ci_pipeline_id 53921230 53921230
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-xugqgpm8-project-304-concurrent-4-pup3rk4y 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-xugqgpm8-project-304-concurrent-4-pup3rk4y 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (376.576 µs) : 357, 396
.   : milestone, 377,
iast (503.627 µs) : 481, 527
.   : milestone, 504,
iast_FULL (743.353 µs) : 720, 766
.   : milestone, 743,
iast_GLOBAL (549.002 µs) : 526, 572
.   : milestone, 549,
iast_HARDCODED_SECRET_DISABLED (505.484 µs) : 483, 528
.   : milestone, 505,
iast_INACTIVE (456.952 µs) : 435, 478
.   : milestone, 457,
iast_TELEMETRY_OFF (496.622 µs) : 473, 520
.   : milestone, 497,
tracing (452.697 µs) : 431, 474
.   : milestone, 453,
section candidate
no_agent (373.985 µs) : 354, 394
.   : milestone, 374,
iast (500.555 µs) : 478, 523
.   : milestone, 501,
iast_FULL (738.446 µs) : 716, 761
.   : milestone, 738,
iast_GLOBAL (559.365 µs) : 536, 583
.   : milestone, 559,
iast_HARDCODED_SECRET_DISABLED (506.658 µs) : 484, 530
.   : milestone, 507,
iast_INACTIVE (458.049 µs) : 436, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (494.974 µs) : 472, 518
.   : milestone, 495,
tracing (455.001 µs) : 434, 476
.   : milestone, 455,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 376.576 µs [356.979 µs, 396.173 µs] -
iast 503.627 µs [480.739 µs, 526.516 µs] 127.051 µs (33.7%)
iast_FULL 743.353 µs [720.364 µs, 766.342 µs] 366.777 µs (97.4%)
iast_GLOBAL 549.002 µs [525.774 µs, 572.229 µs] 172.426 µs (45.8%)
iast_HARDCODED_SECRET_DISABLED 505.484 µs [482.536 µs, 528.432 µs] 128.908 µs (34.2%)
iast_INACTIVE 456.952 µs [435.491 µs, 478.413 µs] 80.376 µs (21.3%)
iast_TELEMETRY_OFF 496.622 µs [473.326 µs, 519.919 µs] 120.047 µs (31.9%)
tracing 452.697 µs [431.41 µs, 473.985 µs] 76.121 µs (20.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 373.985 µs [353.535 µs, 394.434 µs] -
iast 500.555 µs [478.237 µs, 522.873 µs] 126.57 µs (33.8%)
iast_FULL 738.446 µs [716.332 µs, 760.561 µs] 364.462 µs (97.5%)
iast_GLOBAL 559.365 µs [535.644 µs, 583.086 µs] 185.38 µs (49.6%)
iast_HARDCODED_SECRET_DISABLED 506.658 µs [483.814 µs, 529.501 µs] 132.673 µs (35.5%)
iast_INACTIVE 458.049 µs [436.451 µs, 479.647 µs] 84.064 µs (22.5%)
iast_TELEMETRY_OFF 494.974 µs [471.55 µs, 518.397 µs] 120.989 µs (32.4%)
tracing 455.001 µs [433.767 µs, 476.236 µs] 81.017 µs (21.7%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.354 ms) : 1334, 1375
.   : milestone, 1354,
appsec (1.744 ms) : 1721, 1767
.   : milestone, 1744,
appsec_no_iast (1.735 ms) : 1709, 1761
.   : milestone, 1735,
iast (1.507 ms) : 1482, 1531
.   : milestone, 1507,
profiling (1.533 ms) : 1509, 1557
.   : milestone, 1533,
tracing (1.468 ms) : 1443, 1493
.   : milestone, 1468,
section candidate
no_agent (1.366 ms) : 1347, 1386
.   : milestone, 1366,
appsec (1.732 ms) : 1708, 1755
.   : milestone, 1732,
appsec_no_iast (1.745 ms) : 1720, 1770
.   : milestone, 1745,
iast (1.494 ms) : 1470, 1519
.   : milestone, 1494,
profiling (1.507 ms) : 1484, 1531
.   : milestone, 1507,
tracing (1.487 ms) : 1461, 1513
.   : milestone, 1487,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.354 ms [1.334 ms, 1.375 ms] -
appsec 1.744 ms [1.721 ms, 1.767 ms] 390.219 µs (28.8%)
appsec_no_iast 1.735 ms [1.709 ms, 1.761 ms] 380.989 µs (28.1%)
iast 1.507 ms [1.482 ms, 1.531 ms] 152.415 µs (11.3%)
profiling 1.533 ms [1.509 ms, 1.557 ms] 178.89 µs (13.2%)
tracing 1.468 ms [1.443 ms, 1.493 ms] 113.872 µs (8.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.347 ms, 1.386 ms] -
appsec 1.732 ms [1.708 ms, 1.755 ms] 365.244 µs (26.7%)
appsec_no_iast 1.745 ms [1.72 ms, 1.77 ms] 378.468 µs (27.7%)
iast 1.494 ms [1.47 ms, 1.519 ms] 127.899 µs (9.4%)
profiling 1.507 ms [1.484 ms, 1.531 ms] 140.812 µs (10.3%)
tracing 1.487 ms [1.461 ms, 1.513 ms] 120.439 µs (8.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jb/serverless_tag
git_commit_date 1737720979 1737728239
git_commit_sha 3bbea85 5328b1a
release_version 1.46.0-SNAPSHOT~3bbea8564a 1.46.0-SNAPSHOT~5328b1ae2e
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1737730485 1737730485
ci_job_id 779520067 779520067
ci_pipeline_id 53921230 53921230
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-dmnxfugi-project-304-concurrent-3-570t87tp 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Linux runner-dmnxfugi-project-304-concurrent-3-570t87tp 6.8.0-1018-aws #19~22.04.1-Ubuntu SMP Wed Oct 9 16:48:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.475 ms) : 1463, 1486
.   : milestone, 1475,
appsec (2.359 ms) : 2316, 2402
.   : milestone, 2359,
iast (2.11 ms) : 2056, 2164
.   : milestone, 2110,
iast_GLOBAL (2.158 ms) : 2103, 2212
.   : milestone, 2158,
profiling (2.005 ms) : 1960, 2051
.   : milestone, 2005,
tracing (1.952 ms) : 1910, 1995
.   : milestone, 1952,
section candidate
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (2.352 ms) : 2309, 2395
.   : milestone, 2352,
iast (2.109 ms) : 2055, 2164
.   : milestone, 2109,
iast_GLOBAL (2.155 ms) : 2101, 2210
.   : milestone, 2155,
profiling (2.468 ms) : 2280, 2656
.   : milestone, 2468,
tracing (1.959 ms) : 1917, 2001
.   : milestone, 1959,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.475 ms [1.463 ms, 1.486 ms] -
appsec 2.359 ms [2.316 ms, 2.402 ms] 884.098 µs (60.0%)
iast 2.11 ms [2.056 ms, 2.164 ms] 635.232 µs (43.1%)
iast_GLOBAL 2.158 ms [2.103 ms, 2.212 ms] 682.83 µs (46.3%)
profiling 2.005 ms [1.96 ms, 2.051 ms] 530.751 µs (36.0%)
tracing 1.952 ms [1.91 ms, 1.995 ms] 477.646 µs (32.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.465 ms, 1.488 ms] -
appsec 2.352 ms [2.309 ms, 2.395 ms] 875.719 µs (59.3%)
iast 2.109 ms [2.055 ms, 2.164 ms] 633.019 µs (42.9%)
iast_GLOBAL 2.155 ms [2.101 ms, 2.21 ms] 678.889 µs (46.0%)
profiling 2.468 ms [2.28 ms, 2.656 ms] 991.673 µs (67.2%)
tracing 1.959 ms [1.917 ms, 2.001 ms] 482.675 µs (32.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.46.0-SNAPSHOT~5328b1ae2e, baseline=1.46.0-SNAPSHOT~3bbea8564a
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
appsec (15.036 s) : 15036000, 15036000
.   : milestone, 15036000,
iast (18.545 s) : 18545000, 18545000
.   : milestone, 18545000,
iast_GLOBAL (18.205 s) : 18205000, 18205000
.   : milestone, 18205000,
profiling (15.108 s) : 15108000, 15108000
.   : milestone, 15108000,
tracing (15.367 s) : 15367000, 15367000
.   : milestone, 15367000,
section candidate
no_agent (14.936 s) : 14936000, 14936000
.   : milestone, 14936000,
appsec (15.219 s) : 15219000, 15219000
.   : milestone, 15219000,
iast (18.969 s) : 18969000, 18969000
.   : milestone, 18969000,
iast_GLOBAL (18.142 s) : 18142000, 18142000
.   : milestone, 18142000,
profiling (15.583 s) : 15583000, 15583000
.   : milestone, 15583000,
tracing (15.028 s) : 15028000, 15028000
.   : milestone, 15028000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.957 s [14.957 s, 14.957 s] -
appsec 15.036 s [15.036 s, 15.036 s] 79.0 ms (0.5%)
iast 18.545 s [18.545 s, 18.545 s] 3.588 s (24.0%)
iast_GLOBAL 18.205 s [18.205 s, 18.205 s] 3.248 s (21.7%)
profiling 15.108 s [15.108 s, 15.108 s] 151.0 ms (1.0%)
tracing 15.367 s [15.367 s, 15.367 s] 410.0 ms (2.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.936 s [14.936 s, 14.936 s] -
appsec 15.219 s [15.219 s, 15.219 s] 283.0 ms (1.9%)
iast 18.969 s [18.969 s, 18.969 s] 4.033 s (27.0%)
iast_GLOBAL 18.142 s [18.142 s, 18.142 s] 3.206 s (21.5%)
profiling 15.583 s [15.583 s, 15.583 s] 647.0 ms (4.3%)
tracing 15.028 s [15.028 s, 15.028 s] 92.0 ms (0.6%)

PerfectSlayer
PerfectSlayer approved these changes Jan 24, 2025
View reviewed changes
Copy link
Contributor

@PerfectSlayer PerfectSlayer left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Sounds good to me.

Nitpick: there are weird changes related to wildcard imports 🤔

...ing/profiling-uploader/src/test/java/com/datadog/profiling/uploader/ProfileUploaderTest.java Outdated Show resolved Hide resolved
internal-api/src/main/java/datadog/trace/api/Config.java Show resolved Hide resolved
@jbachorik jbachorik merged commit 088b7bf into master Jan 24, 2025
176 checks passed
@jbachorik jbachorik deleted the jb/serverless_tag branch January 24, 2025 15:57
@github-actions github-actions bot added this to the 1.46.0 milestone Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

Assignees
No one assigned
Labels
comp: profiling Profiling type: enhancement type:task
Projects
None yet
Milestone
1.46.0
Development

Successfully merging this pull request may close these issues.
2 participants
@jbachorik @PerfectSlayer