Skip to content

Limit heap size for Gradle daemons forked by the smoke tests #10089

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
nikita-tkachenko-datadog wants to merge 4 commits into
base: master
Choose a base branch
from
Open

Limit heap size for Gradle daemons forked by the smoke tests #10089

nikita-tkachenko-datadog wants to merge 4 commits into from
+2 −5

Conversation

@nikita-tkachenko-datadog
Copy link
Contributor

@nikita-tkachenko-datadog nikita-tkachenko-datadog commented Dec 5, 2025

What Does This Do

Limits heap size to 256mb for the processes forked by CI Visibility smoke tests (Gradle daemons, Maven builds, JUnit console runs).

Motivation

The projects built in the smoke tests are tiny, and 256 mb heap should be sufficient for the build systems.
We have seen some Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) errors before that, we suspect, are caused by running out of memory.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@nikita-tkachenko-datadog nikita-tkachenko-datadog requested a review from a team as a code owner December 5, 2025 13:16
@nikita-tkachenko-datadog nikita-tkachenko-datadog added comp: testing Testing tag: no release notes Changes to exclude from release notes comp: ci visibility Continuous Integration Visibility run-tests: all Run all tests labels Dec 5, 2025
@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sbt-scalatest

Job Status: success

Scenario Overhead (%)
agent 61.28
agentEvpProxy 61.13

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - nebula-release-plugin

Job Status: success

Scenario Overhead (%)
agent 42.19
agentless 47.85
agentlessCodeCoverage 50.36
agentlessLineCoverage 75.72

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - pass4s

Job Status: success

Scenario Overhead (%)
agent 8.13
agentless 7.81
agentlessCodeCoverage 13.47

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - netflix-zuul

Job Status: failed

Scenario Overhead (%)
agent 89.83
agentless 100.48
agentlessCodeCoverage 103.55
agentlessLineCoverage 117.81

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - reactive-streams-jvm

Job Status: success

Scenario Overhead (%)
agent 22.82
agentless 20.50
agentlessCodeCoverage 20.66
agentlessLineCoverage 31.41

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sonar-kotlin

Job Status: success

Scenario Overhead (%)
agent 14.09
agentless 15.52
agentlessCodeCoverage 16.05
agentlessLineCoverage 20.11

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - okhttp

Job Status: success

Scenario Overhead (%)
agent 17.34
agentless 17.20
agentlessCodeCoverage 19.75
agentlessLineCoverage 36.77

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - spring_boot

Job Status: success

Scenario Overhead (%)
agent 11.35
agentless 6.03
agentlessCodeCoverage 10.43
agentlessLineCoverage 29.20

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - jolokia

Job Status: failed

Scenario Overhead (%)
agent 94.06
agentless 95.79
agentlessCodeCoverage 99.93
agentlessLineCoverage 104.61

@cit-pr-commenter
Copy link

cit-pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Test Environment - sonar-java

Job Status: success

Scenario Overhead (%)
agent 14.43
agentless 26.96
agentlessCodeCoverage 76.56
agentlessLineCoverage 172.52

@pr-commenter
Copy link

pr-commenter bot commented Dec 5, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1764970693 1765030284
git_commit_sha 823cec6 b899da7
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~b899da7ab8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765032415 1765032415
ci_job_id 1274006971 1274006971
ci_pipeline_id 85116882 85116882
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-tjonl4wb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-tjonl4wb 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 59 metrics, 6 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.088 s) : 0, 1087901
Total [baseline] (10.863 s) : 0, 10862562
Agent [candidate] (1.088 s) : 0, 1088447
Total [candidate] (10.851 s) : 0, 10851118
section appsec
Agent [baseline] (1.263 s) : 0, 1263009
Total [baseline] (11.119 s) : 0, 11118867
Agent [candidate] (1.262 s) : 0, 1261712
Total [candidate] (11.042 s) : 0, 11041794
section iast
Agent [baseline] (1.221 s) : 0, 1220741
Total [baseline] (11.177 s) : 0, 11177055
Agent [candidate] (1.223 s) : 0, 1223230
Total [candidate] (11.181 s) : 0, 11180639
section profiling
Agent [baseline] (1.202 s) : 0, 1202052
Total [baseline] (11.005 s) : 0, 11005101
Agent [candidate] (1.204 s) : 0, 1204330
Total [candidate] (10.954 s) : 0, 10953704
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent appsec 1.263 s 175.108 ms (16.1%)
Agent iast 1.221 s 132.84 ms (12.2%)
Agent profiling 1.202 s 114.151 ms (10.5%)
Total tracing 10.863 s -
Total appsec 11.119 s 256.305 ms (2.4%)
Total iast 11.177 s 314.493 ms (2.9%)
Total profiling 11.005 s 142.539 ms (1.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.088 s -
Agent appsec 1.262 s 173.265 ms (15.9%)
Agent iast 1.223 s 134.783 ms (12.4%)
Agent profiling 1.204 s 115.883 ms (10.6%)
Total tracing 10.851 s -
Total appsec 11.042 s 190.676 ms (1.8%)
Total iast 11.181 s 329.521 ms (3.0%)
Total profiling 10.954 s 102.586 ms (0.9%) 
gantt
    title petclinic - break down per module: candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.218 ms) : 0, 1218
crashtracking [candidate] (1.203 ms) : 0, 1203
BytebuddyAgent [baseline] (652.504 ms) : 0, 652504
BytebuddyAgent [candidate] (653.433 ms) : 0, 653433
GlobalTracer [baseline] (283.291 ms) : 0, 283291
GlobalTracer [candidate] (283.542 ms) : 0, 283542
AppSec [baseline] (32.807 ms) : 0, 32807
AppSec [candidate] (32.744 ms) : 0, 32744
Debugger [baseline] (68.966 ms) : 0, 68966
Debugger [candidate] (68.247 ms) : 0, 68247
Remote Config [baseline] (671.267 µs) : 0, 671
Remote Config [candidate] (660.61 µs) : 0, 661
Telemetry [baseline] (9.034 ms) : 0, 9034
Telemetry [candidate] (9.163 ms) : 0, 9163
Flare Poller [baseline] (3.738 ms) : 0, 3738
Flare Poller [candidate] (3.779 ms) : 0, 3779
section appsec
crashtracking [baseline] (1.198 ms) : 0, 1198
crashtracking [candidate] (1.185 ms) : 0, 1185
BytebuddyAgent [baseline] (688.746 ms) : 0, 688746
BytebuddyAgent [candidate] (688.441 ms) : 0, 688441
GlobalTracer [baseline] (258.628 ms) : 0, 258628
GlobalTracer [candidate] (258.504 ms) : 0, 258504
IAST [baseline] (24.555 ms) : 0, 24555
IAST [candidate] (24.519 ms) : 0, 24519
AppSec [baseline] (173.172 ms) : 0, 173172
AppSec [candidate] (174.185 ms) : 0, 174185
Debugger [baseline] (67.966 ms) : 0, 67966
Debugger [candidate] (66.096 ms) : 0, 66096
Remote Config [baseline] (688.754 µs) : 0, 689
Remote Config [candidate] (699.356 µs) : 0, 699
Telemetry [baseline] (8.767 ms) : 0, 8767
Telemetry [candidate] (8.836 ms) : 0, 8836
Flare Poller [baseline] (3.728 ms) : 0, 3728
Flare Poller [candidate] (3.766 ms) : 0, 3766
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (788.962 ms) : 0, 788962
BytebuddyAgent [candidate] (791.2 ms) : 0, 791200
GlobalTracer [baseline] (254.806 ms) : 0, 254806
GlobalTracer [candidate] (255.1 ms) : 0, 255100
IAST [baseline] (28.052 ms) : 0, 28052
IAST [candidate] (27.06 ms) : 0, 27060
AppSec [baseline] (34.423 ms) : 0, 34423
AppSec [candidate] (35.097 ms) : 0, 35097
Debugger [baseline] (65.563 ms) : 0, 65563
Debugger [candidate] (65.794 ms) : 0, 65794
Remote Config [baseline] (549.103 µs) : 0, 549
Remote Config [candidate] (535.389 µs) : 0, 535
Telemetry [baseline] (8.431 ms) : 0, 8431
Telemetry [candidate] (8.395 ms) : 0, 8395
Flare Poller [baseline] (3.44 ms) : 0, 3440
Flare Poller [candidate] (3.476 ms) : 0, 3476
section profiling
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.199 ms) : 0, 1199
BytebuddyAgent [baseline] (700.405 ms) : 0, 700405
BytebuddyAgent [candidate] (701.234 ms) : 0, 701234
GlobalTracer [baseline] (220.252 ms) : 0, 220252
GlobalTracer [candidate] (220.594 ms) : 0, 220594
AppSec [baseline] (32.129 ms) : 0, 32129
AppSec [candidate] (32.285 ms) : 0, 32285
Debugger [baseline] (67.899 ms) : 0, 67899
Debugger [candidate] (67.92 ms) : 0, 67920
Remote Config [baseline] (650.97 µs) : 0, 651
Remote Config [candidate] (672.493 µs) : 0, 672
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (9.161 ms) : 0, 9161
Flare Poller [baseline] (3.784 ms) : 0, 3784
Flare Poller [candidate] (3.748 ms) : 0, 3748
ProfilingAgent [baseline] (97.349 ms) : 0, 97349
ProfilingAgent [candidate] (97.996 ms) : 0, 97996
Profiling [baseline] (97.923 ms) : 0, 97923
Profiling [candidate] (98.565 ms) : 0, 98565
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.086 s) : 0, 1086193
Total [baseline] (8.756 s) : 0, 8756087
Agent [candidate] (1.078 s) : 0, 1077595
Total [candidate] (8.729 s) : 0, 8729037
section iast
Agent [baseline] (1.22 s) : 0, 1220212
Total [baseline] (9.455 s) : 0, 9455163
Agent [candidate] (1.218 s) : 0, 1217868
Total [candidate] (9.462 s) : 0, 9461989
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent iast 1.22 s 134.02 ms (12.3%)
Total tracing 8.756 s -
Total iast 9.455 s 699.076 ms (8.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.078 s -
Agent iast 1.218 s 140.273 ms (13.0%)
Total tracing 8.729 s -
Total iast 9.462 s 732.951 ms (8.4%) 
gantt
    title insecure-bank - break down per module: candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.189 ms) : 0, 1189
BytebuddyAgent [baseline] (651.075 ms) : 0, 651075
BytebuddyAgent [candidate] (647.411 ms) : 0, 647411
GlobalTracer [baseline] (284.212 ms) : 0, 284212
GlobalTracer [candidate] (281.068 ms) : 0, 281068
AppSec [baseline] (32.886 ms) : 0, 32886
AppSec [candidate] (32.224 ms) : 0, 32224
Debugger [baseline] (67.56 ms) : 0, 67560
Debugger [candidate] (66.861 ms) : 0, 66861
Remote Config [baseline] (664.417 µs) : 0, 664
Remote Config [candidate] (665.086 µs) : 0, 665
Telemetry [baseline] (9.128 ms) : 0, 9128
Telemetry [candidate] (8.966 ms) : 0, 8966
Flare Poller [baseline] (3.804 ms) : 0, 3804
Flare Poller [candidate] (3.701 ms) : 0, 3701
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (789.628 ms) : 0, 789628
BytebuddyAgent [candidate] (787.443 ms) : 0, 787443
GlobalTracer [baseline] (254.794 ms) : 0, 254794
GlobalTracer [candidate] (255.087 ms) : 0, 255087
AppSec [baseline] (35.013 ms) : 0, 35013
AppSec [candidate] (35.032 ms) : 0, 35032
Debugger [baseline] (64.778 ms) : 0, 64778
Debugger [candidate] (64.484 ms) : 0, 64484
Remote Config [baseline] (535.525 µs) : 0, 536
Remote Config [candidate] (524.885 µs) : 0, 525
Telemetry [baseline] (8.417 ms) : 0, 8417
Telemetry [candidate] (8.436 ms) : 0, 8436
Flare Poller [baseline] (3.4 ms) : 0, 3400
Flare Poller [candidate] (3.443 ms) : 0, 3443
IAST [baseline] (27.055 ms) : 0, 27055
IAST [candidate] (26.901 ms) : 0, 26901
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1764970693 1765030284
git_commit_sha 823cec6 b899da7
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~b899da7ab8
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1765032641 1765032641
ci_job_id 1274006973 1274006973
ci_pipeline_id 85116882 85116882
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-ha6iuje2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-ha6iuje2 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 1 performance improvements and 3 performance regressions! Performance is the same for 16 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:profiling:high_load worse
[+103.358µs; +225.728µs] or [+6.409%; +13.997%]		 unstable
[+508.074µs; +1401.972µs] or [+11.167%; +30.813%]		 unstable
[-587.538op/s; -50.899op/s] or [-25.550%; -2.213%]		 1.777ms 5.505ms 1980.375op/s 1.613ms 4.550ms 2299.594op/s
scenario:load:petclinic:tracing:high_load better
[-1.381ms; -0.787ms] or [-7.548%; -4.299%]		 unsure
[-1502.403µs; -387.843µs] or [-5.044%; -1.302%]		 unstable
[-12.139op/s; +40.764op/s] or [-4.858%; +16.314%]		 17.214ms 28.840ms 264.188op/s 18.297ms 29.785ms 249.875op/s
scenario:load:petclinic:profiling:high_load worse
[+0.814ms; +1.600ms] or [+4.505%; +8.853%]		 worse
[+0.672ms; +2.116ms] or [+2.268%; +7.144%]		 unstable
[-39.042op/s; +12.167op/s] or [-15.468%; +4.820%]		 19.283ms 31.019ms 238.969op/s 18.075ms 29.625ms 252.406op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.063 ms) : 18869, 19257
.   : milestone, 19063,
appsec (19.936 ms) : 19731, 20142
.   : milestone, 19936,
code_origins (17.669 ms) : 17492, 17846
.   : milestone, 17669,
iast (17.725 ms) : 17548, 17901
.   : milestone, 17725,
profiling (18.488 ms) : 18305, 18670
.   : milestone, 18488,
tracing (18.676 ms) : 18491, 18862
.   : milestone, 18676,
section candidate
no_agent (18.363 ms) : 18174, 18552
.   : milestone, 18363,
appsec (19.679 ms) : 19482, 19875
.   : milestone, 19679,
code_origins (17.711 ms) : 17538, 17885
.   : milestone, 17711,
iast (17.872 ms) : 17694, 18050
.   : milestone, 17872,
profiling (19.532 ms) : 19332, 19733
.   : milestone, 19532,
tracing (17.66 ms) : 17483, 17837
.   : milestone, 17660,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.063 ms [18.869 ms, 19.257 ms] -
appsec 19.936 ms [19.731 ms, 20.142 ms] 873.328 µs (4.6%)
code_origins 17.669 ms [17.492 ms, 17.846 ms] -1.394 ms (-7.3%)
iast 17.725 ms [17.548 ms, 17.901 ms] -1.338 ms (-7.0%)
profiling 18.488 ms [18.305 ms, 18.67 ms] -575.378 µs (-3.0%)
tracing 18.676 ms [18.491 ms, 18.862 ms] -386.511 µs (-2.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.363 ms [18.174 ms, 18.552 ms] -
appsec 19.679 ms [19.482 ms, 19.875 ms] 1.316 ms (7.2%)
code_origins 17.711 ms [17.538 ms, 17.885 ms] -651.5 µs (-3.5%)
iast 17.872 ms [17.694 ms, 18.05 ms] -490.706 µs (-2.7%)
profiling 19.532 ms [19.332 ms, 19.733 ms] 1.17 ms (6.4%)
tracing 17.66 ms [17.483 ms, 17.837 ms] -702.815 µs (-3.8%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.217 ms) : 1207, 1228
.   : milestone, 1217,
iast (3.234 ms) : 3190, 3278
.   : milestone, 3234,
iast_FULL (5.716 ms) : 5659, 5774
.   : milestone, 5716,
iast_GLOBAL (3.516 ms) : 3465, 3566
.   : milestone, 3516,
profiling (1.961 ms) : 1945, 1977
.   : milestone, 1961,
tracing (1.853 ms) : 1837, 1869
.   : milestone, 1853,
section candidate
no_agent (1.23 ms) : 1218, 1243
.   : milestone, 1230,
iast (3.156 ms) : 3113, 3199
.   : milestone, 3156,
iast_FULL (5.693 ms) : 5636, 5749
.   : milestone, 5693,
iast_GLOBAL (3.524 ms) : 3473, 3575
.   : milestone, 3524,
profiling (2.29 ms) : 2268, 2311
.   : milestone, 2290,
tracing (1.843 ms) : 1827, 1859
.   : milestone, 1843,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.217 ms [1.207 ms, 1.228 ms] -
iast 3.234 ms [3.19 ms, 3.278 ms] 2.017 ms (165.7%)
iast_FULL 5.716 ms [5.659 ms, 5.774 ms] 4.499 ms (369.6%)
iast_GLOBAL 3.516 ms [3.465 ms, 3.566 ms] 2.298 ms (188.8%)
profiling 1.961 ms [1.945 ms, 1.977 ms] 743.602 µs (61.1%)
tracing 1.853 ms [1.837 ms, 1.869 ms] 635.341 µs (52.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.23 ms [1.218 ms, 1.243 ms] -
iast 3.156 ms [3.113 ms, 3.199 ms] 1.925 ms (156.5%)
iast_FULL 5.693 ms [5.636 ms, 5.749 ms] 4.462 ms (362.7%)
iast_GLOBAL 3.524 ms [3.473 ms, 3.575 ms] 2.294 ms (186.4%)
profiling 2.29 ms [2.268 ms, 2.311 ms] 1.059 ms (86.1%)
tracing 1.843 ms [1.827 ms, 1.859 ms] 612.649 µs (49.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gradle-daemon-smoke-tests
git_commit_date 1764970693 1765030284
git_commit_sha 823cec6 b899da7
release_version 1.57.0-SNAPSHOT~823cec6aa6 1.57.0-SNAPSHOT~b899da7ab8
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1765032361 1765032361
ci_job_id 1274006974 1274006974
ci_pipeline_id 85116882 85116882
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-tvq7x3rx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-tvq7x3rx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 2 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.041 s) : 15041000, 15041000
.   : milestone, 15041000,
appsec (15.039 s) : 15039000, 15039000
.   : milestone, 15039000,
iast (18.698 s) : 18698000, 18698000
.   : milestone, 18698000,
iast_GLOBAL (17.907 s) : 17907000, 17907000
.   : milestone, 17907000,
profiling (14.563 s) : 14563000, 14563000
.   : milestone, 14563000,
tracing (14.991 s) : 14991000, 14991000
.   : milestone, 14991000,
section candidate
no_agent (14.809 s) : 14809000, 14809000
.   : milestone, 14809000,
appsec (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
iast (18.036 s) : 18036000, 18036000
.   : milestone, 18036000,
iast_GLOBAL (17.936 s) : 17936000, 17936000
.   : milestone, 17936000,
profiling (14.449 s) : 14449000, 14449000
.   : milestone, 14449000,
tracing (14.851 s) : 14851000, 14851000
.   : milestone, 14851000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.041 s [15.041 s, 15.041 s] -
appsec 15.039 s [15.039 s, 15.039 s] -2.0 ms (-0.0%)
iast 18.698 s [18.698 s, 18.698 s] 3.657 s (24.3%)
iast_GLOBAL 17.907 s [17.907 s, 17.907 s] 2.866 s (19.1%)
profiling 14.563 s [14.563 s, 14.563 s] -478.0 ms (-3.2%)
tracing 14.991 s [14.991 s, 14.991 s] -50.0 ms (-0.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.809 s [14.809 s, 14.809 s] -
appsec 14.834 s [14.834 s, 14.834 s] 25.0 ms (0.2%)
iast 18.036 s [18.036 s, 18.036 s] 3.227 s (21.8%)
iast_GLOBAL 17.936 s [17.936 s, 17.936 s] 3.127 s (21.1%)
profiling 14.449 s [14.449 s, 14.449 s] -360.0 ms (-2.4%)
tracing 14.851 s [14.851 s, 14.851 s] 42.0 ms (0.3%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.57.0-SNAPSHOT~b899da7ab8, baseline=1.57.0-SNAPSHOT~823cec6aa6
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.481 ms) : 1470, 1493
.   : milestone, 1481,
appsec (3.727 ms) : 3509, 3946
.   : milestone, 3727,
iast (2.241 ms) : 2175, 2306
.   : milestone, 2241,
iast_GLOBAL (2.278 ms) : 2213, 2344
.   : milestone, 2278,
profiling (2.5 ms) : 2343, 2658
.   : milestone, 2500,
tracing (2.07 ms) : 2018, 2122
.   : milestone, 2070,
section candidate
no_agent (1.483 ms) : 1471, 1494
.   : milestone, 1483,
appsec (3.762 ms) : 3543, 3981
.   : milestone, 3762,
iast (2.236 ms) : 2170, 2301
.   : milestone, 2236,
iast_GLOBAL (2.278 ms) : 2212, 2343
.   : milestone, 2278,
profiling (2.109 ms) : 2054, 2163
.   : milestone, 2109,
tracing (2.062 ms) : 2010, 2113
.   : milestone, 2062,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.481 ms [1.47 ms, 1.493 ms] -
appsec 3.727 ms [3.509 ms, 3.946 ms] 2.246 ms (151.6%)
iast 2.241 ms [2.175 ms, 2.306 ms] 759.363 µs (51.3%)
iast_GLOBAL 2.278 ms [2.213 ms, 2.344 ms] 796.978 µs (53.8%)
profiling 2.5 ms [2.343 ms, 2.658 ms] 1.019 ms (68.8%)
tracing 2.07 ms [2.018 ms, 2.122 ms] 588.886 µs (39.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.494 ms] -
appsec 3.762 ms [3.543 ms, 3.981 ms] 2.279 ms (153.7%)
iast 2.236 ms [2.17 ms, 2.301 ms] 752.81 µs (50.8%)
iast_GLOBAL 2.278 ms [2.212 ms, 2.343 ms] 794.727 µs (53.6%)
profiling 2.109 ms [2.054 ms, 2.163 ms] 625.99 µs (42.2%)
tracing 2.062 ms [2.01 ms, 2.113 ms] 578.835 µs (39.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@AlexeyKuznetsov-DD AlexeyKuznetsov-DD AlexeyKuznetsov-DD approved these changes

@Mariovido Mariovido Awaiting requested review from Mariovido Mariovido is a code owner automatically assigned from DataDog/ci-app-libraries-java

Assignees

No one assigned

Labels

comp: ci visibility Continuous Integration Visibility comp: testing Testing run-tests: all Run all tests tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@nikita-tkachenko-datadog @AlexeyKuznetsov-DD