Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add JMXFetch to TracerInstaller for GraalVM Native #8569

Draft
wants to merge 1 commit into
base: master
Choose a base branch
from
Draft

Add JMXFetch to TracerInstaller for GraalVM Native #8569

wants to merge 1 commit into from

Conversation

ygree
Copy link
Contributor

@ygree ygree commented Mar 14, 2025

Error: Discovered unresolved method during parsing: org.datadog.jmxfetch.App.(org.datadog.jmxfetch.AppConfig).

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

@ygree
Add JMXFetch to TracerInstaller for GraalVM Native
634df59 
Error: Discovered unresolved method during parsing: org.datadog.jmxfetch.App.<init>(org.datadog.jmxfetch.AppConfig).
@ygree ygree self-assigned this Mar 14, 2025
@pr-commenter
Copy link

pr-commenter bot commented Mar 14, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/graal-native-jmxfetch
git_commit_date 1741967085 1741986013
git_commit_sha c06a408 634df59
release_version 1.48.0-SNAPSHOT~c06a40868a 1.47.0-SNAPSHOT~634df59c56
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741988856 1741988856
ci_job_id 849454867 849454867
ci_pipeline_id 58918181 58918181
cpu_model Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
kernel_version Linux runner-bbujrxjb-project-304-concurrent-0-rcn0qtw8 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-bbujrxjb-project-304-concurrent-0-rcn0qtw8 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 5 performance improvements and 14 performance regressions! Performance is the same for 36 metrics, 8 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:GlobalTracer worse
[+24.919ms; +27.111ms] or [+10.465%; +11.386%]		 264.125ms 238.110ms
scenario:startup:insecure-bank:iast:AppSec better
[-9.086ms; -5.179ms] or [-15.706%; -8.953%]		 50.716ms 57.849ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:GlobalTracer worse
[+23.828ms; +27.478ms] or [+9.950%; +11.474%]		 265.130ms 239.477ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:AppSec better
[-9.469ms; -5.175ms] or [-16.307%; -8.913%]		 50.743ms 58.065ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:GlobalTracer worse
[+29.273ms; +35.845ms] or [+12.288%; +15.047%]		 270.785ms 238.226ms
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-8.410ms; -7.144ms] or [-14.549%; -12.359%]		 50.027ms 57.804ms
scenario:startup:insecure-bank:tracing:GlobalTracer worse
[+20.699ms; +26.576ms] or [+8.340%; +10.709%]		 271.808ms 248.171ms
scenario:startup:insecure-bank:tracing:AppSec worse
[+1.331ms; +6.313ms] or [+2.360%; +11.190%]		 60.243ms 56.420ms
scenario:startup:petclinic:appsec:GlobalTracer worse
[+24.505ms; +32.051ms] or [+10.077%; +13.180%]		 271.454ms 243.176ms
scenario:startup:petclinic:appsec:AppSec better
[-17.588ms; -14.470ms] or [-9.736%; -8.010%]		 164.620ms 180.649ms
scenario:startup:petclinic:iast:GlobalTracer worse
[+25.882ms; +28.816ms] or [+10.899%; +12.134%]		 264.820ms 237.472ms
scenario:startup:petclinic:iast:IAST worse
[+8.245ms; +9.169ms] or [+34.770%; +38.667%]		 32.420ms 23.713ms
scenario:startup:petclinic:iast:AppSec better
[-7.761ms; -6.500ms] or [-13.597%; -11.387%]		 49.950ms 57.081ms
scenario:startup:petclinic:profiling:Agent.start worse
[+27.522ms; +51.699ms] or [+2.123%; +3.989%]		 1.336s 1.296s
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+2.715ms; +7.005ms] or [+2.795%; +7.210%]		 102.022ms 97.161ms
scenario:startup:petclinic:profiling:GlobalTracer worse
[+23.666ms; +30.746ms] or [+6.412%; +8.331%]		 396.278ms 369.072ms
scenario:startup:petclinic:profiling:Profiling worse
[+2.752ms; +7.039ms] or [+2.832%; +7.243%]		 102.082ms 97.187ms
scenario:startup:petclinic:tracing:Agent.start worse
[+24.645ms; +39.831ms] or [+2.308%; +3.730%]		 1.100s 1.068s
scenario:startup:petclinic:tracing:GlobalTracer worse
[+25.833ms; +32.299ms] or [+10.488%; +13.114%]		 275.365ms 246.299ms
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.068 s) : 0, 1067797
Total [baseline] (10.662 s) : 0, 10661593
Agent [candidate] (1.1 s) : 0, 1100034
Total [candidate] (10.724 s) : 0, 10723861
section appsec
Agent [baseline] (1.211 s) : 0, 1210612
Total [baseline] (10.967 s) : 0, 10966828
Agent [candidate] (1.223 s) : 0, 1223375
Total [candidate] (10.99 s) : 0, 10989894
section iast
Agent [baseline] (1.202 s) : 0, 1202227
Total [baseline] (11.292 s) : 0, 11291697
Agent [candidate] (1.226 s) : 0, 1226041
Total [candidate] (11.166 s) : 0, 11166093
section profiling
Agent [baseline] (1.296 s) : 0, 1296089
Total [baseline] (11.184 s) : 0, 11184173
Agent [candidate] (1.336 s) : 0, 1335699
Total [candidate] (11.215 s) : 0, 11214776
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.068 s -
Agent appsec 1.211 s 142.815 ms (13.4%)
Agent iast 1.202 s 134.43 ms (12.6%)
Agent profiling 1.296 s 228.292 ms (21.4%)
Total tracing 10.662 s -
Total appsec 10.967 s 305.234 ms (2.9%)
Total iast 11.292 s 630.103 ms (5.9%)
Total profiling 11.184 s 522.579 ms (4.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.1 s -
Agent appsec 1.223 s 123.34 ms (11.2%)
Agent iast 1.226 s 126.006 ms (11.5%)
Agent profiling 1.336 s 235.665 ms (21.4%)
Total tracing 10.724 s -
Total appsec 10.99 s 266.033 ms (2.5%)
Total iast 11.166 s 442.232 ms (4.1%)
Total profiling 11.215 s 490.915 ms (4.6%) 
gantt
    title petclinic - break down per module: candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (733.527 ms) : 0, 733527
BytebuddyAgent [candidate] (734.378 ms) : 0, 734378
GlobalTracer [baseline] (246.299 ms) : 0, 246299
GlobalTracer [candidate] (275.365 ms) : 0, 275365
AppSec [baseline] (55.871 ms) : 0, 55871
AppSec [candidate] (58.91 ms) : 0, 58910
Remote Config [baseline] (715.597 µs) : 0, 716
Remote Config [candidate] (1.583 ms) : 0, 1583
Telemetry [baseline] (15.96 ms) : 0, 15960
Telemetry [candidate] (14.621 ms) : 0, 14621
section appsec
BytebuddyAgent [baseline] (751.123 ms) : 0, 751123
BytebuddyAgent [candidate] (750.759 ms) : 0, 750759
GlobalTracer [baseline] (243.176 ms) : 0, 243176
GlobalTracer [candidate] (271.454 ms) : 0, 271454
IAST [baseline] (22.056 ms) : 0, 22056
IAST [candidate] (22.556 ms) : 0, 22556
AppSec [baseline] (180.649 ms) : 0, 180649
AppSec [candidate] (164.62 ms) : 0, 164620
Remote Config [baseline] (679.944 µs) : 0, 680
Remote Config [candidate] (712.638 µs) : 0, 713
Telemetry [baseline] (8.494 ms) : 0, 8494
Telemetry [candidate] (9.416 ms) : 0, 9416
section iast
BytebuddyAgent [baseline] (858.932 ms) : 0, 858932
BytebuddyAgent [candidate] (854.012 ms) : 0, 854012
GlobalTracer [baseline] (237.472 ms) : 0, 237472
GlobalTracer [candidate] (264.82 ms) : 0, 264820
IAST [baseline] (23.713 ms) : 0, 23713
IAST [candidate] (32.42 ms) : 0, 32420
AppSec [baseline] (57.081 ms) : 0, 57081
AppSec [candidate] (49.95 ms) : 0, 49950
Remote Config [baseline] (633.4 µs) : 0, 633
Remote Config [candidate] (639.382 µs) : 0, 639
Telemetry [baseline] (8.925 ms) : 0, 8925
Telemetry [candidate] (9.0 ms) : 0, 9000
section profiling
BytebuddyAgent [baseline] (722.801 ms) : 0, 722801
BytebuddyAgent [candidate] (730.777 ms) : 0, 730777
GlobalTracer [baseline] (369.072 ms) : 0, 369072
GlobalTracer [candidate] (396.278 ms) : 0, 396278
AppSec [baseline] (55.57 ms) : 0, 55570
AppSec [candidate] (55.383 ms) : 0, 55383
Remote Config [baseline] (707.436 µs) : 0, 707
Remote Config [candidate] (701.375 µs) : 0, 701
Telemetry [baseline] (9.279 ms) : 0, 9279
Telemetry [candidate] (9.215 ms) : 0, 9215
ProfilingAgent [baseline] (97.161 ms) : 0, 97161
ProfilingAgent [candidate] (102.022 ms) : 0, 102022
Profiling [baseline] (97.187 ms) : 0, 97187
Profiling [candidate] (102.082 ms) : 0, 102082
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.069 s) : 0, 1068739
Total [baseline] (9.256 s) : 0, 9256344
Agent [candidate] (1.091 s) : 0, 1090839
Total [candidate] (9.192 s) : 0, 9192105
section iast
Agent [baseline] (1.198 s) : 0, 1198309
Total [baseline] (9.824 s) : 0, 9824415
Agent [candidate] (1.222 s) : 0, 1222496
Total [candidate] (9.819 s) : 0, 9818611
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.204 s) : 0, 1204351
Total [baseline] (9.847 s) : 0, 9846975
Agent [candidate] (1.223 s) : 0, 1223282
Total [candidate] (9.779 s) : 0, 9778847
section iast_TELEMETRY_OFF
Agent [baseline] (1.194 s) : 0, 1194403
Total [baseline] (9.795 s) : 0, 9794634
Agent [candidate] (1.226 s) : 0, 1225809
Total [candidate] (9.901 s) : 0, 9900994
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.069 s -
Agent iast 1.198 s 129.57 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.204 s 135.612 ms (12.7%)
Agent iast_TELEMETRY_OFF 1.194 s 125.664 ms (11.8%)
Total tracing 9.256 s -
Total iast 9.824 s 568.071 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.847 s 590.631 ms (6.4%)
Total iast_TELEMETRY_OFF 9.795 s 538.29 ms (5.8%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.091 s -
Agent iast 1.222 s 131.657 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.223 s 132.442 ms (12.1%)
Agent iast_TELEMETRY_OFF 1.226 s 134.97 ms (12.4%)
Total tracing 9.192 s -
Total iast 9.819 s 626.506 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.779 s 586.741 ms (6.4%)
Total iast_TELEMETRY_OFF 9.901 s 708.888 ms (7.7%) 
gantt
    title insecure-bank - break down per module: candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (735.094 ms) : 0, 735094
BytebuddyAgent [candidate] (729.55 ms) : 0, 729550
GlobalTracer [baseline] (248.171 ms) : 0, 248171
GlobalTracer [candidate] (271.808 ms) : 0, 271808
AppSec [baseline] (56.42 ms) : 0, 56420
AppSec [candidate] (60.243 ms) : 0, 60243
Remote Config [baseline] (728.579 µs) : 0, 729
Remote Config [candidate] (722.413 µs) : 0, 722
Telemetry [baseline] (12.886 ms) : 0, 12886
Telemetry [candidate] (13.42 ms) : 0, 13420
section iast
BytebuddyAgent [baseline] (853.543 ms) : 0, 853543
BytebuddyAgent [candidate] (851.629 ms) : 0, 851629
GlobalTracer [baseline] (238.11 ms) : 0, 238110
GlobalTracer [candidate] (264.125 ms) : 0, 264125
IAST [baseline] (23.741 ms) : 0, 23741
IAST [candidate] (31.211 ms) : 0, 31211
AppSec [baseline] (57.849 ms) : 0, 57849
AppSec [candidate] (50.716 ms) : 0, 50716
Remote Config [baseline] (627.527 µs) : 0, 628
Remote Config [candidate] (638.453 µs) : 0, 638
Telemetry [baseline] (8.979 ms) : 0, 8979
Telemetry [candidate] (9.019 ms) : 0, 9019
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (858.019 ms) : 0, 858019
BytebuddyAgent [candidate] (852.139 ms) : 0, 852139
GlobalTracer [baseline] (239.477 ms) : 0, 239477
GlobalTracer [candidate] (265.13 ms) : 0, 265130
IAST [baseline] (23.563 ms) : 0, 23563
IAST [candidate] (30.391 ms) : 0, 30391
AppSec [baseline] (58.065 ms) : 0, 58065
AppSec [candidate] (50.743 ms) : 0, 50743
Remote Config [baseline] (630.639 µs) : 0, 631
Remote Config [candidate] (645.332 µs) : 0, 645
Telemetry [baseline] (9.073 ms) : 0, 9073
Telemetry [candidate] (9.031 ms) : 0, 9031
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (850.051 ms) : 0, 850051
BytebuddyAgent [candidate] (854.654 ms) : 0, 854654
GlobalTracer [baseline] (238.226 ms) : 0, 238226
GlobalTracer [candidate] (270.785 ms) : 0, 270785
IAST [baseline] (23.346 ms) : 0, 23346
IAST [candidate] (25.408 ms) : 0, 25408
AppSec [baseline] (57.804 ms) : 0, 57804
AppSec [candidate] (50.027 ms) : 0, 50027
Remote Config [baseline] (635.548 µs) : 0, 636
Remote Config [candidate] (662.758 µs) : 0, 663
Telemetry [baseline] (8.913 ms) : 0, 8913
Telemetry [candidate] (9.023 ms) : 0, 9023
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-03-14T21:16:25 2025-03-14T21:24:12
git_branch master ygree/graal-native-jmxfetch
git_commit_date 1741967085 1741986013
git_commit_sha c06a408 634df59
release_version 1.48.0-SNAPSHOT~c06a40868a 1.47.0-SNAPSHOT~634df59c56
start_time 2025-03-14T21:16:11 2025-03-14T21:23:58
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1741987853 1741987853
ci_job_id 849454868 849454868
ci_pipeline_id 58918181 58918181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-bbujrxjb-project-304-concurrent-1-xyzdw80p 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-bbujrxjb-project-304-concurrent-1-xyzdw80p 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.371 ms) : 1352, 1391
.   : milestone, 1371,
appsec (1.767 ms) : 1742, 1791
.   : milestone, 1767,
appsec_no_iast (1.718 ms) : 1693, 1742
.   : milestone, 1718,
code_origins (1.712 ms) : 1685, 1740
.   : milestone, 1712,
iast (1.522 ms) : 1498, 1546
.   : milestone, 1522,
profiling (1.541 ms) : 1518, 1564
.   : milestone, 1541,
tracing (1.513 ms) : 1488, 1537
.   : milestone, 1513,
section candidate
no_agent (1.356 ms) : 1336, 1376
.   : milestone, 1356,
appsec (1.752 ms) : 1727, 1776
.   : milestone, 1752,
appsec_no_iast (1.772 ms) : 1748, 1796
.   : milestone, 1772,
code_origins (1.677 ms) : 1643, 1711
.   : milestone, 1677,
iast (1.522 ms) : 1497, 1548
.   : milestone, 1522,
profiling (1.545 ms) : 1522, 1567
.   : milestone, 1545,
tracing (1.531 ms) : 1504, 1558
.   : milestone, 1531,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.371 ms [1.352 ms, 1.391 ms] -
appsec 1.767 ms [1.742 ms, 1.791 ms] 395.469 µs (28.8%)
appsec_no_iast 1.718 ms [1.693 ms, 1.742 ms] 346.301 µs (25.3%)
code_origins 1.712 ms [1.685 ms, 1.74 ms] 341.131 µs (24.9%)
iast 1.522 ms [1.498 ms, 1.546 ms] 151.141 µs (11.0%)
profiling 1.541 ms [1.518 ms, 1.564 ms] 169.674 µs (12.4%)
tracing 1.513 ms [1.488 ms, 1.537 ms] 141.369 µs (10.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.356 ms [1.336 ms, 1.376 ms] -
appsec 1.752 ms [1.727 ms, 1.776 ms] 395.823 µs (29.2%)
appsec_no_iast 1.772 ms [1.748 ms, 1.796 ms] 416.203 µs (30.7%)
code_origins 1.677 ms [1.643 ms, 1.711 ms] 321.164 µs (23.7%)
iast 1.522 ms [1.497 ms, 1.548 ms] 166.592 µs (12.3%)
profiling 1.545 ms [1.522 ms, 1.567 ms] 188.683 µs (13.9%)
tracing 1.531 ms [1.504 ms, 1.558 ms] 174.976 µs (12.9%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (383.854 µs) : 364, 404
.   : milestone, 384,
iast (517.865 µs) : 496, 540
.   : milestone, 518,
iast_FULL (735.047 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (575.048 µs) : 552, 598
.   : milestone, 575,
iast_HARDCODED_SECRET_DISABLED (519.709 µs) : 498, 542
.   : milestone, 520,
iast_INACTIVE (468.993 µs) : 448, 490
.   : milestone, 469,
iast_TELEMETRY_OFF (507.021 µs) : 485, 529
.   : milestone, 507,
tracing (468.138 µs) : 447, 489
.   : milestone, 468,
section candidate
no_agent (386.484 µs) : 367, 406
.   : milestone, 386,
iast (518.865 µs) : 497, 541
.   : milestone, 519,
iast_FULL (734.711 µs) : 713, 757
.   : milestone, 735,
iast_GLOBAL (566.474 µs) : 545, 588
.   : milestone, 566,
iast_HARDCODED_SECRET_DISABLED (522.019 µs) : 500, 544
.   : milestone, 522,
iast_INACTIVE (475.516 µs) : 454, 497
.   : milestone, 476,
iast_TELEMETRY_OFF (497.947 µs) : 476, 520
.   : milestone, 498,
tracing (463.693 µs) : 442, 485
.   : milestone, 464,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 383.854 µs [363.87 µs, 403.837 µs] -
iast 517.865 µs [496.122 µs, 539.608 µs] 134.011 µs (34.9%)
iast_FULL 735.047 µs [713.167 µs, 756.927 µs] 351.193 µs (91.5%)
iast_GLOBAL 575.048 µs [552.379 µs, 597.716 µs] 191.194 µs (49.8%)
iast_HARDCODED_SECRET_DISABLED 519.709 µs [497.614 µs, 541.805 µs] 135.855 µs (35.4%)
iast_INACTIVE 468.993 µs [447.655 µs, 490.332 µs] 85.139 µs (22.2%)
iast_TELEMETRY_OFF 507.021 µs [485.166 µs, 528.875 µs] 123.167 µs (32.1%)
tracing 468.138 µs [447.156 µs, 489.119 µs] 84.284 µs (22.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 386.484 µs [366.953 µs, 406.015 µs] -
iast 518.865 µs [497.116 µs, 540.614 µs] 132.381 µs (34.3%)
iast_FULL 734.711 µs [712.765 µs, 756.656 µs] 348.226 µs (90.1%)
iast_GLOBAL 566.474 µs [544.62 µs, 588.329 µs] 179.99 µs (46.6%)
iast_HARDCODED_SECRET_DISABLED 522.019 µs [500.288 µs, 543.749 µs] 135.534 µs (35.1%)
iast_INACTIVE 475.516 µs [453.758 µs, 497.274 µs] 89.032 µs (23.0%)
iast_TELEMETRY_OFF 497.947 µs [476.349 µs, 519.546 µs] 111.463 µs (28.8%)
tracing 463.693 µs [442.494 µs, 484.892 µs] 77.209 µs (20.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/graal-native-jmxfetch
git_commit_date 1741967085 1741986013
git_commit_sha c06a408 634df59
release_version 1.48.0-SNAPSHOT~c06a40868a 1.47.0-SNAPSHOT~634df59c56
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1741988356 1741988356
ci_job_id 849454869 849454869
ci_pipeline_id 58918181 58918181
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-hvxyazeg-project-304-concurrent-0-b7rz74mo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-hvxyazeg-project-304-concurrent-0-b7rz74mo 6.8.0-1024-aws #26~22.04.1-Ubuntu SMP Wed Feb 19 06:54:57 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.445 s) : 15445000, 15445000
.   : milestone, 15445000,
appsec (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
iast (18.774 s) : 18774000, 18774000
.   : milestone, 18774000,
iast_GLOBAL (17.922 s) : 17922000, 17922000
.   : milestone, 17922000,
profiling (14.98 s) : 14980000, 14980000
.   : milestone, 14980000,
tracing (15.04 s) : 15040000, 15040000
.   : milestone, 15040000,
section candidate
no_agent (15.443 s) : 15443000, 15443000
.   : milestone, 15443000,
appsec (14.969 s) : 14969000, 14969000
.   : milestone, 14969000,
iast (18.849 s) : 18849000, 18849000
.   : milestone, 18849000,
iast_GLOBAL (18.738 s) : 18738000, 18738000
.   : milestone, 18738000,
profiling (15.225 s) : 15225000, 15225000
.   : milestone, 15225000,
tracing (14.744 s) : 14744000, 14744000
.   : milestone, 14744000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.445 s [15.445 s, 15.445 s] -
appsec 15.038 s [15.038 s, 15.038 s] -407.0 ms (-2.6%)
iast 18.774 s [18.774 s, 18.774 s] 3.329 s (21.6%)
iast_GLOBAL 17.922 s [17.922 s, 17.922 s] 2.477 s (16.0%)
profiling 14.98 s [14.98 s, 14.98 s] -465.0 ms (-3.0%)
tracing 15.04 s [15.04 s, 15.04 s] -405.0 ms (-2.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.443 s [15.443 s, 15.443 s] -
appsec 14.969 s [14.969 s, 14.969 s] -474.0 ms (-3.1%)
iast 18.849 s [18.849 s, 18.849 s] 3.406 s (22.1%)
iast_GLOBAL 18.738 s [18.738 s, 18.738 s] 3.295 s (21.3%)
profiling 15.225 s [15.225 s, 15.225 s] -218.0 ms (-1.4%)
tracing 14.744 s [14.744 s, 14.744 s] -699.0 ms (-4.5%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.47.0-SNAPSHOT~634df59c56, baseline=1.48.0-SNAPSHOT~c06a40868a
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.479 ms) : 1468, 1491
.   : milestone, 1479,
appsec (2.34 ms) : 2297, 2384
.   : milestone, 2340,
iast (2.121 ms) : 2066, 2177
.   : milestone, 2121,
iast_GLOBAL (2.177 ms) : 2121, 2233
.   : milestone, 2177,
profiling (1.987 ms) : 1942, 2031
.   : milestone, 1987,
tracing (1.963 ms) : 1920, 2005
.   : milestone, 1963,
section candidate
no_agent (1.477 ms) : 1465, 1489
.   : milestone, 1477,
appsec (2.365 ms) : 2322, 2408
.   : milestone, 2365,
iast (2.127 ms) : 2072, 2182
.   : milestone, 2127,
iast_GLOBAL (2.159 ms) : 2104, 2214
.   : milestone, 2159,
profiling (1.991 ms) : 1946, 2036
.   : milestone, 1991,
tracing (1.944 ms) : 1902, 1986
.   : milestone, 1944,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.479 ms [1.468 ms, 1.491 ms] -
appsec 2.34 ms [2.297 ms, 2.384 ms] 860.954 µs (58.2%)
iast 2.121 ms [2.066 ms, 2.177 ms] 641.724 µs (43.4%)
iast_GLOBAL 2.177 ms [2.121 ms, 2.233 ms] 697.515 µs (47.1%)
profiling 1.987 ms [1.942 ms, 2.031 ms] 507.134 µs (34.3%)
tracing 1.963 ms [1.92 ms, 2.005 ms] 483.088 µs (32.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.489 ms] -
appsec 2.365 ms [2.322 ms, 2.408 ms] 887.879 µs (60.1%)
iast 2.127 ms [2.072 ms, 2.182 ms] 650.457 µs (44.0%)
iast_GLOBAL 2.159 ms [2.104 ms, 2.214 ms] 681.67 µs (46.2%)
profiling 1.991 ms [1.946 ms, 2.036 ms] 513.993 µs (34.8%)
tracing 1.944 ms [1.902 ms, 1.986 ms] 467.088 µs (31.6%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees

@ygree ygree

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@ygree