Skip to content

Prepare for JEP 500 #9557

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
PerfectSlayer wants to merge 12 commits into
base: master
Choose a base branch
from
Open

Prepare for JEP 500 #9557

PerfectSlayer wants to merge 12 commits into from
+34 −3

Conversation

@PerfectSlayer
Copy link
Contributor

@PerfectSlayer PerfectSlayer commented Sep 18, 2025 •
edited by atlassian bot
Loading

What Does This Do

This PR prepares for the "Prepare to Make Final Mean Final" changes where mutating final field will be forbidden.

Motivation

Adding forbidden API should avoid using this API in the future, decreasing the migration work.

Additional Notes

Contributor Checklist

Jira ticket: APMLP-594

@datadog-datadog-prod-us1

This comment has been minimized.

Sign in to view
@pr-commenter
Copy link

pr-commenter bot commented Sep 18, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/jep500
git_commit_date 1769086485 1769111264
git_commit_sha 3d62379 c997577
release_version 1.59.0-SNAPSHOT~3d62379c90 1.54.0-SNAPSHOT~c997577e23
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769113120 1769113120
ci_job_id 1371148759 1371148759
ci_pipeline_id 92353311 92353311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-aarc9qbx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-aarc9qbx 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 11 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.085 s) : 0, 1085236
Total [baseline] (8.786 s) : 0, 8785906
Agent [candidate] (1.086 s) : 0, 1086004
Total [candidate] (8.778 s) : 0, 8778139
section iast
Agent [baseline] (1.222 s) : 0, 1221572
Total [baseline] (9.344 s) : 0, 9343668
Agent [candidate] (1.227 s) : 0, 1226740
Total [candidate] (9.371 s) : 0, 9371392
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.085 s -
Agent iast 1.222 s 136.337 ms (12.6%)
Total tracing 8.786 s -
Total iast 9.344 s 557.761 ms (6.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.086 s -
Agent iast 1.227 s 140.737 ms (13.0%)
Total tracing 8.778 s -
Total iast 9.371 s 593.254 ms (6.8%) 
gantt
    title insecure-bank - break down per module: candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.182 ms) : 0, 1182
crashtracking [candidate] (1.175 ms) : 0, 1175
BytebuddyAgent [baseline] (651.886 ms) : 0, 651886
BytebuddyAgent [candidate] (652.278 ms) : 0, 652278
GlobalTracer [baseline] (283.714 ms) : 0, 283714
GlobalTracer [candidate] (283.712 ms) : 0, 283712
AppSec [baseline] (32.7 ms) : 0, 32700
AppSec [candidate] (32.572 ms) : 0, 32572
Debugger [baseline] (67.091 ms) : 0, 67091
Debugger [candidate] (67.395 ms) : 0, 67395
Remote Config [baseline] (630.936 µs) : 0, 631
Remote Config [candidate] (631.509 µs) : 0, 632
Telemetry [baseline] (8.789 ms) : 0, 8789
Telemetry [candidate] (8.897 ms) : 0, 8897
Flare Poller [baseline] (3.824 ms) : 0, 3824
Flare Poller [candidate] (3.852 ms) : 0, 3852
section iast
crashtracking [baseline] (1.174 ms) : 0, 1174
crashtracking [candidate] (1.174 ms) : 0, 1174
BytebuddyAgent [baseline] (790.916 ms) : 0, 790916
BytebuddyAgent [candidate] (793.717 ms) : 0, 793717
GlobalTracer [baseline] (256.102 ms) : 0, 256102
GlobalTracer [candidate] (257.288 ms) : 0, 257288
IAST [baseline] (26.871 ms) : 0, 26871
IAST [candidate] (27.03 ms) : 0, 27030
AppSec [baseline] (33.499 ms) : 0, 33499
AppSec [candidate] (32.617 ms) : 0, 32617
Debugger [baseline] (65.247 ms) : 0, 65247
Debugger [candidate] (66.904 ms) : 0, 66904
Remote Config [baseline] (578.513 µs) : 0, 579
Remote Config [candidate] (576.016 µs) : 0, 576
Telemetry [baseline] (8.395 ms) : 0, 8395
Telemetry [candidate] (8.524 ms) : 0, 8524
Flare Poller [baseline] (3.548 ms) : 0, 3548
Flare Poller [candidate] (3.672 ms) : 0, 3672
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.093 s) : 0, 1092668
Total [baseline] (10.88 s) : 0, 10880267
Agent [candidate] (1.096 s) : 0, 1096040
Total [candidate] (10.888 s) : 0, 10887512
section appsec
Agent [baseline] (1.272 s) : 0, 1271865
Total [baseline] (10.996 s) : 0, 10996339
Agent [candidate] (1.268 s) : 0, 1267710
Total [candidate] (11.1 s) : 0, 11100266
section iast
Agent [baseline] (1.233 s) : 0, 1233204
Total [baseline] (11.239 s) : 0, 11239263
Agent [candidate] (1.228 s) : 0, 1228268
Total [candidate] (11.164 s) : 0, 11163618
section profiling
Agent [baseline] (1.204 s) : 0, 1203931
Total [baseline] (10.897 s) : 0, 10897162
Agent [candidate] (1.208 s) : 0, 1208268
Total [candidate] (10.901 s) : 0, 10900847
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.093 s -
Agent appsec 1.272 s 179.198 ms (16.4%)
Agent iast 1.233 s 140.536 ms (12.9%)
Agent profiling 1.204 s 111.263 ms (10.2%)
Total tracing 10.88 s -
Total appsec 10.996 s 116.071 ms (1.1%)
Total iast 11.239 s 358.996 ms (3.3%)
Total profiling 10.897 s 16.894 ms (0.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.096 s -
Agent appsec 1.268 s 171.669 ms (15.7%)
Agent iast 1.228 s 132.227 ms (12.1%)
Agent profiling 1.208 s 112.227 ms (10.2%)
Total tracing 10.888 s -
Total appsec 11.1 s 212.754 ms (2.0%)
Total iast 11.164 s 276.106 ms (2.5%)
Total profiling 10.901 s 13.335 ms (0.1%) 
gantt
    title petclinic - break down per module: candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.196 ms) : 0, 1196
BytebuddyAgent [baseline] (655.73 ms) : 0, 655730
BytebuddyAgent [candidate] (658.508 ms) : 0, 658508
GlobalTracer [baseline] (285.072 ms) : 0, 285072
GlobalTracer [candidate] (285.513 ms) : 0, 285513
AppSec [baseline] (32.886 ms) : 0, 32886
AppSec [candidate] (32.836 ms) : 0, 32836
Debugger [baseline] (67.053 ms) : 0, 67053
Debugger [candidate] (68.757 ms) : 0, 68757
Remote Config [baseline] (626.165 µs) : 0, 626
Remote Config [candidate] (635.232 µs) : 0, 635
Telemetry [baseline] (9.012 ms) : 0, 9012
Telemetry [candidate] (9.006 ms) : 0, 9006
Flare Poller [baseline] (5.453 ms) : 0, 5453
Flare Poller [candidate] (3.871 ms) : 0, 3871
section appsec
crashtracking [baseline] (1.186 ms) : 0, 1186
crashtracking [candidate] (1.187 ms) : 0, 1187
BytebuddyAgent [baseline] (695.036 ms) : 0, 695036
BytebuddyAgent [candidate] (691.856 ms) : 0, 691856
GlobalTracer [baseline] (260.47 ms) : 0, 260470
GlobalTracer [candidate] (260.004 ms) : 0, 260004
AppSec [baseline] (173.845 ms) : 0, 173845
AppSec [candidate] (173.401 ms) : 0, 173401
Debugger [baseline] (67.177 ms) : 0, 67177
Debugger [candidate] (67.284 ms) : 0, 67284
Remote Config [baseline] (791.272 µs) : 0, 791
Remote Config [candidate] (762.813 µs) : 0, 763
Telemetry [baseline] (9.414 ms) : 0, 9414
Telemetry [candidate] (9.41 ms) : 0, 9410
Flare Poller [baseline] (3.745 ms) : 0, 3745
Flare Poller [candidate] (3.791 ms) : 0, 3791
IAST [baseline] (24.727 ms) : 0, 24727
IAST [candidate] (24.577 ms) : 0, 24577
section iast
crashtracking [baseline] (1.189 ms) : 0, 1189
crashtracking [candidate] (1.195 ms) : 0, 1195
BytebuddyAgent [baseline] (798.156 ms) : 0, 798156
BytebuddyAgent [candidate] (794.906 ms) : 0, 794906
GlobalTracer [baseline] (258.097 ms) : 0, 258097
GlobalTracer [candidate] (257.348 ms) : 0, 257348
AppSec [baseline] (33.622 ms) : 0, 33622
AppSec [candidate] (33.318 ms) : 0, 33318
Debugger [baseline] (66.881 ms) : 0, 66881
Debugger [candidate] (66.566 ms) : 0, 66566
Remote Config [baseline] (609.123 µs) : 0, 609
Remote Config [candidate] (576.802 µs) : 0, 577
Telemetry [baseline] (8.497 ms) : 0, 8497
Telemetry [candidate] (8.434 ms) : 0, 8434
Flare Poller [baseline] (3.575 ms) : 0, 3575
Flare Poller [candidate] (3.566 ms) : 0, 3566
IAST [baseline] (27.192 ms) : 0, 27192
IAST [candidate] (27.031 ms) : 0, 27031
section profiling
ProfilingAgent [baseline] (96.382 ms) : 0, 96382
ProfilingAgent [candidate] (96.871 ms) : 0, 96871
crashtracking [baseline] (1.208 ms) : 0, 1208
crashtracking [candidate] (1.206 ms) : 0, 1206
BytebuddyAgent [baseline] (701.364 ms) : 0, 701364
BytebuddyAgent [candidate] (704.199 ms) : 0, 704199
GlobalTracer [baseline] (221.691 ms) : 0, 221691
GlobalTracer [candidate] (222.498 ms) : 0, 222498
AppSec [baseline] (32.306 ms) : 0, 32306
AppSec [candidate] (32.492 ms) : 0, 32492
Debugger [baseline] (67.896 ms) : 0, 67896
Debugger [candidate] (68.009 ms) : 0, 68009
Remote Config [baseline] (628.325 µs) : 0, 628
Remote Config [candidate] (637.197 µs) : 0, 637
Telemetry [baseline] (8.875 ms) : 0, 8875
Telemetry [candidate] (8.787 ms) : 0, 8787
Flare Poller [baseline] (3.722 ms) : 0, 3722
Flare Poller [candidate] (3.675 ms) : 0, 3675
Profiling [baseline] (96.948 ms) : 0, 96948
Profiling [candidate] (97.45 ms) : 0, 97450
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/jep500
git_commit_date 1769086485 1769111264
git_commit_sha 3d62379 c997577
release_version 1.59.0-SNAPSHOT~3d62379c90 1.54.0-SNAPSHOT~c997577e23
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1769113524 1769113524
ci_job_id 1371148761 1371148761
ci_pipeline_id 92353311 92353311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-55wyzrul 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-55wyzrul 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 14 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load worse
[+130.144µs; +302.448µs] or [+5.468%; +12.708%]		 worse
[+350.721µs; +870.657µs] or [+5.013%; +12.444%]		 unstable
[-270.295op/s; +53.170op/s] or [-18.211%; +3.582%]		 2.596ms 7.607ms 1375.688op/s 2.380ms 6.996ms 1484.250op/s
scenario:load:insecure-bank:iast_FULL:high_load better
[-450.049µs; -128.801µs] or [-8.533%; -2.442%]		 better
[-1032.702µs; -271.234µs] or [-8.295%; -2.179%]		 unstable
[-39.231op/s; +133.543op/s] or [-5.012%; +17.061%]		 4.985ms 11.797ms 829.875op/s 5.274ms 12.449ms 782.719op/s
scenario:load:petclinic:iast:high_load better
[-1.663ms; -1.069ms] or [-8.957%; -5.757%]		 better
[-2.106ms; -0.989ms] or [-6.999%; -3.286%]		 unstable
[-7.061op/s; +41.748op/s] or [-2.851%; +16.859%]		 17.200ms 28.549ms 264.969op/s 18.566ms 30.096ms 247.625op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (17.95 ms) : 17769, 18131
.   : milestone, 17950,
appsec (18.647 ms) : 18458, 18837
.   : milestone, 18647,
code_origins (17.627 ms) : 17452, 17803
.   : milestone, 17627,
iast (18.849 ms) : 18660, 19039
.   : milestone, 18849,
profiling (19.118 ms) : 18925, 19310
.   : milestone, 19118,
tracing (17.804 ms) : 17626, 17982
.   : milestone, 17804,
section candidate
no_agent (18.056 ms) : 17874, 18238
.   : milestone, 18056,
appsec (18.779 ms) : 18590, 18969
.   : milestone, 18779,
code_origins (17.889 ms) : 17709, 18068
.   : milestone, 17889,
iast (17.608 ms) : 17431, 17784
.   : milestone, 17608,
profiling (18.833 ms) : 18645, 19020
.   : milestone, 18833,
tracing (17.432 ms) : 17256, 17607
.   : milestone, 17432,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.95 ms [17.769 ms, 18.131 ms] -
appsec 18.647 ms [18.458 ms, 18.837 ms] 697.203 µs (3.9%)
code_origins 17.627 ms [17.452 ms, 17.803 ms] -322.656 µs (-1.8%)
iast 18.849 ms [18.66 ms, 19.039 ms] 899.316 µs (5.0%)
profiling 19.118 ms [18.925 ms, 19.31 ms] 1.168 ms (6.5%)
tracing 17.804 ms [17.626 ms, 17.982 ms] -146.392 µs (-0.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 18.056 ms [17.874 ms, 18.238 ms] -
appsec 18.779 ms [18.59 ms, 18.969 ms] 722.803 µs (4.0%)
code_origins 17.889 ms [17.709 ms, 18.068 ms] -167.518 µs (-0.9%)
iast 17.608 ms [17.431 ms, 17.784 ms] -448.671 µs (-2.5%)
profiling 18.833 ms [18.645 ms, 19.02 ms] 776.044 µs (4.3%)
tracing 17.432 ms [17.256 ms, 17.607 ms] -624.717 µs (-3.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.187 ms) : 1175, 1199
.   : milestone, 1187,
iast (3.079 ms) : 3035, 3123
.   : milestone, 3079,
iast_FULL (5.907 ms) : 5848, 5967
.   : milestone, 5907,
iast_GLOBAL (3.514 ms) : 3465, 3563
.   : milestone, 3514,
profiling (1.985 ms) : 1968, 2003
.   : milestone, 1985,
tracing (1.79 ms) : 1775, 1804
.   : milestone, 1790,
section candidate
no_agent (1.183 ms) : 1171, 1194
.   : milestone, 1183,
iast (3.328 ms) : 3280, 3375
.   : milestone, 3328,
iast_FULL (5.567 ms) : 5513, 5621
.   : milestone, 5567,
iast_GLOBAL (3.58 ms) : 3524, 3636
.   : milestone, 3580,
profiling (1.993 ms) : 1976, 2010
.   : milestone, 1993,
tracing (1.86 ms) : 1844, 1877
.   : milestone, 1860,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.187 ms [1.175 ms, 1.199 ms] -
iast 3.079 ms [3.035 ms, 3.123 ms] 1.892 ms (159.4%)
iast_FULL 5.907 ms [5.848 ms, 5.967 ms] 4.721 ms (397.7%)
iast_GLOBAL 3.514 ms [3.465 ms, 3.563 ms] 2.327 ms (196.0%)
profiling 1.985 ms [1.968 ms, 2.003 ms] 798.383 µs (67.3%)
tracing 1.79 ms [1.775 ms, 1.804 ms] 602.788 µs (50.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.183 ms [1.171 ms, 1.194 ms] -
iast 3.328 ms [3.28 ms, 3.375 ms] 2.145 ms (181.4%)
iast_FULL 5.567 ms [5.513 ms, 5.621 ms] 4.384 ms (370.7%)
iast_GLOBAL 3.58 ms [3.524 ms, 3.636 ms] 2.397 ms (202.7%)
profiling 1.993 ms [1.976 ms, 2.01 ms] 810.257 µs (68.5%)
tracing 1.86 ms [1.844 ms, 1.877 ms] 677.494 µs (57.3%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/jep500
git_commit_date 1769086485 1769111264
git_commit_sha 3d62379 c997577
release_version 1.59.0-SNAPSHOT~3d62379c90 1.54.0-SNAPSHOT~c997577e23
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1769113294 1769113294
ci_job_id 1371148762 1371148762
ci_pipeline_id 92353311 92353311
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-2-h9zhkus0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-2-h9zhkus0 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.469 ms) : 1458, 1480
.   : milestone, 1469,
appsec (2.523 ms) : 2468, 2578
.   : milestone, 2523,
iast (2.224 ms) : 2158, 2290
.   : milestone, 2224,
iast_GLOBAL (2.263 ms) : 2197, 2329
.   : milestone, 2263,
profiling (2.07 ms) : 2017, 2123
.   : milestone, 2070,
tracing (2.05 ms) : 1998, 2102
.   : milestone, 2050,
section candidate
no_agent (1.471 ms) : 1460, 1483
.   : milestone, 1471,
appsec (3.706 ms) : 3487, 3925
.   : milestone, 3706,
iast (2.218 ms) : 2152, 2283
.   : milestone, 2218,
iast_GLOBAL (2.258 ms) : 2192, 2323
.   : milestone, 2258,
profiling (2.087 ms) : 2032, 2142
.   : milestone, 2087,
tracing (2.058 ms) : 2006, 2110
.   : milestone, 2058,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.469 ms [1.458 ms, 1.48 ms] -
appsec 2.523 ms [2.468 ms, 2.578 ms] 1.054 ms (71.7%)
iast 2.224 ms [2.158 ms, 2.29 ms] 755.137 µs (51.4%)
iast_GLOBAL 2.263 ms [2.197 ms, 2.329 ms] 794.109 µs (54.1%)
profiling 2.07 ms [2.017 ms, 2.123 ms] 601.051 µs (40.9%)
tracing 2.05 ms [1.998 ms, 2.102 ms] 580.884 µs (39.5%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.471 ms [1.46 ms, 1.483 ms] -
appsec 3.706 ms [3.487 ms, 3.925 ms] 2.235 ms (151.9%)
iast 2.218 ms [2.152 ms, 2.283 ms] 746.452 µs (50.7%)
iast_GLOBAL 2.258 ms [2.192 ms, 2.323 ms] 786.407 µs (53.5%)
profiling 2.087 ms [2.032 ms, 2.142 ms] 615.986 µs (41.9%)
tracing 2.058 ms [2.006 ms, 2.11 ms] 586.752 µs (39.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.54.0-SNAPSHOT~c997577e23, baseline=1.59.0-SNAPSHOT~3d62379c90
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.329 s) : 15329000, 15329000
.   : milestone, 15329000,
appsec (14.745 s) : 14745000, 14745000
.   : milestone, 14745000,
iast (18.198 s) : 18198000, 18198000
.   : milestone, 18198000,
iast_GLOBAL (17.761 s) : 17761000, 17761000
.   : milestone, 17761000,
profiling (14.723 s) : 14723000, 14723000
.   : milestone, 14723000,
tracing (14.605 s) : 14605000, 14605000
.   : milestone, 14605000,
section candidate
no_agent (15.653 s) : 15653000, 15653000
.   : milestone, 15653000,
appsec (14.564 s) : 14564000, 14564000
.   : milestone, 14564000,
iast (18.328 s) : 18328000, 18328000
.   : milestone, 18328000,
iast_GLOBAL (17.75 s) : 17750000, 17750000
.   : milestone, 17750000,
profiling (14.843 s) : 14843000, 14843000
.   : milestone, 14843000,
tracing (14.665 s) : 14665000, 14665000
.   : milestone, 14665000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.329 s [15.329 s, 15.329 s] -
appsec 14.745 s [14.745 s, 14.745 s] -584.0 ms (-3.8%)
iast 18.198 s [18.198 s, 18.198 s] 2.869 s (18.7%)
iast_GLOBAL 17.761 s [17.761 s, 17.761 s] 2.432 s (15.9%)
profiling 14.723 s [14.723 s, 14.723 s] -606.0 ms (-4.0%)
tracing 14.605 s [14.605 s, 14.605 s] -724.0 ms (-4.7%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.653 s [15.653 s, 15.653 s] -
appsec 14.564 s [14.564 s, 14.564 s] -1.089 s (-7.0%)
iast 18.328 s [18.328 s, 18.328 s] 2.675 s (17.1%)
iast_GLOBAL 17.75 s [17.75 s, 17.75 s] 2.097 s (13.4%)
profiling 14.843 s [14.843 s, 14.843 s] -810.0 ms (-5.2%)
tracing 14.665 s [14.665 s, 14.665 s] -988.0 ms (-6.3%)

@PerfectSlayer PerfectSlayer added the tag: no release notes Changes to exclude from release notes label Sep 18, 2025
@PerfectSlayer PerfectSlayer marked this pull request as ready for review September 18, 2025 14:57
@PerfectSlayer PerfectSlayer requested review from a team as code owners September 18, 2025 14:57
@nikita-tkachenko-datadog
Copy link
Contributor

nikita-tkachenko-datadog commented Sep 18, 2025

Will we be forbidding setAccessible(...) calls as well? (such as the one done in datadog.trace.util.MethodHandles#privateFieldSetter(java.lang.Class<?>, java.lang.String))

bric3
bric3 reviewed Sep 18, 2025
View reviewed changes
@PerfectSlayer
Copy link
Contributor Author

PerfectSlayer commented Sep 18, 2025

We won't. Quick quote from my doc about the topic:

But the following will still working:

  • java.lang.reflect.AccessibleObject#setAccessible(boolean) will work to change the accessibility flag and Field.get() / unreflect() / unreflectGetter() will still allow access to private fields value and method calls.

@PerfectSlayer PerfectSlayer marked this pull request as draft September 19, 2025 09:37
@PerfectSlayer
Copy link
Contributor Author

PerfectSlayer commented Sep 19, 2025

Going back to draft to carefully evaluate and document each calls.
I also envisioned some fixes for some of the calls already.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 1, 2026

This pull request has been marked as stale because it has not had activity over the past quarter. It will be closed in 7 days if no further activity occurs. Feel free to reopen the PR if you are still working on it.

@github-actions github-actions bot added the tag: stale Stale pull requests label Jan 1, 2026
@PerfectSlayer
Copy link
Contributor Author

PerfectSlayer commented Jan 5, 2026

Let see if it makes the Q1 planning

@PerfectSlayer PerfectSlayer removed the tag: stale Stale pull requests label Jan 5, 2026
@PerfectSlayer PerfectSlayer mentioned this pull request Jan 16, 2026
Closed
@pr-commenter
Copy link

pr-commenter bot commented Jan 21, 2026 •
edited
Loading

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1769179844 1769180190
end_time 2026-01-23T14:52:04 2026-01-23T14:57:50
git_branch master bbujon/jep500
git_commit_sha 82f9e4b 805b105
start_time 2026-01-23T14:50:45 2026-01-23T14:56:31
See matching parameters
Baseline Candidate
ci_job_id 1373089109 1373089109
ci_pipeline_id 92488283 92488283
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1769179126 1769179126

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 6 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-65.631µs; +27.508µs] or [-22.583%; +9.465%]		 unstable
[-75.809µs; +39.667µs] or [-22.753%; +11.905%]		 unstable
[-92.924µs; +49.013µs] or [-26.442%; +13.947%]		 unstable
[-777.407µs; +402.044µs] or [-67.092%; +34.697%]		 same
scenario:basic same same same unstable
[-149336.712ns; +151238.789ns] or [-18.418%; +18.652%]		 unstable
[-135.543op/s; +277.790op/s] or [-5.151%; +10.556%]
scenario:loop unsure
[+0.310µs; +8.348µs] or [+0.004%; +0.094%]		 unsure
[-14.714µs; -1.961µs] or [-0.164%; -0.022%]		 unsure
[-12.310µs; -0.162µs] or [-0.136%; -0.002%]		 unsure
[-92.385µs; -3.973µs] or [-1.007%; -0.043%]		 same
Request duration reports for reports 
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (333.185 µs) : 263, 403
.   : milestone, 333,
basic (275.196 µs) : 268, 283
.   : milestone, 275,
loop (8.96 ms) : 8953, 8966
.   : milestone, 8960,
section candidate
noprobe (315.114 µs) : 282, 348
.   : milestone, 315,
basic (274.061 µs) : 267, 281
.   : milestone, 274,
loop (8.951 ms) : 8946, 8957
.   : milestone, 8951,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 333.185 µs [262.954 µs, 403.417 µs]
basic 275.196 µs [267.672 µs, 282.72 µs]
loop 8.96 ms [8.953 ms, 8.966 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 315.114 µs [281.742 µs, 348.486 µs]
basic 274.061 µs [267.442 µs, 280.68 µs]
loop 8.951 ms [8.946 ms, 8.957 ms]

@sarahchen6 sarahchen6 marked this pull request as ready for review January 22, 2026 21:26
@sarahchen6 sarahchen6 requested a review from a team as a code owner January 22, 2026 21:26
@sarahchen6 sarahchen6 requested review from tylfin and removed request for a team January 22, 2026 21:26
@tylfin tylfin requested a review from jpbempel January 22, 2026 21:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@bric3 bric3 bric3 left review comments

@sarahchen6 sarahchen6 sarahchen6 left review comments

@nikita-tkachenko-datadog nikita-tkachenko-datadog Awaiting requested review from nikita-tkachenko-datadog nikita-tkachenko-datadog is a code owner automatically assigned from DataDog/ci-app-libraries-java

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/asm-java

@manuel-alvarez-alvarez manuel-alvarez-alvarez Awaiting requested review from manuel-alvarez-alvarez manuel-alvarez-alvarez is a code owner automatically assigned from DataDog/asm-java

@tylfin tylfin Awaiting requested review from tylfin tylfin is a code owner automatically assigned from DataDog/debugger-java

@jpbempel jpbempel Awaiting requested review from jpbempel

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

tag: no release notes Changes to exclude from release notes

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

5 participants

@PerfectSlayer @nikita-tkachenko-datadog @bric3 @sarahchen6