Store accumulator-stage lookups directly by charlesmyu · Pull Request #10645 · DataDog/dd-trace-java

charlesmyu · 2026-02-19T21:51:36Z

What Does This Do

Stores the map of accumulator ID to stage ID directly in a Long - Integer map, rather than storing the stage-level accumulators themselves.

Motivation

The stage-level accumulators naively roll up metrics from the task level by summing all values. This means they are not accurate in all cases, particular for metrics that are better visualized as a distribution of values across all tasks instead of a single sum.

In #10553 we rollup task-level metrics ourselves and encode them into the Spark SQL metrics as distributions in order to improve the granularity of information collected. This left one remaining use of the stage-level accumulators - mapping operations in Spark SQL plans to their respective stages.

Since we do not need the entire accumulator to accomplish this, we should simplify that to a ID-ID map instead to save space. We can also remove the 50k limit since we are not storing the entire accumulator, allowing us to avoid creating orphaned operations (previously occurred when the EldestHashMap overflowed).

Additional Notes

I didn't feel the explicit need for a FF here, since the change is fairly straightforwards and shouldn't negatively impact perf. However, if we feel strongly otherwise I'm happy to make that happen.

Contributor Checklist

Format the title according to the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any other useful labels
Avoid using close, fix, or any linking keywords when referencing an issue
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, migration, or deletion
Update public documentation with any new configuration flags or behaviors

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

pr-commenter · 2026-02-19T22:49:24Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/stop-storing-stage-accumulators
git_commit_date	1771954806	1771963573
git_commit_sha	`f453b4e`	`780cd6f`
release_version	1.60.0-SNAPSHOT~f453b4e500	1.60.0-SNAPSHOT~780cd6f04a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771965372	1771965372
ci_job_id	1453150372	1453150372
ci_pipeline_id	98683560	98683560
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-v9lwr2ls 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-v9lwr2ls 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 61 metrics, 10 unstable metrics.

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.074 s) : 0, 1073925
Total [baseline] (8.761 s) : 0, 8760551
Agent [candidate] (1.067 s) : 0, 1066597
Total [candidate] (8.744 s) : 0, 8743742
section iast
Agent [baseline] (1.234 s) : 0, 1234137
Total [baseline] (9.368 s) : 0, 9367935
Agent [candidate] (1.228 s) : 0, 1228039
Total [candidate] (9.353 s) : 0, 9353279

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.074 s	-
Agent	iast	1.234 s	160.212 ms (14.9%)
Total	tracing	8.761 s	-
Total	iast	9.368 s	607.385 ms (6.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.067 s	-
Agent	iast	1.228 s	161.442 ms (15.1%)
Total	tracing	8.744 s	-
Total	iast	9.353 s	609.536 ms (7.0%)

gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.224 ms) : 0, 1224
crashtracking [candidate] (1.179 ms) : 0, 1179
BytebuddyAgent [baseline] (635.763 ms) : 0, 635763
BytebuddyAgent [candidate] (628.68 ms) : 0, 628680
AgentMeter [baseline] (29.26 ms) : 0, 29260
AgentMeter [candidate] (28.907 ms) : 0, 28907
GlobalTracer [baseline] (258.951 ms) : 0, 258951
GlobalTracer [candidate] (257.881 ms) : 0, 257881
AppSec [baseline] (33.151 ms) : 0, 33151
AppSec [candidate] (32.926 ms) : 0, 32926
Debugger [baseline] (64.141 ms) : 0, 64141
Debugger [candidate] (62.843 ms) : 0, 62843
Remote Config [baseline] (620.233 µs) : 0, 620
Remote Config [candidate] (632.886 µs) : 0, 633
Telemetry [baseline] (10.618 ms) : 0, 10618
Telemetry [candidate] (9.882 ms) : 0, 9882
Flare Poller [baseline] (3.763 ms) : 0, 3763
Flare Poller [candidate] (7.607 ms) : 0, 7607
section iast
crashtracking [baseline] (1.2 ms) : 0, 1200
crashtracking [candidate] (1.191 ms) : 0, 1191
BytebuddyAgent [baseline] (798.253 ms) : 0, 798253
BytebuddyAgent [candidate] (794.065 ms) : 0, 794065
AgentMeter [baseline] (11.468 ms) : 0, 11468
AgentMeter [candidate] (11.255 ms) : 0, 11255
GlobalTracer [baseline] (247.563 ms) : 0, 247563
GlobalTracer [candidate] (247.193 ms) : 0, 247193
IAST [baseline] (27.152 ms) : 0, 27152
IAST [candidate] (26.839 ms) : 0, 26839
AppSec [baseline] (33.075 ms) : 0, 33075
AppSec [candidate] (34.736 ms) : 0, 34736
Debugger [baseline] (66.625 ms) : 0, 66625
Debugger [candidate] (64.264 ms) : 0, 64264
Remote Config [baseline] (540.471 µs) : 0, 540
Remote Config [candidate] (533.701 µs) : 0, 534
Telemetry [baseline] (8.709 ms) : 0, 8709
Telemetry [candidate] (8.612 ms) : 0, 8612
Flare Poller [baseline] (3.458 ms) : 0, 3458
Flare Poller [candidate] (3.446 ms) : 0, 3446

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.07 s) : 0, 1070407
Total [baseline] (10.799 s) : 0, 10799081
Agent [candidate] (1.074 s) : 0, 1074287
Total [candidate] (10.956 s) : 0, 10956289
section appsec
Agent [baseline] (1.24 s) : 0, 1239797
Total [baseline] (10.98 s) : 0, 10979974
Agent [candidate] (1.24 s) : 0, 1240060
Total [candidate] (11.002 s) : 0, 11002410
section iast
Agent [baseline] (1.233 s) : 0, 1233129
Total [baseline] (11.148 s) : 0, 11148070
Agent [candidate] (1.228 s) : 0, 1227811
Total [candidate] (11.155 s) : 0, 11155454
section profiling
Agent [baseline] (1.19 s) : 0, 1190329
Total [baseline] (10.896 s) : 0, 10895675
Agent [candidate] (1.199 s) : 0, 1199262
Total [candidate] (10.998 s) : 0, 10997619

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.07 s	-
Agent	appsec	1.24 s	169.39 ms (15.8%)
Agent	iast	1.233 s	162.722 ms (15.2%)
Agent	profiling	1.19 s	119.923 ms (11.2%)
Total	tracing	10.799 s	-
Total	appsec	10.98 s	180.893 ms (1.7%)
Total	iast	11.148 s	348.989 ms (3.2%)
Total	profiling	10.896 s	96.593 ms (0.9%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.074 s	-
Agent	appsec	1.24 s	165.773 ms (15.4%)
Agent	iast	1.228 s	153.524 ms (14.3%)
Agent	profiling	1.199 s	124.975 ms (11.6%)
Total	tracing	10.956 s	-
Total	appsec	11.002 s	46.12 ms (0.4%)
Total	iast	11.155 s	199.164 ms (1.8%)
Total	profiling	10.998 s	41.33 ms (0.4%)

gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.207 ms) : 0, 1207
BytebuddyAgent [baseline] (631.798 ms) : 0, 631798
BytebuddyAgent [candidate] (633.196 ms) : 0, 633196
AgentMeter [baseline] (29.34 ms) : 0, 29340
AgentMeter [candidate] (29.285 ms) : 0, 29285
GlobalTracer [baseline] (257.525 ms) : 0, 257525
GlobalTracer [candidate] (259.056 ms) : 0, 259056
AppSec [baseline] (33.09 ms) : 0, 33090
AppSec [candidate] (33.148 ms) : 0, 33148
Debugger [baseline] (65.379 ms) : 0, 65379
Debugger [candidate] (64.1 ms) : 0, 64100
Remote Config [baseline] (621.297 µs) : 0, 621
Remote Config [candidate] (623.275 µs) : 0, 623
Telemetry [baseline] (10.75 ms) : 0, 10750
Telemetry [candidate] (11.376 ms) : 0, 11376
Flare Poller [baseline] (4.534 ms) : 0, 4534
Flare Poller [candidate] (6.144 ms) : 0, 6144
section appsec
crashtracking [baseline] (1.183 ms) : 0, 1183
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (658.918 ms) : 0, 658918
BytebuddyAgent [candidate] (658.361 ms) : 0, 658361
AgentMeter [baseline] (11.942 ms) : 0, 11942
AgentMeter [candidate] (11.917 ms) : 0, 11917
GlobalTracer [baseline] (258.25 ms) : 0, 258250
GlobalTracer [candidate] (258.441 ms) : 0, 258441
IAST [baseline] (25.259 ms) : 0, 25259
IAST [candidate] (25.388 ms) : 0, 25388
AppSec [baseline] (167.879 ms) : 0, 167879
AppSec [candidate] (168.017 ms) : 0, 168017
Debugger [baseline] (66.552 ms) : 0, 66552
Debugger [candidate] (66.919 ms) : 0, 66919
Remote Config [baseline] (642.318 µs) : 0, 642
Remote Config [candidate] (644.036 µs) : 0, 644
Telemetry [baseline] (9.458 ms) : 0, 9458
Telemetry [candidate] (9.506 ms) : 0, 9506
Flare Poller [baseline] (3.744 ms) : 0, 3744
Flare Poller [candidate] (3.711 ms) : 0, 3711
section iast
crashtracking [baseline] (1.187 ms) : 0, 1187
crashtracking [candidate] (1.181 ms) : 0, 1181
BytebuddyAgent [baseline] (796.981 ms) : 0, 796981
BytebuddyAgent [candidate] (793.849 ms) : 0, 793849
AgentMeter [baseline] (11.29 ms) : 0, 11290
AgentMeter [candidate] (11.258 ms) : 0, 11258
GlobalTracer [baseline] (247.326 ms) : 0, 247326
GlobalTracer [candidate] (246.752 ms) : 0, 246752
IAST [baseline] (27.178 ms) : 0, 27178
IAST [candidate] (26.812 ms) : 0, 26812
AppSec [baseline] (32.302 ms) : 0, 32302
AppSec [candidate] (35.301 ms) : 0, 35301
Debugger [baseline] (68.308 ms) : 0, 68308
Debugger [candidate] (64.17 ms) : 0, 64170
Remote Config [baseline] (530.183 µs) : 0, 530
Remote Config [candidate] (534.844 µs) : 0, 535
Telemetry [baseline] (8.575 ms) : 0, 8575
Telemetry [candidate] (8.624 ms) : 0, 8624
Flare Poller [baseline] (3.478 ms) : 0, 3478
Flare Poller [candidate] (3.477 ms) : 0, 3477
section profiling
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (682.093 ms) : 0, 682093
BytebuddyAgent [candidate] (686.872 ms) : 0, 686872
AgentMeter [baseline] (8.551 ms) : 0, 8551
AgentMeter [candidate] (8.645 ms) : 0, 8645
GlobalTracer [baseline] (216.067 ms) : 0, 216067
GlobalTracer [candidate] (217.539 ms) : 0, 217539
AppSec [baseline] (32.418 ms) : 0, 32418
AppSec [candidate] (32.943 ms) : 0, 32943
Debugger [baseline] (67.115 ms) : 0, 67115
Debugger [candidate] (66.853 ms) : 0, 66853
Remote Config [baseline] (621.381 µs) : 0, 621
Remote Config [candidate] (637.424 µs) : 0, 637
Telemetry [baseline] (8.968 ms) : 0, 8968
Telemetry [candidate] (9.827 ms) : 0, 9827
Flare Poller [baseline] (3.747 ms) : 0, 3747
Flare Poller [candidate] (3.767 ms) : 0, 3767
ProfilingAgent [baseline] (98.942 ms) : 0, 98942
ProfilingAgent [candidate] (100.145 ms) : 0, 100145
Profiling [baseline] (99.508 ms) : 0, 99508
Profiling [candidate] (100.722 ms) : 0, 100722

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/stop-storing-stage-accumulators
git_commit_date	1771954806	1771963573
git_commit_sha	`f453b4e`	`780cd6f`
release_version	1.60.0-SNAPSHOT~f453b4e500	1.60.0-SNAPSHOT~780cd6f04a

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1771965874	1771965874
ci_job_id	1453150375	1453150375
ci_pipeline_id	98683560	98683560
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-kl3xlaix 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-kl3xlaix 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 0 performance regressions! Performance is the same for 19 metrics, 15 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:code_origins:high_load	better [-1.292ms; -0.908ms] or [-7.120%; -5.001%]	better [-2.455ms; -1.371ms] or [-8.236%; -4.599%]	unstable [-12.686op/s; +46.624op/s] or [-5.033%; +18.497%]	17.050ms	27.898ms	269.031op/s	18.150ms	29.812ms	252.062op/s

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.172 ms) : 1161, 1183
.   : milestone, 1172,
iast (3.162 ms) : 3121, 3204
.   : milestone, 3162,
iast_FULL (5.873 ms) : 5813, 5932
.   : milestone, 5873,
iast_GLOBAL (3.646 ms) : 3588, 3703
.   : milestone, 3646,
profiling (2.273 ms) : 2249, 2296
.   : milestone, 2273,
tracing (1.827 ms) : 1810, 1844
.   : milestone, 1827,
section candidate
no_agent (1.188 ms) : 1176, 1199
.   : milestone, 1188,
iast (3.178 ms) : 3134, 3222
.   : milestone, 3178,
iast_FULL (6.072 ms) : 6010, 6133
.   : milestone, 6072,
iast_GLOBAL (3.54 ms) : 3485, 3595
.   : milestone, 3540,
profiling (2.228 ms) : 2207, 2249
.   : milestone, 2228,
tracing (1.822 ms) : 1807, 1838
.   : milestone, 1822,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.172 ms [1.161 ms, 1.183 ms]	-
iast	3.162 ms [3.121 ms, 3.204 ms]	1.99 ms (169.9%)
iast_FULL	5.873 ms [5.813 ms, 5.932 ms]	4.701 ms (401.1%)
iast_GLOBAL	3.646 ms [3.588 ms, 3.703 ms]	2.474 ms (211.1%)
profiling	2.273 ms [2.249 ms, 2.296 ms]	1.101 ms (93.9%)
tracing	1.827 ms [1.81 ms, 1.844 ms]	655.24 µs (55.9%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.188 ms [1.176 ms, 1.199 ms]	-
iast	3.178 ms [3.134 ms, 3.222 ms]	1.991 ms (167.6%)
iast_FULL	6.072 ms [6.01 ms, 6.133 ms]	4.884 ms (411.2%)
iast_GLOBAL	3.54 ms [3.485 ms, 3.595 ms]	2.353 ms (198.1%)
profiling	2.228 ms [2.207 ms, 2.249 ms]	1.04 ms (87.6%)
tracing	1.822 ms [1.807 ms, 1.838 ms]	634.464 µs (53.4%)

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.183 ms) : 17995, 18371
.   : milestone, 18183,
appsec (18.541 ms) : 18356, 18726
.   : milestone, 18541,
code_origins (18.518 ms) : 18333, 18702
.   : milestone, 18518,
iast (17.624 ms) : 17449, 17799
.   : milestone, 17624,
profiling (18.775 ms) : 18587, 18964
.   : milestone, 18775,
tracing (17.734 ms) : 17558, 17910
.   : milestone, 17734,
section candidate
no_agent (17.818 ms) : 17638, 17998
.   : milestone, 17818,
appsec (18.365 ms) : 18181, 18549
.   : milestone, 18365,
code_origins (17.341 ms) : 17172, 17511
.   : milestone, 17341,
iast (17.801 ms) : 17621, 17980
.   : milestone, 17801,
profiling (18.865 ms) : 18680, 19050
.   : milestone, 18865,
tracing (18.572 ms) : 18386, 18758
.   : milestone, 18572,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.183 ms [17.995 ms, 18.371 ms]	-
appsec	18.541 ms [18.356 ms, 18.726 ms]	358.13 µs (2.0%)
code_origins	18.518 ms [18.333 ms, 18.702 ms]	334.833 µs (1.8%)
iast	17.624 ms [17.449 ms, 17.799 ms]	-558.584 µs (-3.1%)
profiling	18.775 ms [18.587 ms, 18.964 ms]	592.428 µs (3.3%)
tracing	17.734 ms [17.558 ms, 17.91 ms]	-449.063 µs (-2.5%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	17.818 ms [17.638 ms, 17.998 ms]	-
appsec	18.365 ms [18.181 ms, 18.549 ms]	547.037 µs (3.1%)
code_origins	17.341 ms [17.172 ms, 17.511 ms]	-476.627 µs (-2.7%)
iast	17.801 ms [17.621 ms, 17.98 ms]	-17.257 µs (-0.1%)
profiling	18.865 ms [18.68 ms, 19.05 ms]	1.047 ms (5.9%)
tracing	18.572 ms [18.386 ms, 18.758 ms]	754.089 µs (4.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	charles.yu/djm-0000/stop-storing-stage-accumulators
git_commit_date	1771954806	1771963573
git_commit_sha	`f453b4e`	`780cd6f`
release_version	1.60.0-SNAPSHOT~f453b4e500	1.60.0-SNAPSHOT~780cd6f04a

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1771965559	1771965559
ci_job_id	1453150377	1453150377
ci_pipeline_id	98683560	98683560
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-fnsr4r5l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-fnsr4r5l 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1472, 1495
.   : milestone, 1483,
appsec (2.582 ms) : 2524, 2640
.   : milestone, 2582,
iast (2.275 ms) : 2206, 2345
.   : milestone, 2275,
iast_GLOBAL (2.306 ms) : 2237, 2376
.   : milestone, 2306,
profiling (2.098 ms) : 2043, 2153
.   : milestone, 2098,
tracing (2.08 ms) : 2026, 2134
.   : milestone, 2080,
section candidate
no_agent (1.48 ms) : 1469, 1492
.   : milestone, 1480,
appsec (3.792 ms) : 3570, 4015
.   : milestone, 3792,
iast (2.26 ms) : 2191, 2330
.   : milestone, 2260,
iast_GLOBAL (2.311 ms) : 2241, 2381
.   : milestone, 2311,
profiling (2.089 ms) : 2034, 2144
.   : milestone, 2089,
tracing (2.081 ms) : 2027, 2136
.   : milestone, 2081,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.483 ms [1.472 ms, 1.495 ms]	-
appsec	2.582 ms [2.524 ms, 2.64 ms]	1.099 ms (74.1%)
iast	2.275 ms [2.206 ms, 2.345 ms]	791.9 µs (53.4%)
iast_GLOBAL	2.306 ms [2.237 ms, 2.376 ms]	823.298 µs (55.5%)
profiling	2.098 ms [2.043 ms, 2.153 ms]	614.584 µs (41.4%)
tracing	2.08 ms [2.026 ms, 2.134 ms]	596.853 µs (40.2%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.48 ms [1.469 ms, 1.492 ms]	-
appsec	3.792 ms [3.57 ms, 4.015 ms]	2.312 ms (156.2%)
iast	2.26 ms [2.191 ms, 2.33 ms]	780.076 µs (52.7%)
iast_GLOBAL	2.311 ms [2.241 ms, 2.381 ms]	830.64 µs (56.1%)
profiling	2.089 ms [2.034 ms, 2.144 ms]	608.35 µs (41.1%)
tracing	2.081 ms [2.027 ms, 2.136 ms]	601.047 µs (40.6%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~780cd6f04a, baseline=1.60.0-SNAPSHOT~f453b4e500
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.674 s) : 14674000, 14674000
.   : milestone, 14674000,
appsec (14.693 s) : 14693000, 14693000
.   : milestone, 14693000,
iast (18.161 s) : 18161000, 18161000
.   : milestone, 18161000,
iast_GLOBAL (17.985 s) : 17985000, 17985000
.   : milestone, 17985000,
profiling (15.454 s) : 15454000, 15454000
.   : milestone, 15454000,
tracing (14.681 s) : 14681000, 14681000
.   : milestone, 14681000,
section candidate
no_agent (15.46 s) : 15460000, 15460000
.   : milestone, 15460000,
appsec (14.791 s) : 14791000, 14791000
.   : milestone, 14791000,
iast (18.058 s) : 18058000, 18058000
.   : milestone, 18058000,
iast_GLOBAL (17.756 s) : 17756000, 17756000
.   : milestone, 17756000,
profiling (14.908 s) : 14908000, 14908000
.   : milestone, 14908000,
tracing (14.44 s) : 14440000, 14440000
.   : milestone, 14440000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.674 s [14.674 s, 14.674 s]	-
appsec	14.693 s [14.693 s, 14.693 s]	19.0 ms (0.1%)
iast	18.161 s [18.161 s, 18.161 s]	3.487 s (23.8%)
iast_GLOBAL	17.985 s [17.985 s, 17.985 s]	3.311 s (22.6%)
profiling	15.454 s [15.454 s, 15.454 s]	780.0 ms (5.3%)
tracing	14.681 s [14.681 s, 14.681 s]	7.0 ms (0.0%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	15.46 s [15.46 s, 15.46 s]	-
appsec	14.791 s [14.791 s, 14.791 s]	-669.0 ms (-4.3%)
iast	18.058 s [18.058 s, 18.058 s]	2.598 s (16.8%)
iast_GLOBAL	17.756 s [17.756 s, 17.756 s]	2.296 s (14.9%)
profiling	14.908 s [14.908 s, 14.908 s]	-552.0 ms (-3.6%)
tracing	14.44 s [14.44 s, 14.44 s]	-1.02 s (-6.6%)

charlesmyu · 2026-02-24T20:07:06Z

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

Store accumulator-stage lookups directly #10645 👈 (View in Graphite)
Track external accumulators in tracer instead of using SparkInfo values #10553
master

This stack of pull requests is managed by Graphite. Learn more about stacking.

charlesmyu added the inst: apache spark Apache Spark instrumentation label Feb 19, 2026

charlesmyu mentioned this pull request Feb 19, 2026

Track external accumulators in tracer instead of using SparkInfo values #10553

Draft

charlesmyu force-pushed the charles.yu/djm-0000/fix-spark-plan-metrics branch from e52fbc5 to e413d1d Compare February 19, 2026 22:02

charlesmyu force-pushed the charles.yu/djm-0000/stop-storing-stage-accumulators branch from e1c532c to 9594586 Compare February 19, 2026 22:02

charlesmyu added the type: enhancement Enhancements and improvements label Feb 20, 2026

charlesmyu force-pushed the charles.yu/djm-0000/fix-spark-plan-metrics branch from e413d1d to 89df516 Compare February 23, 2026 21:52

charlesmyu force-pushed the charles.yu/djm-0000/stop-storing-stage-accumulators branch from 9594586 to cb6648d Compare February 23, 2026 21:52

Store accumulator-stage lookups directly

780cd6f

charlesmyu force-pushed the charles.yu/djm-0000/fix-spark-plan-metrics branch from 89df516 to 8651527 Compare February 24, 2026 20:06

charlesmyu force-pushed the charles.yu/djm-0000/stop-storing-stage-accumulators branch from cb6648d to 780cd6f Compare February 24, 2026 20:06

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Store accumulator-stage lookups directly#10645

Store accumulator-stage lookups directly#10645
charlesmyu wants to merge 1 commit intocharles.yu/djm-0000/fix-spark-plan-metricsfrom
charles.yu/djm-0000/stop-storing-stage-accumulators

charlesmyu commented Feb 19, 2026

Uh oh!

pr-commenter bot commented Feb 19, 2026 •

edited

Loading

Uh oh!

charlesmyu commented Feb 24, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

charlesmyu commented Feb 19, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

pr-commenter bot commented Feb 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

charlesmyu commented Feb 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pr-commenter bot commented Feb 19, 2026 •

edited

Loading

charlesmyu commented Feb 24, 2026 •

edited

Loading