Skip to content

llmobs: set model tag even when llmobs disabled#10644

Draft
ygree wants to merge 1 commit intomasterfrom
ygree/llmobs-systest-fixes
Draft

llmobs: set model tag even when llmobs disabled#10644
ygree wants to merge 1 commit intomasterfrom
ygree/llmobs-systest-fixes

Conversation

@ygree
Copy link
Contributor

@ygree ygree commented Feb 19, 2026

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

Note: Once your PR is ready to merge, add it to the merge queue by commenting /merge. /merge -c cancels the queue request. /merge -f --reason "reason" skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.

@ygree ygree self-assigned this Feb 19, 2026
@ygree ygree added comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix labels Feb 19, 2026
@pr-commenter
Copy link

pr-commenter bot commented Feb 19, 2026

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771925430
git_commit_sha 16f3647 cbd6226
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~cbd6226824
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771927449 1771927449
ci_job_id 1450592466 1450592466
ci_pipeline_id 98506479 98506479
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-0nlcmfjy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-0nlcmfjy 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics.

Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080475
Total [baseline] (8.804 s) : 0, 8804183
Agent [candidate] (1.064 s) : 0, 1063725
Total [candidate] (8.718 s) : 0, 8717822
section iast
Agent [baseline] (1.25 s) : 0, 1249557
Total [baseline] (9.384 s) : 0, 9383974
Agent [candidate] (1.231 s) : 0, 1230613
Total [candidate] (9.355 s) : 0, 9355198
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.08 s -
Agent iast 1.25 s 169.082 ms (15.6%)
Total tracing 8.804 s -
Total iast 9.384 s 579.792 ms (6.6%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.064 s -
Agent iast 1.231 s 166.888 ms (15.7%)
Total tracing 8.718 s -
Total iast 9.355 s 637.376 ms (7.3%)
gantt
    title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (637.962 ms) : 0, 637962
BytebuddyAgent [candidate] (629.135 ms) : 0, 629135
AgentMeter [baseline] (29.487 ms) : 0, 29487
AgentMeter [candidate] (28.883 ms) : 0, 28883
GlobalTracer [baseline] (260.751 ms) : 0, 260751
GlobalTracer [candidate] (257.629 ms) : 0, 257629
AppSec [baseline] (33.38 ms) : 0, 33380
AppSec [candidate] (32.812 ms) : 0, 32812
Debugger [baseline] (62.309 ms) : 0, 62309
Debugger [candidate] (62.194 ms) : 0, 62194
Remote Config [baseline] (638.698 µs) : 0, 639
Remote Config [candidate] (613.979 µs) : 0, 614
Telemetry [baseline] (15.309 ms) : 0, 15309
Telemetry [candidate] (9.777 ms) : 0, 9777
Flare Poller [baseline] (3.777 ms) : 0, 3777
Flare Poller [candidate] (6.176 ms) : 0, 6176
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (809.231 ms) : 0, 809231
BytebuddyAgent [candidate] (795.887 ms) : 0, 795887
AgentMeter [baseline] (11.751 ms) : 0, 11751
AgentMeter [candidate] (11.289 ms) : 0, 11289
GlobalTracer [baseline] (250.787 ms) : 0, 250787
GlobalTracer [candidate] (247.741 ms) : 0, 247741
AppSec [baseline] (34.296 ms) : 0, 34296
AppSec [candidate] (35.578 ms) : 0, 35578
Debugger [baseline] (66.224 ms) : 0, 66224
Debugger [candidate] (63.976 ms) : 0, 63976
Remote Config [baseline] (543.817 µs) : 0, 544
Remote Config [candidate] (541.322 µs) : 0, 541
Telemetry [baseline] (8.722 ms) : 0, 8722
Telemetry [candidate] (8.649 ms) : 0, 8649
Flare Poller [baseline] (3.542 ms) : 0, 3542
Flare Poller [candidate] (3.507 ms) : 0, 3507
IAST [baseline] (27.634 ms) : 0, 27634
IAST [candidate] (27.015 ms) : 0, 27015
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071919
Total [baseline] (10.865 s) : 0, 10864799
Agent [candidate] (1.066 s) : 0, 1065841
Total [candidate] (10.976 s) : 0, 10976148
section appsec
Agent [baseline] (1.247 s) : 0, 1247146
Total [baseline] (11.049 s) : 0, 11048562
Agent [candidate] (1.246 s) : 0, 1246271
Total [candidate] (11.095 s) : 0, 11094565
section iast
Agent [baseline] (1.243 s) : 0, 1242891
Total [baseline] (11.231 s) : 0, 11230507
Agent [candidate] (1.243 s) : 0, 1243284
Total [candidate] (11.167 s) : 0, 11166988
section profiling
Agent [baseline] (1.192 s) : 0, 1192463
Total [baseline] (11.076 s) : 0, 11075888
Agent [candidate] (1.197 s) : 0, 1197375
Total [candidate] (10.953 s) : 0, 10953149
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.072 s -
Agent appsec 1.247 s 175.227 ms (16.3%)
Agent iast 1.243 s 170.972 ms (16.0%)
Agent profiling 1.192 s 120.544 ms (11.2%)
Total tracing 10.865 s -
Total appsec 11.049 s 183.763 ms (1.7%)
Total iast 11.231 s 365.708 ms (3.4%)
Total profiling 11.076 s 211.089 ms (1.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.066 s -
Agent appsec 1.246 s 180.431 ms (16.9%)
Agent iast 1.243 s 177.443 ms (16.6%)
Agent profiling 1.197 s 131.535 ms (12.3%)
Total tracing 10.976 s -
Total appsec 11.095 s 118.417 ms (1.1%)
Total iast 11.167 s 190.84 ms (1.7%)
Total profiling 10.953 s -23.0 ms (-0.2%)
gantt
    title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (632.811 ms) : 0, 632811
BytebuddyAgent [candidate] (629.12 ms) : 0, 629120
AgentMeter [baseline] (29.094 ms) : 0, 29094
AgentMeter [candidate] (29.031 ms) : 0, 29031
GlobalTracer [baseline] (258.458 ms) : 0, 258458
GlobalTracer [candidate] (257.538 ms) : 0, 257538
AppSec [baseline] (33.24 ms) : 0, 33240
AppSec [candidate] (32.862 ms) : 0, 32862
Debugger [baseline] (62.6 ms) : 0, 62600
Debugger [candidate] (62.477 ms) : 0, 62477
Remote Config [baseline] (627.373 µs) : 0, 627
Remote Config [candidate] (645.5 µs) : 0, 646
Telemetry [baseline] (13.186 ms) : 0, 13186
Telemetry [candidate] (12.325 ms) : 0, 12325
Flare Poller [baseline] (5.338 ms) : 0, 5338
Flare Poller [candidate] (5.345 ms) : 0, 5345
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (662.792 ms) : 0, 662792
BytebuddyAgent [candidate] (662.956 ms) : 0, 662956
AgentMeter [baseline] (12.006 ms) : 0, 12006
AgentMeter [candidate] (12.039 ms) : 0, 12039
GlobalTracer [baseline] (259.56 ms) : 0, 259560
GlobalTracer [candidate] (259.614 ms) : 0, 259614
IAST [baseline] (25.566 ms) : 0, 25566
IAST [candidate] (25.483 ms) : 0, 25483
AppSec [baseline] (168.731 ms) : 0, 168731
AppSec [candidate] (169.153 ms) : 0, 169153
Debugger [baseline] (67.667 ms) : 0, 67667
Debugger [candidate] (66.368 ms) : 0, 66368
Remote Config [baseline] (653.811 µs) : 0, 654
Remote Config [candidate] (681.501 µs) : 0, 682
Telemetry [baseline] (9.712 ms) : 0, 9712
Telemetry [candidate] (9.67 ms) : 0, 9670
Flare Poller [baseline] (3.823 ms) : 0, 3823
Flare Poller [candidate] (3.714 ms) : 0, 3714
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (804.038 ms) : 0, 804038
BytebuddyAgent [candidate] (804.46 ms) : 0, 804460
AgentMeter [baseline] (11.553 ms) : 0, 11553
AgentMeter [candidate] (11.53 ms) : 0, 11530
GlobalTracer [baseline] (249.937 ms) : 0, 249937
GlobalTracer [candidate] (249.467 ms) : 0, 249467
IAST [baseline] (27.34 ms) : 0, 27340
IAST [candidate] (27.44 ms) : 0, 27440
AppSec [baseline] (34.251 ms) : 0, 34251
AppSec [candidate] (34.985 ms) : 0, 34985
Debugger [baseline] (66.733 ms) : 0, 66733
Debugger [candidate] (66.241 ms) : 0, 66241
Remote Config [baseline] (545.85 µs) : 0, 546
Remote Config [candidate] (535.709 µs) : 0, 536
Telemetry [baseline] (8.492 ms) : 0, 8492
Telemetry [candidate] (8.593 ms) : 0, 8593
Flare Poller [baseline] (3.401 ms) : 0, 3401
Flare Poller [candidate] (3.401 ms) : 0, 3401
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (682.168 ms) : 0, 682168
BytebuddyAgent [candidate] (686.726 ms) : 0, 686726
AgentMeter [baseline] (8.668 ms) : 0, 8668
AgentMeter [candidate] (8.71 ms) : 0, 8710
GlobalTracer [baseline] (216.455 ms) : 0, 216455
GlobalTracer [candidate] (216.709 ms) : 0, 216709
AppSec [baseline] (32.926 ms) : 0, 32926
AppSec [candidate] (33.091 ms) : 0, 33091
Debugger [baseline] (67.537 ms) : 0, 67537
Debugger [candidate] (68.194 ms) : 0, 68194
Remote Config [baseline] (637.82 µs) : 0, 638
Remote Config [candidate] (626.777 µs) : 0, 627
Telemetry [baseline] (9.025 ms) : 0, 9025
Telemetry [candidate] (9.006 ms) : 0, 9006
Flare Poller [baseline] (3.821 ms) : 0, 3821
Flare Poller [candidate] (3.77 ms) : 0, 3770
ProfilingAgent [baseline] (100.054 ms) : 0, 100054
ProfilingAgent [candidate] (99.47 ms) : 0, 99470
Profiling [baseline] (100.672 ms) : 0, 100672
Profiling [candidate] (100.04 ms) : 0, 100040
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771925430
git_commit_sha 16f3647 cbd6226
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~cbd6226824
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1771927945 1771927945
ci_job_id 1450592467 1450592467
ci_pipeline_id 98506479 98506479
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-12nh26ri 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-12nh26ri 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast:high_load better
[-154.086µs; -64.675µs] or [-6.243%; -2.620%]
unsure
[-495.342µs; -89.807µs] or [-6.725%; -1.219%]
unstable
[-93.225op/s; +213.787op/s] or [-6.539%; +14.995%]
2.359ms 7.073ms 1486.031op/s 2.468ms 7.365ms 1425.750op/s
scenario:load:petclinic:iast:high_load better
[-1332.097µs; -597.904µs] or [-7.313%; -3.282%]
better
[-2.212ms; -0.967ms] or [-7.381%; -3.228%]
unstable
[-15.471op/s; +40.408op/s] or [-6.152%; +16.069%]
17.251ms 28.377ms 263.938op/s 18.216ms 29.967ms 251.469op/s
scenario:load:petclinic:profiling:high_load worse
[+0.729ms; +1.722ms] or [+3.997%; +9.447%]
same
[-267.641µs; +1467.367µs] or [-0.893%; +4.896%]
unstable
[-40.288op/s; +14.038op/s] or [-15.997%; +5.574%]
19.458ms 30.570ms 238.719op/s 18.233ms 29.970ms 251.844op/s
scenario:load:petclinic:no_agent:high_load better
[-2.187ms; -0.650ms] or [-11.504%; -3.418%]
unsure
[-2.872ms; -0.088ms] or [-9.263%; -0.285%]
unstable
[-8.993op/s; +48.118op/s] or [-3.740%; +20.010%]
17.590ms 29.520ms 260.031op/s 19.008ms 30.999ms 240.469op/s
Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.413 ms) : 19214, 19612
.   : milestone, 19413,
appsec (19.047 ms) : 18854, 19241
.   : milestone, 19047,
code_origins (17.639 ms) : 17466, 17812
.   : milestone, 17639,
iast (18.56 ms) : 18373, 18747
.   : milestone, 18560,
profiling (18.533 ms) : 18348, 18717
.   : milestone, 18533,
tracing (17.449 ms) : 17274, 17624
.   : milestone, 17449,
section candidate
no_agent (17.943 ms) : 17761, 18125
.   : milestone, 17943,
appsec (18.585 ms) : 18399, 18772
.   : milestone, 18585,
code_origins (17.766 ms) : 17589, 17944
.   : milestone, 17766,
iast (17.679 ms) : 17503, 17854
.   : milestone, 17679,
profiling (19.564 ms) : 19369, 19758
.   : milestone, 19564,
tracing (17.88 ms) : 17700, 18059
.   : milestone, 17880,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.413 ms [19.214 ms, 19.612 ms] -
appsec 19.047 ms [18.854 ms, 19.241 ms] -366.094 µs (-1.9%)
code_origins 17.639 ms [17.466 ms, 17.812 ms] -1.774 ms (-9.1%)
iast 18.56 ms [18.373 ms, 18.747 ms] -852.927 µs (-4.4%)
profiling 18.533 ms [18.348 ms, 18.717 ms] -880.415 µs (-4.5%)
tracing 17.449 ms [17.274 ms, 17.624 ms] -1.964 ms (-10.1%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.943 ms [17.761 ms, 18.125 ms] -
appsec 18.585 ms [18.399 ms, 18.772 ms] 642.497 µs (3.6%)
code_origins 17.766 ms [17.589 ms, 17.944 ms] -176.365 µs (-1.0%)
iast 17.679 ms [17.503 ms, 17.854 ms] -264.223 µs (-1.5%)
profiling 19.564 ms [19.369 ms, 19.758 ms] 1.621 ms (9.0%)
tracing 17.88 ms [17.7 ms, 18.059 ms] -63.154 µs (-0.4%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.182 ms) : 1171, 1194
.   : milestone, 1182,
iast (3.207 ms) : 3165, 3250
.   : milestone, 3207,
iast_FULL (5.889 ms) : 5830, 5948
.   : milestone, 5889,
iast_GLOBAL (3.604 ms) : 3537, 3670
.   : milestone, 3604,
profiling (2.148 ms) : 2127, 2168
.   : milestone, 2148,
tracing (1.816 ms) : 1800, 1831
.   : milestone, 1816,
section candidate
no_agent (1.192 ms) : 1180, 1204
.   : milestone, 1192,
iast (3.076 ms) : 3036, 3116
.   : milestone, 3076,
iast_FULL (5.961 ms) : 5901, 6022
.   : milestone, 5961,
iast_GLOBAL (3.519 ms) : 3463, 3574
.   : milestone, 3519,
profiling (2.059 ms) : 2039, 2078
.   : milestone, 2059,
tracing (1.857 ms) : 1841, 1873
.   : milestone, 1857,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.182 ms [1.171 ms, 1.194 ms] -
iast 3.207 ms [3.165 ms, 3.25 ms] 2.025 ms (171.3%)
iast_FULL 5.889 ms [5.83 ms, 5.948 ms] 4.707 ms (398.1%)
iast_GLOBAL 3.604 ms [3.537 ms, 3.67 ms] 2.421 ms (204.8%)
profiling 2.148 ms [2.127 ms, 2.168 ms] 965.308 µs (81.6%)
tracing 1.816 ms [1.8 ms, 1.831 ms] 633.393 µs (53.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.192 ms [1.18 ms, 1.204 ms] -
iast 3.076 ms [3.036 ms, 3.116 ms] 1.884 ms (158.1%)
iast_FULL 5.961 ms [5.901 ms, 6.022 ms] 4.769 ms (400.2%)
iast_GLOBAL 3.519 ms [3.463 ms, 3.574 ms] 2.327 ms (195.2%)
profiling 2.059 ms [2.039 ms, 2.078 ms] 866.936 µs (72.7%)
tracing 1.857 ms [1.841 ms, 1.873 ms] 665.135 µs (55.8%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/llmobs-systest-fixes
git_commit_date 1771372325 1771925430
git_commit_sha 16f3647 cbd6226
release_version 1.60.0-SNAPSHOT~16f36474a2 1.60.0-SNAPSHOT~cbd6226824
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1771927636 1771927636
ci_job_id 1450592468 1450592468
ci_pipeline_id 98506479 98506479
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-rfebq0ko 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-rfebq0ko 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.371 s) : 15371000, 15371000
.   : milestone, 15371000,
appsec (14.819 s) : 14819000, 14819000
.   : milestone, 14819000,
iast (18.129 s) : 18129000, 18129000
.   : milestone, 18129000,
iast_GLOBAL (17.826 s) : 17826000, 17826000
.   : milestone, 17826000,
profiling (14.915 s) : 14915000, 14915000
.   : milestone, 14915000,
tracing (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
section candidate
no_agent (15.082 s) : 15082000, 15082000
.   : milestone, 15082000,
appsec (15.034 s) : 15034000, 15034000
.   : milestone, 15034000,
iast (18.0 s) : 18000000, 18000000
.   : milestone, 18000000,
iast_GLOBAL (17.947 s) : 17947000, 17947000
.   : milestone, 17947000,
profiling (14.834 s) : 14834000, 14834000
.   : milestone, 14834000,
tracing (14.746 s) : 14746000, 14746000
.   : milestone, 14746000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.371 s [15.371 s, 15.371 s] -
appsec 14.819 s [14.819 s, 14.819 s] -552.0 ms (-3.6%)
iast 18.129 s [18.129 s, 18.129 s] 2.758 s (17.9%)
iast_GLOBAL 17.826 s [17.826 s, 17.826 s] 2.455 s (16.0%)
profiling 14.915 s [14.915 s, 14.915 s] -456.0 ms (-3.0%)
tracing 14.852 s [14.852 s, 14.852 s] -519.0 ms (-3.4%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.082 s [15.082 s, 15.082 s] -
appsec 15.034 s [15.034 s, 15.034 s] -48.0 ms (-0.3%)
iast 18.0 s [18.0 s, 18.0 s] 2.918 s (19.3%)
iast_GLOBAL 17.947 s [17.947 s, 17.947 s] 2.865 s (19.0%)
profiling 14.834 s [14.834 s, 14.834 s] -248.0 ms (-1.6%)
tracing 14.746 s [14.746 s, 14.746 s] -336.0 ms (-2.2%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.76 ms) : 3540, 3979
.   : milestone, 3760,
iast (2.237 ms) : 2168, 2306
.   : milestone, 2237,
iast_GLOBAL (2.287 ms) : 2218, 2356
.   : milestone, 2287,
profiling (2.09 ms) : 2033, 2146
.   : milestone, 2090,
tracing (2.042 ms) : 1989, 2095
.   : milestone, 2042,
section candidate
no_agent (1.468 ms) : 1457, 1480
.   : milestone, 1468,
appsec (3.757 ms) : 3537, 3976
.   : milestone, 3757,
iast (2.244 ms) : 2175, 2312
.   : milestone, 2244,
iast_GLOBAL (2.288 ms) : 2219, 2357
.   : milestone, 2288,
profiling (2.065 ms) : 2011, 2119
.   : milestone, 2065,
tracing (2.051 ms) : 1998, 2105
.   : milestone, 2051,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.76 ms [3.54 ms, 3.979 ms] 2.291 ms (156.1%)
iast 2.237 ms [2.168 ms, 2.306 ms] 768.612 µs (52.3%)
iast_GLOBAL 2.287 ms [2.218 ms, 2.356 ms] 818.864 µs (55.8%)
profiling 2.09 ms [2.033 ms, 2.146 ms] 621.284 µs (42.3%)
tracing 2.042 ms [1.989 ms, 2.095 ms] 573.848 µs (39.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.468 ms [1.457 ms, 1.48 ms] -
appsec 3.757 ms [3.537 ms, 3.976 ms] 2.289 ms (155.9%)
iast 2.244 ms [2.175 ms, 2.312 ms] 775.544 µs (52.8%)
iast_GLOBAL 2.288 ms [2.219 ms, 2.357 ms] 820.28 µs (55.9%)
profiling 2.065 ms [2.011 ms, 2.119 ms] 596.991 µs (40.7%)
tracing 2.051 ms [1.998 ms, 2.105 ms] 583.33 µs (39.7%)

@ygree ygree force-pushed the ygree/llmobs-systest-fixes branch from 5cd257e to cbd6226 Compare February 24, 2026 09:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp: mlobs ML Observability (LLMObs) type: bug Bug report and fix

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant