llmobs: set model tag even when llmobs disabled#10644
Draft
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.08 s) : 0, 1080475
Total [baseline] (8.804 s) : 0, 8804183
Agent [candidate] (1.064 s) : 0, 1063725
Total [candidate] (8.718 s) : 0, 8717822
section iast
Agent [baseline] (1.25 s) : 0, 1249557
Total [baseline] (9.384 s) : 0, 9383974
Agent [candidate] (1.231 s) : 0, 1230613
Total [candidate] (9.355 s) : 0, 9355198
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.203 ms) : 0, 1203
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (637.962 ms) : 0, 637962
BytebuddyAgent [candidate] (629.135 ms) : 0, 629135
AgentMeter [baseline] (29.487 ms) : 0, 29487
AgentMeter [candidate] (28.883 ms) : 0, 28883
GlobalTracer [baseline] (260.751 ms) : 0, 260751
GlobalTracer [candidate] (257.629 ms) : 0, 257629
AppSec [baseline] (33.38 ms) : 0, 33380
AppSec [candidate] (32.812 ms) : 0, 32812
Debugger [baseline] (62.309 ms) : 0, 62309
Debugger [candidate] (62.194 ms) : 0, 62194
Remote Config [baseline] (638.698 µs) : 0, 639
Remote Config [candidate] (613.979 µs) : 0, 614
Telemetry [baseline] (15.309 ms) : 0, 15309
Telemetry [candidate] (9.777 ms) : 0, 9777
Flare Poller [baseline] (3.777 ms) : 0, 3777
Flare Poller [candidate] (6.176 ms) : 0, 6176
section iast
crashtracking [baseline] (1.202 ms) : 0, 1202
crashtracking [candidate] (1.176 ms) : 0, 1176
BytebuddyAgent [baseline] (809.231 ms) : 0, 809231
BytebuddyAgent [candidate] (795.887 ms) : 0, 795887
AgentMeter [baseline] (11.751 ms) : 0, 11751
AgentMeter [candidate] (11.289 ms) : 0, 11289
GlobalTracer [baseline] (250.787 ms) : 0, 250787
GlobalTracer [candidate] (247.741 ms) : 0, 247741
AppSec [baseline] (34.296 ms) : 0, 34296
AppSec [candidate] (35.578 ms) : 0, 35578
Debugger [baseline] (66.224 ms) : 0, 66224
Debugger [candidate] (63.976 ms) : 0, 63976
Remote Config [baseline] (543.817 µs) : 0, 544
Remote Config [candidate] (541.322 µs) : 0, 541
Telemetry [baseline] (8.722 ms) : 0, 8722
Telemetry [candidate] (8.649 ms) : 0, 8649
Flare Poller [baseline] (3.542 ms) : 0, 3542
Flare Poller [candidate] (3.507 ms) : 0, 3507
IAST [baseline] (27.634 ms) : 0, 27634
IAST [candidate] (27.015 ms) : 0, 27015
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.072 s) : 0, 1071919
Total [baseline] (10.865 s) : 0, 10864799
Agent [candidate] (1.066 s) : 0, 1065841
Total [candidate] (10.976 s) : 0, 10976148
section appsec
Agent [baseline] (1.247 s) : 0, 1247146
Total [baseline] (11.049 s) : 0, 11048562
Agent [candidate] (1.246 s) : 0, 1246271
Total [candidate] (11.095 s) : 0, 11094565
section iast
Agent [baseline] (1.243 s) : 0, 1242891
Total [baseline] (11.231 s) : 0, 11230507
Agent [candidate] (1.243 s) : 0, 1243284
Total [candidate] (11.167 s) : 0, 11166988
section profiling
Agent [baseline] (1.192 s) : 0, 1192463
Total [baseline] (11.076 s) : 0, 11075888
Agent [candidate] (1.197 s) : 0, 1197375
Total [candidate] (10.953 s) : 0, 10953149
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.195 ms) : 0, 1195
crashtracking [candidate] (1.183 ms) : 0, 1183
BytebuddyAgent [baseline] (632.811 ms) : 0, 632811
BytebuddyAgent [candidate] (629.12 ms) : 0, 629120
AgentMeter [baseline] (29.094 ms) : 0, 29094
AgentMeter [candidate] (29.031 ms) : 0, 29031
GlobalTracer [baseline] (258.458 ms) : 0, 258458
GlobalTracer [candidate] (257.538 ms) : 0, 257538
AppSec [baseline] (33.24 ms) : 0, 33240
AppSec [candidate] (32.862 ms) : 0, 32862
Debugger [baseline] (62.6 ms) : 0, 62600
Debugger [candidate] (62.477 ms) : 0, 62477
Remote Config [baseline] (627.373 µs) : 0, 627
Remote Config [candidate] (645.5 µs) : 0, 646
Telemetry [baseline] (13.186 ms) : 0, 13186
Telemetry [candidate] (12.325 ms) : 0, 12325
Flare Poller [baseline] (5.338 ms) : 0, 5338
Flare Poller [candidate] (5.345 ms) : 0, 5345
section appsec
crashtracking [baseline] (1.192 ms) : 0, 1192
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (662.792 ms) : 0, 662792
BytebuddyAgent [candidate] (662.956 ms) : 0, 662956
AgentMeter [baseline] (12.006 ms) : 0, 12006
AgentMeter [candidate] (12.039 ms) : 0, 12039
GlobalTracer [baseline] (259.56 ms) : 0, 259560
GlobalTracer [candidate] (259.614 ms) : 0, 259614
IAST [baseline] (25.566 ms) : 0, 25566
IAST [candidate] (25.483 ms) : 0, 25483
AppSec [baseline] (168.731 ms) : 0, 168731
AppSec [candidate] (169.153 ms) : 0, 169153
Debugger [baseline] (67.667 ms) : 0, 67667
Debugger [candidate] (66.368 ms) : 0, 66368
Remote Config [baseline] (653.811 µs) : 0, 654
Remote Config [candidate] (681.501 µs) : 0, 682
Telemetry [baseline] (9.712 ms) : 0, 9712
Telemetry [candidate] (9.67 ms) : 0, 9670
Flare Poller [baseline] (3.823 ms) : 0, 3823
Flare Poller [candidate] (3.714 ms) : 0, 3714
section iast
crashtracking [baseline] (1.188 ms) : 0, 1188
crashtracking [candidate] (1.193 ms) : 0, 1193
BytebuddyAgent [baseline] (804.038 ms) : 0, 804038
BytebuddyAgent [candidate] (804.46 ms) : 0, 804460
AgentMeter [baseline] (11.553 ms) : 0, 11553
AgentMeter [candidate] (11.53 ms) : 0, 11530
GlobalTracer [baseline] (249.937 ms) : 0, 249937
GlobalTracer [candidate] (249.467 ms) : 0, 249467
IAST [baseline] (27.34 ms) : 0, 27340
IAST [candidate] (27.44 ms) : 0, 27440
AppSec [baseline] (34.251 ms) : 0, 34251
AppSec [candidate] (34.985 ms) : 0, 34985
Debugger [baseline] (66.733 ms) : 0, 66733
Debugger [candidate] (66.241 ms) : 0, 66241
Remote Config [baseline] (545.85 µs) : 0, 546
Remote Config [candidate] (535.709 µs) : 0, 536
Telemetry [baseline] (8.492 ms) : 0, 8492
Telemetry [candidate] (8.593 ms) : 0, 8593
Flare Poller [baseline] (3.401 ms) : 0, 3401
Flare Poller [candidate] (3.401 ms) : 0, 3401
section profiling
crashtracking [baseline] (1.217 ms) : 0, 1217
crashtracking [candidate] (1.22 ms) : 0, 1220
BytebuddyAgent [baseline] (682.168 ms) : 0, 682168
BytebuddyAgent [candidate] (686.726 ms) : 0, 686726
AgentMeter [baseline] (8.668 ms) : 0, 8668
AgentMeter [candidate] (8.71 ms) : 0, 8710
GlobalTracer [baseline] (216.455 ms) : 0, 216455
GlobalTracer [candidate] (216.709 ms) : 0, 216709
AppSec [baseline] (32.926 ms) : 0, 32926
AppSec [candidate] (33.091 ms) : 0, 33091
Debugger [baseline] (67.537 ms) : 0, 67537
Debugger [candidate] (68.194 ms) : 0, 68194
Remote Config [baseline] (637.82 µs) : 0, 638
Remote Config [candidate] (626.777 µs) : 0, 627
Telemetry [baseline] (9.025 ms) : 0, 9025
Telemetry [candidate] (9.006 ms) : 0, 9006
Flare Poller [baseline] (3.821 ms) : 0, 3821
Flare Poller [candidate] (3.77 ms) : 0, 3770
ProfilingAgent [baseline] (100.054 ms) : 0, 100054
ProfilingAgent [candidate] (99.47 ms) : 0, 99470
Profiling [baseline] (100.672 ms) : 0, 100672
Profiling [candidate] (100.04 ms) : 0, 100040
LoadParameters
See matching parameters
SummaryFound 4 performance improvements and 1 performance regressions! Performance is the same for 15 metrics, 16 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section baseline
no_agent (19.413 ms) : 19214, 19612
. : milestone, 19413,
appsec (19.047 ms) : 18854, 19241
. : milestone, 19047,
code_origins (17.639 ms) : 17466, 17812
. : milestone, 17639,
iast (18.56 ms) : 18373, 18747
. : milestone, 18560,
profiling (18.533 ms) : 18348, 18717
. : milestone, 18533,
tracing (17.449 ms) : 17274, 17624
. : milestone, 17449,
section candidate
no_agent (17.943 ms) : 17761, 18125
. : milestone, 17943,
appsec (18.585 ms) : 18399, 18772
. : milestone, 18585,
code_origins (17.766 ms) : 17589, 17944
. : milestone, 17766,
iast (17.679 ms) : 17503, 17854
. : milestone, 17679,
profiling (19.564 ms) : 19369, 19758
. : milestone, 19564,
tracing (17.88 ms) : 17700, 18059
. : milestone, 17880,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section baseline
no_agent (1.182 ms) : 1171, 1194
. : milestone, 1182,
iast (3.207 ms) : 3165, 3250
. : milestone, 3207,
iast_FULL (5.889 ms) : 5830, 5948
. : milestone, 5889,
iast_GLOBAL (3.604 ms) : 3537, 3670
. : milestone, 3604,
profiling (2.148 ms) : 2127, 2168
. : milestone, 2148,
tracing (1.816 ms) : 1800, 1831
. : milestone, 1816,
section candidate
no_agent (1.192 ms) : 1180, 1204
. : milestone, 1192,
iast (3.076 ms) : 3036, 3116
. : milestone, 3076,
iast_FULL (5.961 ms) : 5901, 6022
. : milestone, 5961,
iast_GLOBAL (3.519 ms) : 3463, 3574
. : milestone, 3519,
profiling (2.059 ms) : 2039, 2078
. : milestone, 2059,
tracing (1.857 ms) : 1841, 1873
. : milestone, 1857,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section baseline
no_agent (15.371 s) : 15371000, 15371000
. : milestone, 15371000,
appsec (14.819 s) : 14819000, 14819000
. : milestone, 14819000,
iast (18.129 s) : 18129000, 18129000
. : milestone, 18129000,
iast_GLOBAL (17.826 s) : 17826000, 17826000
. : milestone, 17826000,
profiling (14.915 s) : 14915000, 14915000
. : milestone, 14915000,
tracing (14.852 s) : 14852000, 14852000
. : milestone, 14852000,
section candidate
no_agent (15.082 s) : 15082000, 15082000
. : milestone, 15082000,
appsec (15.034 s) : 15034000, 15034000
. : milestone, 15034000,
iast (18.0 s) : 18000000, 18000000
. : milestone, 18000000,
iast_GLOBAL (17.947 s) : 17947000, 17947000
. : milestone, 17947000,
profiling (14.834 s) : 14834000, 14834000
. : milestone, 14834000,
tracing (14.746 s) : 14746000, 14746000
. : milestone, 14746000,
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~cbd6226824, baseline=1.60.0-SNAPSHOT~16f36474a2
dateFormat X
axisFormat %s
section baseline
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (3.76 ms) : 3540, 3979
. : milestone, 3760,
iast (2.237 ms) : 2168, 2306
. : milestone, 2237,
iast_GLOBAL (2.287 ms) : 2218, 2356
. : milestone, 2287,
profiling (2.09 ms) : 2033, 2146
. : milestone, 2090,
tracing (2.042 ms) : 1989, 2095
. : milestone, 2042,
section candidate
no_agent (1.468 ms) : 1457, 1480
. : milestone, 1468,
appsec (3.757 ms) : 3537, 3976
. : milestone, 3757,
iast (2.244 ms) : 2175, 2312
. : milestone, 2244,
iast_GLOBAL (2.288 ms) : 2219, 2357
. : milestone, 2288,
profiling (2.065 ms) : 2011, 2119
. : milestone, 2065,
tracing (2.051 ms) : 1998, 2105
. : milestone, 2051,
|
5cd257e to
cbd6226
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Motivation
Additional Notes
Contributor Checklist
type:and (comp:orinst:) labels in addition to any other useful labelsclose,fix, or any linking keywords when referencing an issueUse
solvesinstead, and assign the PR milestone to the issueJira ticket: [PROJ-IDENT]
Note: Once your PR is ready to merge, add it to the merge queue by commenting
/merge./merge -ccancels the queue request./merge -f --reason "reason"skips all merge queue checks; please use this judiciously, as some checks do not run at the PR-level. For more information, see this doc.