Reproducer for Virtual Thread issues#10698
Draft
AlexeyKuznetsov-DD wants to merge 1 commit intomasterfrom
Draft
Conversation
BenchmarksStartupParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 12 unstable metrics.
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.091 s) : 0, 1090983
Total [baseline] (11.184 s) : 0, 11183566
Agent [candidate] (1.09 s) : 0, 1089907
Total [candidate] (11.337 s) : 0, 11337224
section appsec
Agent [baseline] (1.274 s) : 0, 1274229
Total [baseline] (11.291 s) : 0, 11291337
Agent [candidate] (1.272 s) : 0, 1271779
Total [candidate] (11.302 s) : 0, 11302246
section iast
Agent [baseline] (1.268 s) : 0, 1268086
Total [baseline] (11.317 s) : 0, 11316775
Agent [candidate] (1.262 s) : 0, 1261590
Total [candidate] (11.426 s) : 0, 11426355
section profiling
Agent [baseline] (1.227 s) : 0, 1227157
Total [baseline] (11.395 s) : 0, 11394773
Agent [candidate] (1.215 s) : 0, 1214647
Total [candidate] (11.114 s) : 0, 11114059
gantt
title petclinic - break down per module: candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.246 ms) : 0, 1246
crashtracking [candidate] (1.234 ms) : 0, 1234
BytebuddyAgent [baseline] (642.528 ms) : 0, 642528
BytebuddyAgent [candidate] (641.144 ms) : 0, 641144
AgentMeter [baseline] (29.681 ms) : 0, 29681
AgentMeter [candidate] (29.68 ms) : 0, 29680
GlobalTracer [baseline] (264.67 ms) : 0, 264670
GlobalTracer [candidate] (264.516 ms) : 0, 264516
AppSec [baseline] (33.667 ms) : 0, 33667
AppSec [candidate] (33.635 ms) : 0, 33635
Debugger [baseline] (65.05 ms) : 0, 65050
Debugger [candidate] (64.866 ms) : 0, 64866
Remote Config [baseline] (661.794 µs) : 0, 662
Remote Config [candidate] (645.252 µs) : 0, 645
Telemetry [baseline] (9.483 ms) : 0, 9483
Telemetry [candidate] (10.378 ms) : 0, 10378
Flare Poller [baseline] (7.326 ms) : 0, 7326
Flare Poller [candidate] (7.279 ms) : 0, 7279
section appsec
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.258 ms) : 0, 1258
BytebuddyAgent [baseline] (673.829 ms) : 0, 673829
BytebuddyAgent [candidate] (674.565 ms) : 0, 674565
AgentMeter [baseline] (12.331 ms) : 0, 12331
AgentMeter [candidate] (12.317 ms) : 0, 12317
GlobalTracer [baseline] (266.861 ms) : 0, 266861
GlobalTracer [candidate] (265.354 ms) : 0, 265354
IAST [baseline] (26.579 ms) : 0, 26579
IAST [candidate] (26.305 ms) : 0, 26305
AppSec [baseline] (173.277 ms) : 0, 173277
AppSec [candidate] (172.228 ms) : 0, 172228
Debugger [baseline] (69.503 ms) : 0, 69503
Debugger [candidate] (68.932 ms) : 0, 68932
Remote Config [baseline] (671.144 µs) : 0, 671
Remote Config [candidate] (700.146 µs) : 0, 700
Telemetry [baseline] (9.867 ms) : 0, 9867
Telemetry [candidate] (9.867 ms) : 0, 9867
Flare Poller [baseline] (3.76 ms) : 0, 3760
Flare Poller [candidate] (3.774 ms) : 0, 3774
section iast
crashtracking [baseline] (1.239 ms) : 0, 1239
crashtracking [candidate] (1.227 ms) : 0, 1227
BytebuddyAgent [baseline] (817.045 ms) : 0, 817045
BytebuddyAgent [candidate] (811.519 ms) : 0, 811519
AgentMeter [baseline] (11.669 ms) : 0, 11669
AgentMeter [candidate] (11.596 ms) : 0, 11596
GlobalTracer [baseline] (256.476 ms) : 0, 256476
GlobalTracer [candidate] (255.929 ms) : 0, 255929
IAST [baseline] (28.254 ms) : 0, 28254
IAST [candidate] (28.207 ms) : 0, 28207
AppSec [baseline] (36.259 ms) : 0, 36259
AppSec [candidate] (35.439 ms) : 0, 35439
Debugger [baseline] (67.682 ms) : 0, 67682
Debugger [candidate] (68.127 ms) : 0, 68127
Remote Config [baseline] (574.956 µs) : 0, 575
Remote Config [candidate] (559.717 µs) : 0, 560
Telemetry [baseline] (8.889 ms) : 0, 8889
Telemetry [candidate] (9.001 ms) : 0, 9001
Flare Poller [baseline] (3.561 ms) : 0, 3561
Flare Poller [candidate] (3.608 ms) : 0, 3608
section profiling
crashtracking [baseline] (1.223 ms) : 0, 1223
crashtracking [candidate] (1.248 ms) : 0, 1248
BytebuddyAgent [baseline] (699.702 ms) : 0, 699702
BytebuddyAgent [candidate] (695.15 ms) : 0, 695150
AgentMeter [baseline] (8.905 ms) : 0, 8905
AgentMeter [candidate] (8.809 ms) : 0, 8809
GlobalTracer [baseline] (225.713 ms) : 0, 225713
GlobalTracer [candidate] (222.657 ms) : 0, 222657
AppSec [baseline] (34.341 ms) : 0, 34341
AppSec [candidate] (33.63 ms) : 0, 33630
Debugger [baseline] (70.137 ms) : 0, 70137
Debugger [candidate] (69.768 ms) : 0, 69768
Remote Config [baseline] (671.7 µs) : 0, 672
Remote Config [candidate] (663.273 µs) : 0, 663
Telemetry [baseline] (9.364 ms) : 0, 9364
Telemetry [candidate] (9.181 ms) : 0, 9181
Flare Poller [baseline] (4.016 ms) : 0, 4016
Flare Poller [candidate] (3.745 ms) : 0, 3745
ProfilingAgent [baseline] (101.549 ms) : 0, 101549
ProfilingAgent [candidate] (98.496 ms) : 0, 98496
Profiling [baseline] (102.17 ms) : 0, 102170
Profiling [candidate] (99.081 ms) : 0, 99081
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.101 s) : 0, 1101172
Total [baseline] (9.345 s) : 0, 9344791
Agent [candidate] (1.086 s) : 0, 1086433
Total [candidate] (9.286 s) : 0, 9286267
section iast
Agent [baseline] (1.263 s) : 0, 1263474
Total [baseline] (9.954 s) : 0, 9954381
Agent [candidate] (1.259 s) : 0, 1259015
Total [candidate] (9.939 s) : 0, 9938534
gantt
title insecure-bank - break down per module: candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.26 ms) : 0, 1260
crashtracking [candidate] (1.244 ms) : 0, 1244
BytebuddyAgent [baseline] (647.337 ms) : 0, 647337
BytebuddyAgent [candidate] (638.845 ms) : 0, 638845
AgentMeter [baseline] (29.991 ms) : 0, 29991
AgentMeter [candidate] (29.582 ms) : 0, 29582
GlobalTracer [baseline] (267.132 ms) : 0, 267132
GlobalTracer [candidate] (264.298 ms) : 0, 264298
AppSec [baseline] (34.239 ms) : 0, 34239
AppSec [candidate] (33.574 ms) : 0, 33574
Debugger [baseline] (64.043 ms) : 0, 64043
Debugger [candidate] (66.22 ms) : 0, 66220
Remote Config [baseline] (665.14 µs) : 0, 665
Remote Config [candidate] (648.162 µs) : 0, 648
Telemetry [baseline] (14.041 ms) : 0, 14041
Telemetry [candidate] (10.144 ms) : 0, 10144
Flare Poller [baseline] (5.618 ms) : 0, 5618
Flare Poller [candidate] (5.438 ms) : 0, 5438
section iast
crashtracking [baseline] (1.236 ms) : 0, 1236
crashtracking [candidate] (1.244 ms) : 0, 1244
BytebuddyAgent [baseline] (814.783 ms) : 0, 814783
BytebuddyAgent [candidate] (810.382 ms) : 0, 810382
AgentMeter [baseline] (11.595 ms) : 0, 11595
AgentMeter [candidate] (11.558 ms) : 0, 11558
GlobalTracer [baseline] (255.237 ms) : 0, 255237
GlobalTracer [candidate] (254.838 ms) : 0, 254838
IAST [baseline] (27.932 ms) : 0, 27932
IAST [candidate] (28.211 ms) : 0, 28211
AppSec [baseline] (33.677 ms) : 0, 33677
AppSec [candidate] (35.722 ms) : 0, 35722
Debugger [baseline] (69.261 ms) : 0, 69261
Debugger [candidate] (67.726 ms) : 0, 67726
Remote Config [baseline] (574.866 µs) : 0, 575
Remote Config [candidate] (570.744 µs) : 0, 571
Telemetry [baseline] (8.931 ms) : 0, 8931
Telemetry [candidate] (8.888 ms) : 0, 8888
Flare Poller [baseline] (3.575 ms) : 0, 3575
Flare Poller [candidate] (3.544 ms) : 0, 3544
LoadParameters
See matching parameters
SummaryFound 0 performance improvements and 3 performance regressions! Performance is the same for 18 metrics, 15 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section baseline
no_agent (17.697 ms) : 17521, 17874
. : milestone, 17697,
appsec (18.609 ms) : 18418, 18799
. : milestone, 18609,
code_origins (17.697 ms) : 17522, 17872
. : milestone, 17697,
iast (17.439 ms) : 17266, 17612
. : milestone, 17439,
profiling (18.456 ms) : 18273, 18639
. : milestone, 18456,
tracing (17.89 ms) : 17716, 18065
. : milestone, 17890,
section candidate
no_agent (18.987 ms) : 18793, 19182
. : milestone, 18987,
appsec (18.069 ms) : 17887, 18252
. : milestone, 18069,
code_origins (18.655 ms) : 18466, 18844
. : milestone, 18655,
iast (17.574 ms) : 17396, 17752
. : milestone, 17574,
profiling (18.838 ms) : 18648, 19027
. : milestone, 18838,
tracing (17.764 ms) : 17586, 17941
. : milestone, 17764,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section baseline
no_agent (1.201 ms) : 1189, 1213
. : milestone, 1201,
iast (3.147 ms) : 3104, 3189
. : milestone, 3147,
iast_FULL (5.559 ms) : 5504, 5614
. : milestone, 5559,
iast_GLOBAL (3.784 ms) : 3720, 3848
. : milestone, 3784,
profiling (2.086 ms) : 2067, 2105
. : milestone, 2086,
tracing (1.77 ms) : 1755, 1785
. : milestone, 1770,
section candidate
no_agent (1.2 ms) : 1187, 1212
. : milestone, 1200,
iast (3.172 ms) : 3127, 3218
. : milestone, 3172,
iast_FULL (5.695 ms) : 5638, 5752
. : milestone, 5695,
iast_GLOBAL (3.665 ms) : 3603, 3728
. : milestone, 3665,
profiling (2.115 ms) : 2096, 2134
. : milestone, 2115,
tracing (1.782 ms) : 1767, 1796
. : milestone, 1782,
DacapoParameters
See matching parameters
SummaryFound 1 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 1 unstable metrics.
Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section baseline
no_agent (1.471 ms) : 1459, 1483
. : milestone, 1471,
appsec (3.793 ms) : 3572, 4014
. : milestone, 3793,
iast (2.248 ms) : 2179, 2317
. : milestone, 2248,
iast_GLOBAL (2.282 ms) : 2213, 2351
. : milestone, 2282,
profiling (2.067 ms) : 2013, 2121
. : milestone, 2067,
tracing (2.053 ms) : 2000, 2107
. : milestone, 2053,
section candidate
no_agent (1.468 ms) : 1456, 1479
. : milestone, 1468,
appsec (2.504 ms) : 2450, 2558
. : milestone, 2504,
iast (2.246 ms) : 2177, 2314
. : milestone, 2246,
iast_GLOBAL (2.287 ms) : 2218, 2357
. : milestone, 2287,
profiling (2.501 ms) : 2335, 2666
. : milestone, 2501,
tracing (2.061 ms) : 2007, 2114
. : milestone, 2061,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.60.0-SNAPSHOT~fe5b6e5a4c, baseline=1.60.0-SNAPSHOT~1185d745d0
dateFormat X
axisFormat %s
section baseline
no_agent (15.685 s) : 15685000, 15685000
. : milestone, 15685000,
appsec (14.951 s) : 14951000, 14951000
. : milestone, 14951000,
iast (18.094 s) : 18094000, 18094000
. : milestone, 18094000,
iast_GLOBAL (17.733 s) : 17733000, 17733000
. : milestone, 17733000,
profiling (15.087 s) : 15087000, 15087000
. : milestone, 15087000,
tracing (14.495 s) : 14495000, 14495000
. : milestone, 14495000,
section candidate
no_agent (15.374 s) : 15374000, 15374000
. : milestone, 15374000,
appsec (14.931 s) : 14931000, 14931000
. : milestone, 14931000,
iast (18.123 s) : 18123000, 18123000
. : milestone, 18123000,
iast_GLOBAL (17.968 s) : 17968000, 17968000
. : milestone, 17968000,
profiling (14.906 s) : 14906000, 14906000
. : milestone, 14906000,
tracing (14.529 s) : 14529000, 14529000
. : milestone, 14529000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
Reproducer for Virtual Thread issues
Motivation
Debug why test failed on CI
Additional Notes
Do not merge