gabriellefu commented on PR #23588:
URL: https://github.com/apache/kafka/pull/23588#issuecomment-6093321182
after using tag tree and picker, the jhm results are as follow
# Run complete. Total time: 00:33:35
REMEMBER: The numbers below are just data. To gain reusable insights, you
need to follow up on
why the numbers are the way they are. Use profilers (see -prof, -lprof),
design factorial
experiments, perform baseline and negative tests that provide experimental
control, make sure
the benchmarking environment is safe on JVM/OS/HW level, ask for reviews
from the domain experts.
Do not assume the numbers tell you what you want them to tell.
NOTE: Current JVM experimentally supports Compiler Blackholes, and they are
in use. Please exercise
extra caution when trusting the results, look into the generated code to
check the benchmark still
works, and factor in a small probability of new VM bugs. Additionally, while
comparisons between
different JVMs are already problematic, the performance difference caused by
different Blackhole
modes can be very significant. Please make sure you use the consistent
Blackhole mode for comparisons.
Benchmark (assignmentType) (assignorType)
(memberCount) (membersPerProcess) (partitionCount)
(rackAwareTags) (reportedOffsets) (standbyReplicas) (subtopologyCount) Mode
Cnt Score Error Units
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
NONE NONE 1 100 avgt 5
4.191 ± 0.126 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
NONE NONE 2 100 avgt 5
4.997 ± 0.103 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_AND_ZONE NONE 1 100
avgt 5 6.070 ± 0.103 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_AND_ZONE NONE 2 100
avgt 5 8.396 ± 0.174 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_ZONE_AND_RACK NONE 1 100
avgt 5 6.906 ± 0.138 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_ZONE_AND_RACK NONE 2 100
avgt 5 10.377 ± 0.243 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_ZONE_AND_HOST NONE 1 100
avgt 5 6.811 ± 0.162 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
CLUSTER_ZONE_AND_HOST NONE 2 100
avgt 5 9.910 ± 0.163 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 1
100 avgt 5 9.078 ± 0.201 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 1 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 2
100 avgt 5 15.275 ± 0.404 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
NONE NONE 1 100 avgt 5
4.501 ± 0.053 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
NONE NONE 2 100 avgt 5
5.458 ± 0.081 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_AND_ZONE NONE 1 100
avgt 5 5.680 ± 0.088 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_AND_ZONE NONE 2 100
avgt 5 8.047 ± 0.112 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_ZONE_AND_RACK NONE 1 100
avgt 5 6.297 ± 0.084 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_ZONE_AND_RACK NONE 2 100
avgt 5 10.059 ± 0.181 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_ZONE_AND_HOST NONE 1 100
avgt 5 6.057 ± 0.211 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
CLUSTER_ZONE_AND_HOST NONE 2 100
avgt 5 9.245 ± 0.115 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 1
100 avgt 5 7.480 ± 0.141 ms/op
StreamsAssignorBenchmark.doAssignment FULL STICKY
1000 50 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 2
100 avgt 5 12.104 ± 0.225 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
NONE NONE 1 100 avgt 5
3.503 ± 0.104 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
NONE NONE 2 100 avgt 5
4.696 ± 0.098 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_AND_ZONE NONE 1 100
avgt 5 5.905 ± 0.129 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_AND_ZONE NONE 2 100
avgt 5 8.579 ± 0.171 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_ZONE_AND_RACK NONE 1 100
avgt 5 6.297 ± 0.167 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_ZONE_AND_RACK NONE 2 100
avgt 5 10.016 ± 0.254 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_ZONE_AND_HOST NONE 1 100
avgt 5 6.721 ± 0.221 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
CLUSTER_ZONE_AND_HOST NONE 2 100
avgt 5 10.187 ± 0.291 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 1
100 avgt 5 7.588 ± 0.259 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 1 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 2
100 avgt 5 12.199 ± 0.390 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
NONE NONE 1 100 avgt 5
3.317 ± 0.111 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
NONE NONE 2 100 avgt 5
4.548 ± 0.112 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_AND_ZONE NONE 1 100
avgt 5 4.999 ± 0.150 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_AND_ZONE NONE 2 100
avgt 5 8.150 ± 0.319 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_ZONE_AND_RACK NONE 1 100
avgt 5 5.625 ± 0.144 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_ZONE_AND_RACK NONE 2 100
avgt 5 9.864 ± 2.616 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_ZONE_AND_HOST NONE 1 100
avgt 5 5.387 ± 0.134 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
CLUSTER_ZONE_AND_HOST NONE 2 100
avgt 5 8.580 ± 0.123 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 1
100 avgt 5 6.448 ± 0.159 ms/op
StreamsAssignorBenchmark.doAssignment INCREMENTAL STICKY
1000 50 100
REGION_CLUSTER_ZONE_RACK_AND_HOST NONE 2
100 avgt 5 10.571 ± 0.238 ms/op
Benchmark result is saved to /Users/gabriella/Downloads/jmh-sticky-rack.txt
JMH benchmarks done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
