jeffkbkim commented on PR #15970:
URL: https://github.com/apache/kafka/pull/15970#issuecomment-2113427888
TargetAssignmentBuilderBenchmark results (Baseline vs KAFKA-16626). The runs
with high consumer group member count is noticeably better now.
Baseline
```
Benchmark (memberCount)
(partitionsToMemberRatio) (topicCount) Mode Cnt Score Error Units
TargetAssignmentBuilderBenchmark.build 100
5 10 avgt 5 0.181 ± 0.025 ms/op
TargetAssignmentBuilderBenchmark.build 100
5 100 avgt 5 0.483 ± 0.042 ms/op
TargetAssignmentBuilderBenchmark.build 100
5 1000 avgt 5 3.693 ± 0.074 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 10 avgt 5 0.287 ± 0.010 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 100 avgt 5 0.634 ± 0.034 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 1000 avgt 5 4.573 ± 0.127 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 10 avgt 5 1.016 ± 0.063 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 100 avgt 5 1.960 ± 0.106 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 1000 avgt 5 6.669 ± 0.257 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 10 avgt 5 0.849 ± 0.083 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 100 avgt 5 2.209 ± 0.139 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 1000 avgt 5 22.515 ± 1.182 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 10 avgt 5 1.519 ± 0.181 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 100 avgt 5 3.038 ± 0.291 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 1000 avgt 5 23.761 ± 0.734 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 10 avgt 5 6.651 ± 0.785 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 100 avgt 5 16.168 ± 0.939 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 1000 avgt 5 39.315 ± 1.811 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 10 avgt 5 1.782 ± 0.193 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 100 avgt 5 4.886 ± 0.669 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 1000 avgt 5 37.605 ± 0.674 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 10 avgt 5 3.982 ± 0.534 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 100 avgt 5 7.444 ± 0.411 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 1000 avgt 5 46.231 ± 1.616 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 10 avgt 5 15.327 ± 1.394 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 100 avgt 5 29.014 ± 0.890 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 1000 avgt 5 76.194 ± 0.952 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 10 avgt 5 18.086 ± 2.724 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 100 avgt 5 31.667 ± 1.372 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 1000 avgt 5 208.516 ± 7.774 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 10 avgt 5 25.929 ± 1.926 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 100 avgt 5 43.845 ± 1.089 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 1000 avgt 5 248.228 ± 16.409 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 10 avgt 5 87.236 ± 7.133 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 100 avgt 5 150.507 ± 14.060 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 1000 avgt 5 325.549 ± 5.762 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 10 avgt 5 32.577 ± 2.574 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 100 avgt 5 65.163 ± 7.653 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 1000 avgt 5 401.885 ± 23.356 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 10 avgt 5 56.647 ± 4.140 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 100 avgt 5 88.750 ± 13.175 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 1000 avgt 5 484.745 ± 28.352 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 10 avgt 5 184.636 ± 13.637 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 100 avgt 5 308.914 ± 31.608 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 1000 avgt 5 738.403 ± 39.927 ms/op
```
KAFKA-16626
```
Benchmark (memberCount)
(partitionsToMemberRatio) (topicCount) Mode Cnt Score Error Units
TargetAssignmentBuilderBenchmark.build 100
5 10 avgt 5 0.078 ± 0.009 ms/op
TargetAssignmentBuilderBenchmark.build 100
5 100 avgt 5 0.105 ± 0.009 ms/op
TargetAssignmentBuilderBenchmark.build 100
5 1000 avgt 5 0.091 ± 0.023 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 10 avgt 5 0.123 ± 0.007 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 100 avgt 5 0.195 ± 0.465 ms/op
TargetAssignmentBuilderBenchmark.build 100
10 1000 avgt 5 0.255 ± 0.126 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 10 avgt 5 0.136 ± 0.018 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 100 avgt 5 0.548 ± 0.022 ms/op
TargetAssignmentBuilderBenchmark.build 100
50 1000 avgt 5 0.638 ± 0.055 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 10 avgt 5 0.458 ± 0.355 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 100 avgt 5 0.415 ± 0.013 ms/op
TargetAssignmentBuilderBenchmark.build 500
5 1000 avgt 5 0.459 ± 0.056 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 10 avgt 5 0.633 ± 0.060 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 100 avgt 5 0.657 ± 0.011 ms/op
TargetAssignmentBuilderBenchmark.build 500
10 1000 avgt 5 0.761 ± 0.014 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 10 avgt 5 0.657 ± 0.046 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 100 avgt 5 3.409 ± 0.255 ms/op
TargetAssignmentBuilderBenchmark.build 500
50 1000 avgt 5 4.212 ± 1.094 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 10 avgt 5 0.846 ± 0.044 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 100 avgt 5 0.874 ± 0.053 ms/op
TargetAssignmentBuilderBenchmark.build 1000
5 1000 avgt 5 1.078 ± 0.065 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 10 avgt 5 1.449 ± 0.179 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 100 avgt 5 1.403 ± 0.199 ms/op
TargetAssignmentBuilderBenchmark.build 1000
10 1000 avgt 5 1.976 ± 0.266 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 10 avgt 5 1.580 ± 0.224 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 100 avgt 5 7.959 ± 0.691 ms/op
TargetAssignmentBuilderBenchmark.build 1000
50 1000 avgt 5 7.869 ± 1.361 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 10 avgt 5 6.482 ± 0.153 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 100 avgt 5 6.230 ± 0.594 ms/op
TargetAssignmentBuilderBenchmark.build 5000
5 1000 avgt 5 7.176 ± 0.170 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 10 avgt 5 11.094 ± 0.606 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 100 avgt 5 10.858 ± 1.202 ms/op
TargetAssignmentBuilderBenchmark.build 5000
10 1000 avgt 5 10.733 ± 0.702 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 10 avgt 5 11.338 ± 0.698 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 100 avgt 5 41.590 ± 2.797 ms/op
TargetAssignmentBuilderBenchmark.build 5000
50 1000 avgt 5 38.990 ± 4.194 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 10 avgt 5 13.628 ± 0.649 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 100 avgt 5 13.889 ± 1.030 ms/op
TargetAssignmentBuilderBenchmark.build 10000
5 1000 avgt 5 13.512 ± 0.698 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 10 avgt 5 24.794 ± 2.460 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 100 avgt 5 27.380 ± 7.286 ms/op
TargetAssignmentBuilderBenchmark.build 10000
10 1000 avgt 5 25.246 ± 5.307 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 10 avgt 5 24.075 ± 0.236 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 100 avgt 5 88.173 ± 3.596 ms/op
TargetAssignmentBuilderBenchmark.build 10000
50 1000 avgt 5 96.332 ± 34.552 ms/op
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: jira-unsubscr...@kafka.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
