ZhangHuiGui commented on PR #41036: URL: https://github.com/apache/arrow/pull/41036#issuecomment-2048721547
> One minor nit is that I prefer bytes processed over items processed (it is more comparable and I don't have to worry about knowing as many details of the benchmark) but I won't force that. As [pitrou](https://github.com/pitrou) said, bytes is actually not accurate in this benchmark because we have a varlength type, which may make the bytes/s indicator very high, but it is not as intuitive as items/s. The results are like below: ```shell GrouperWithMultiTypes/"{int32, int32}"/4096/10000 6523 us 6522 us 108 items_per_second=628.047k/s null_percent=0.01 size=4.096k GrouperWithMultiTypes/"{int32, int32}"/4096/100 8122 us 8120 us 86 items_per_second=504.427k/s null_percent=1 size=4.096k GrouperWithMultiTypes/"{int32, int32}"/4096/10 8473 us 8472 us 83 items_per_second=483.476k/s null_percent=10 size=4.096k GrouperWithMultiTypes/"{int32, int32}"/4096/2 9209 us 9207 us 76 items_per_second=444.856k/s null_percent=50 size=4.096k GrouperWithMultiTypes/"{int32, int32}"/4096/1 9863 us 9861 us 70 items_per_second=415.358k/s null_percent=100 size=4.096k GrouperWithMultiTypes/"{int32, int32}"/4096/0 6532 us 6531 us 107 items_per_second=627.155k/s null_percent=0 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/1024/10000 1628 us 1628 us 431 items_per_second=629.181k/s null_percent=0.01 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/1024/100 12616 us 12614 us 55 items_per_second=81.1817k/s null_percent=1 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/1024/10 89235 us 89216 us 8 items_per_second=11.4778k/s null_percent=10 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/1024/2 279436 us 279381 us 2 items_per_second=3.66524k/s null_percent=50 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/1024/1 2474 us 2473 us 283 items_per_second=413.992k/s null_percent=100 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/1024/0 1627 us 1627 us 429 items_per_second=629.503k/s null_percent=0 size=1.024k GrouperWithMultiTypes/"{int32, int64}"/4096/10000 6484 us 6483 us 107 items_per_second=631.833k/s null_percent=0.01 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/4096/100 49194 us 49186 us 14 items_per_second=83.2752k/s null_percent=1 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/4096/10 414187 us 414110 us 2 items_per_second=9.89109k/s null_percent=10 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/4096/2 1350538 us 1350126 us 1 items_per_second=3.03379k/s null_percent=50 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/4096/1 9590 us 9588 us 73 items_per_second=427.195k/s null_percent=100 size=4.096k GrouperWithMultiTypes/"{int32, int64}"/4096/0 6475 us 6474 us 108 items_per_second=632.68k/s null_percent=0 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/10000 3679 us 3678 us 190 items_per_second=278.42k/s null_percent=0.01 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/100 17617 us 17614 us 40 items_per_second=58.1361k/s null_percent=1 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/10 191058 us 191017 us 4 items_per_second=5.36077k/s null_percent=10 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/2 718916 us 718763 us 1 items_per_second=1.42467k/s null_percent=50 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/1 5451 us 5450 us 129 items_per_second=187.874k/s null_percent=100 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/1024/0 3675 us 3675 us 190 items_per_second=278.664k/s null_percent=0 size=1.024k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/10000 17341 us 17338 us 41 items_per_second=236.242k/s null_percent=0.01 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/100 100409 us 100389 us 7 items_per_second=40.8013k/s null_percent=1 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/10 921094 us 920851 us 1 items_per_second=4.44806k/s null_percent=10 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/2 3632795 us 3631833 us 1 items_per_second=1.12781k/s null_percent=50 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/1 21414 us 21411 us 33 items_per_second=191.299k/s null_percent=100 size=4.096k GrouperWithMultiTypes/"{boolean, int64, utf8}"/4096/0 14967 us 14965 us 46 items_per_second=273.711k/s null_percent=0 size=4.096k GrouperWithMultiTypes/"{int32, boolean, utf8}"/1024/10000 3724 us 3724 us 188 items_per_second=275.008k/s null_percent=0.01 size=1.024k GrouperWithMultiTypes/"{int32, boolean, utf8}"/1024/100 13209 us 13207 us 53 items_per_second=77.5372k/s null_percent=1 size=1.024k GrouperWithMultiTypes/"{int32, boolean, utf8}"/1024/10 140985 us 140961 us 5 items_per_second=7.26443k/s null_percent=10 size=1.024k GrouperWithMultiTypes/"{int32, boolean, utf8}"/1024/2 500871 us 500788 us 2 items_per_second=2.04478k/s null_percent=50 size=1.024k GrouperWithMultiTypes/"{int32, boolean, utf8}"/1024/1 5491 us 5490 us 128 items_per_second=186.517k/s null_percent=100 size=1.024 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
