pitrou commented on PR #37641:
URL: https://github.com/apache/arrow/pull/37641#issuecomment-1735564903
I improved and simplified the benchmark code. Here are the current results
here:
```
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:10
11142 ns 11140 ns 62716 bytes_per_second=175.236M/s
compression_ratio=0.700959 items_per_second=45.9596M/s
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:90
11904 ns 11902 ns 58803 bytes_per_second=172.829M/s
compression_ratio=0.765799 items_per_second=43.0166M/s
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:99
11796 ns 11794 ns 58970 bytes_per_second=169.732M/s
compression_ratio=0.759524 items_per_second=43.4132M/s
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:10
40895 ns 40885 ns 16988 bytes_per_second=186.932M/s
compression_ratio=0.695357 items_per_second=50.0914M/s
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:90
45275 ns 45266 ns 15099 bytes_per_second=172.528M/s
compression_ratio=0.753808 items_per_second=45.2437M/s
BM_DeltaEncodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:99
46609 ns 46598 ns 14949 bytes_per_second=168.19M/s
compression_ratio=0.762051 items_per_second=43.9504M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:10
14330 ns 14326 ns 48859 bytes_per_second=1085.98M/s
compression_ratio=0.933408 items_per_second=35.7382M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:90
14291 ns 14288 ns 49084 bytes_per_second=1104.8M/s
compression_ratio=1.19315 items_per_second=35.8346M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:99
14001 ns 13998 ns 49811 bytes_per_second=1100.33M/s
compression_ratio=1.21214 items_per_second=36.5759M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:10
46585 ns 46575 ns 14949 bytes_per_second=1.29997G/s
compression_ratio=0.930448 items_per_second=43.9721M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:90
60950 ns 60938 ns 11346 bytes_per_second=1028.95M/s
compression_ratio=1.18361 items_per_second=33.6078M/s
BM_DeltaEncodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:99
60273 ns 60260 ns 11491 bytes_per_second=1040.17M/s
compression_ratio=1.22369 items_per_second=33.9862M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:10
40006 ns 39997 ns 17513 bytes_per_second=5.95053G/s
compression_ratio=1.0309 items_per_second=12.8011M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:90
54380 ns 54368 ns 12895 bytes_per_second=4.32286G/s
compression_ratio=1.43071 items_per_second=9.41729M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:99
59008 ns 58992 ns 11894 bytes_per_second=4.28957G/s
compression_ratio=1.54352 items_per_second=8.67907M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:10
150360 ns 150330 ns 4295 bytes_per_second=6.41765G/s
compression_ratio=1.02877 items_per_second=13.6234M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:90
189980 ns 189936 ns 3689 bytes_per_second=5.15671G/s
compression_ratio=1.41325 items_per_second=10.7826M/s
BM_DeltaEncodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:99
203198 ns 203155 ns 3417 bytes_per_second=4.93974G/s
compression_ratio=1.50832 items_per_second=10.081M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:10
5270 ns 5270 ns 132014 bytes_per_second=370.447M/s
compression_ratio=0.700959 items_per_second=97.1578M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:90
5061 ns 5060 ns 126446 bytes_per_second=406.504M/s
compression_ratio=0.765799 items_per_second=101.178M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:512/prefixed-percent:99
5542 ns 5542 ns 126490 bytes_per_second=361.218M/s
compression_ratio=0.759524 items_per_second=92.3904M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:10
23027 ns 23024 ns 30212 bytes_per_second=331.951M/s
compression_ratio=0.695357 items_per_second=88.9516M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:90
22239 ns 22235 ns 31329 bytes_per_second=351.231M/s
compression_ratio=0.753808 items_per_second=92.1068M/s
BM_DeltaDecodingByteArray/max-string-length:8/batch-size:2048/prefixed-percent:99
22392 ns 22389 ns 31045 bytes_per_second=350.055M/s
compression_ratio=0.762051 items_per_second=91.4744M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:10
5040 ns 5040 ns 137874 bytes_per_second=3.01475G/s
compression_ratio=0.933408 items_per_second=101.592M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:90
5312 ns 5312 ns 133927 bytes_per_second=2.90216G/s
compression_ratio=1.19315 items_per_second=96.3918M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:512/prefixed-percent:99
5238 ns 5238 ns 131598 bytes_per_second=2.87179G/s
compression_ratio=1.21214 items_per_second=97.7513M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:10
20561 ns 20558 ns 33335 bytes_per_second=2.9452G/s
compression_ratio=0.930448 items_per_second=99.6227M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:90
23385 ns 23381 ns 28702 bytes_per_second=2.61889G/s
compression_ratio=1.18361 items_per_second=87.5921M/s
BM_DeltaDecodingByteArray/max-string-length:64/batch-size:2048/prefixed-percent:99
22930 ns 22925 ns 29705 bytes_per_second=2.67001G/s
compression_ratio=1.22369 items_per_second=89.333M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:10
8253 ns 8251 ns 85126 bytes_per_second=28.8434G/s
compression_ratio=1.0309 items_per_second=62.0494M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:90
9089 ns 9088 ns 76982 bytes_per_second=25.8625G/s
compression_ratio=1.43071 items_per_second=56.341M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:512/prefixed-percent:99
9418 ns 9416 ns 74093 bytes_per_second=26.874G/s
compression_ratio=1.54352 items_per_second=54.374M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:10
35156 ns 35151 ns 19918 bytes_per_second=27.4465G/s
compression_ratio=1.02877 items_per_second=58.2635M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:90
38266 ns 38257 ns 18211 bytes_per_second=25.6015G/s
compression_ratio=1.41325 items_per_second=53.532M/s
BM_DeltaDecodingByteArray/max-string-length:1024/batch-size:2048/prefixed-percent:99
38955 ns 38948 ns 17954 bytes_per_second=25.7662G/s
compression_ratio=1.50832 items_per_second=52.5835M/s
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
