mapleFU commented on issue #40845: URL: https://github.com/apache/arrow/issues/40845#issuecomment-2041431912
Experimental: I've test unpack16 here: https://github.com/apache/arrow/commit/8a535943b2a875331a7f2c0b79f2b1907ba4252a ``` ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 2465 ns 2466 ns 281572 bytes_per_second=6.11536G/s items_per_second=3.28316G/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 8089 ns 8087 ns 86160 bytes_per_second=1.86483G/s items_per_second=1001.17M/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1024 1107 ns 1107 ns 632608 bytes_per_second=13.6192G/s items_per_second=7.31173G/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 1990 ns 1982 ns 351679 bytes_per_second=7.60825G/s items_per_second=4.08465G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 2076 ns 2073 ns 337611 bytes_per_second=7.27283G/s items_per_second=3.90457G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 2040 ns 2039 ns 331507 bytes_per_second=7.39673G/s items_per_second=3.97109G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 6757 ns 6753 ns 101800 bytes_per_second=2.23295G/s items_per_second=1.19881G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 1464 ns 1465 ns 478498 bytes_per_second=10.2958G/s items_per_second=5.5275G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 1505 ns 1496 ns 479725 bytes_per_second=10.0798G/s items_per_second=5.41153G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1024 1611 ns 1547 ns 444939 bytes_per_second=9.75007G/s items_per_second=5.23453G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 1500 ns 1497 ns 451485 bytes_per_second=10.0736G/s items_per_second=5.40825G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 1858 ns 1848 ns 383159 bytes_per_second=8.1605G/s items_per_second=4.38114G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 1907 ns 1865 ns 380770 bytes_per_second=8.08728G/s items_per_second=4.34183G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 1826 ns 1824 ns 387361 bytes_per_second=8.26649G/s items_per_second=4.43804G/s ``` Before ( using unpack32): ```ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 2989 ns 2989 ns 234187 bytes_per_second=5.04491G/s items_per_second=2.70847G/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 8456 ns 8455 ns 83862 bytes_per_second=1.78358G/s items_per_second=957.552M/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1024 1128 ns 1124 ns 612445 bytes_per_second=13.4204G/s items_per_second=7.20505G/s ReadLevels_Rle/MaxLevel:1/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 2374 ns 2374 ns 284599 bytes_per_second=6.3533G/s items_per_second=3.4109G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 2349 ns 2351 ns 299245 bytes_per_second=6.4148G/s items_per_second=3.44392G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 2124 ns 2124 ns 326544 bytes_per_second=7.09917G/s items_per_second=3.81134G/s ReadLevels_Rle/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 7704 ns 7692 ns 92346 bytes_per_second=1.96045G/s items_per_second=1052.51M/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 1686 ns 1687 ns 396268 bytes_per_second=8.93824G/s items_per_second=4.79868G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 1759 ns 1757 ns 411404 bytes_per_second=8.58509G/s items_per_second=4.60908G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1024 1708 ns 1710 ns 404015 bytes_per_second=8.82047G/s items_per_second=4.73545G/s ReadLevels_BitPack/MaxLevel:1/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 1660 ns 1662 ns 413912 bytes_per_second=9.0731G/s items_per_second=4.87108G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:1 1907 ns 1882 ns 386860 bytes_per_second=8.01277G/s items_per_second=4.30182G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:2048/LevelRepeatCount:1 1752 ns 1752 ns 397436 bytes_per_second=8.60686G/s items_per_second=4.62077G/s ReadLevels_BitPack/MaxLevel:3/NumLevels:8096/BatchSize:1024/LevelRepeatCount:7 1804 ns 1804 ns 385000 bytes_per_second=8.36066G/s items_per_second=4.48859G/s ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
