wpleonardo commented on PR #1375:
URL: https://github.com/apache/orc/pull/1375#issuecomment-1761397725
> @wpleonardo still find no improvement if just select int64 type columns.
>
> Q: `select
reporttime,appid,uid,clientversioncode,sdkversioncode,starttimestamp,backgroundtotal,foregroundtotal,firstiframesize,firstiframedecodetime,extras,mclientip,mnc,mcc,vsipsuccess,msipsuccess,vsipfail,msipfail,mediaflag,videomutetype,owneruid
from file('lz4_new_bigolive_audience_stats_orc.orc') format Null;`
>
> without avx512:
>
> ```
> localhost:9001, queries: 20, QPS: 2.256, RPS: 2715210.217, MiB/s:
4092.049, result RPS: 0.000, result MiB/s: 0.000.
>
> 0.000% 0.421 sec.
> 10.000% 0.423 sec.
> 20.000% 0.425 sec.
> 30.000% 0.429 sec.
> 40.000% 0.433 sec.
> 50.000% 0.440 sec.
> 60.000% 0.440 sec.
> 70.000% 0.442 sec.
> 80.000% 0.443 sec.
> 90.000% 0.456 sec.
> 95.000% 0.457 sec.
> 99.000% 0.464 sec.
> 99.900% 0.464 sec.
> 99.990% 0.464 sec.
> ```
>
> with avx512
>
> ```
> localhost:9001, queries: 20, QPS: 2.216, RPS: 2665968.958, MiB/s:
4017.839, result RPS: 0.000, result MiB/s: 0.000.
>
> 0.000% 0.423 sec.
> 10.000% 0.429 sec.
> 20.000% 0.431 sec.
> 30.000% 0.434 sec.
> 40.000% 0.438 sec.
> 50.000% 0.442 sec.
> 60.000% 0.448 sec.
> 70.000% 0.451 sec.
> 80.000% 0.453 sec.
> 90.000% 0.469 sec.
> 95.000% 0.473 sec.
> 99.000% 0.482 sec.
> 99.900% 0.482 sec.
> 99.990% 0.482 sec.
> ```
Could you debug your program to check if ORC is using AVX512 bit-unpacking,
for example, to check if the function "BitUnpackAVX512::readLongs" is invoked
when you execute the query statement?
If you find ORC is using AVX512 bit-unpacking, then execute the command
"perf top" to check the proportion of AVX512 bit-unpacking function hotspots,
for example, function "vectorUnpack x".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
