camuel commented on issue #18411: URL: https://github.com/apache/datafusion/issues/18411#issuecomment-3475260492
somehow on my amd64 desktop duckdb is similar but DataFusion is much worse. See below: ``` cam@cam-System-Product-Name:~/Embucket/repos/datafusion$ time datafusion-cli -c "select l_returnflag,l_linestatus, count(*) as count_order from 'sf1000/lineitem/lineitem*.parquet' group by l_returnflag, l_linestatus;" DataFusion CLI v50.0.0 +--------------+--------------+-------------+ | l_returnflag | l_linestatus | count_order | +--------------+--------------+-------------+ | R | F | 1480675200 | | N | O | 2999975927 | | A | F | 1480681438 | | N | F | 38657144 | +--------------+--------------+-------------+ 4 row(s) fetched. Elapsed 20.319 seconds. real 0m20.379s user 3m46.062s sys 0m1.353s ``` <img width="1623" height="290" alt="Image" src="https://github.com/user-attachments/assets/de198800-dc6c-48a8-9317-176ef71f70d6"; /> given it is a higher percentage of a longer time, just that memcpy takes more then twice longer on my machine than on Andrew's when DuckDB somehow is roughly the same. So perhaps I have another amd64 related issue on my machine on top of the mentioned above inefficiency -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
