[
https://issues.apache.org/jira/browse/ARROW-10240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17210516#comment-17210516
]
Andy Grove commented on ARROW-10240:
------------------------------------
Great idea [~jhorstmann] . Do you want me to take care of this or are you
planning on working on it? I could do this tonight.
> [Rust] [Datafusion] Optionally load tpch data into memory before running
> benchmark query
> ----------------------------------------------------------------------------------------
>
> Key: ARROW-10240
> URL: https://issues.apache.org/jira/browse/ARROW-10240
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Rust, Rust - DataFusion
> Reporter: Jörn Horstmann
> Priority: Minor
>
> The tpch benchmark runtime seems to be dominated by csv parsing code and it
> is really difficult to see any performance hotspots related to actual query
> execution in a flamegraph.
> With the date in memory and more iterations it should be easier to profile
> and find bottlenecks.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
