zeodtr commented on issue #7698: URL: https://github.com/apache/arrow-datafusion/issues/7698#issuecomment-1807557910
I've applied the precomputed qualified_name I've mentioned above and the btree draft by @oleggator to DataFusion 31.0.0, then ran valgrind with a simple SELECT many-columns query for a table that has 3617 columns. The following attachment is the resulting call graph in SVG format. Still `clone()`ing precomputed qualified_name takes about 47% of the total planning time (logical plan building + optimizing) while `field_with_qualified_name` now takes only a negligible percentage.  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
