simonvandel commented on issue #6710: URL: https://github.com/apache/arrow-datafusion/issues/6710#issuecomment-1596004358
I may be confused by the ORDER BY on the ProjectionExec. The query is a reduced case of a bigger query where the data source is marked already sorted. But in that bigger query, I could see profiling stacks related to sorting, which is unexpected. I'll see if I make a small reproduction with a flamegraph. In any case, would it be unreasonable to remove the ORDER BY in the query plan if there is in fact no sorting going on? I think that would fit with the same model that a SortExec is also removed from a plan if data is already sorted. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
