matthewgapp commented on issue #462: URL: https://github.com/apache/arrow-datafusion/issues/462#issuecomment-1728731208
@alamb Thanks for the pointer on those "characteristic metadata" methods. I ran across them late last night and it seemed to solve the blocking issue. But the optimizer still slides in RepartitionsExec and CoalesceExec's into the physical plan which slows things down by an order of magnitude (~30x). To that end, I've drafted a [follow-on PR](https://github.com/matthewgapp/arrow-datafusion/pull/2) that eliminates omits them (only) when they'd be descendants of a recursive query. Will work on getting this thing tested (might not be until this weekend). Lmk if any other comments/thoughts in meantime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
