liurenjie1024 commented on issue #2633: URL: https://github.com/apache/arrow-datafusion/issues/2633#issuecomment-1140231370
> I looked at https://github.com/liurenjie1024/rust-opt-framework for bit today -- it looks very neat and a good example of a more general purpose optimization framework. > > > > I would personally be very interested in seeing an Proof Of Concept of this framework connected into DataFusion (aka instead of the existing hard coded ordering https://github.com/apache/arrow-datafusion/blob/894be6719373be85fa777028fe3ec534536660e3/datafusion/core/src/execution/context.rs#L1259-L1278) > > > > In terms of features I think are valuable for DataFusion are: > > 1. Easy to understand default behavior that is robust (in the sense it doesn't degrade horribly without statistics, etc) > > 2. Customizable: some way to allow users of DataFusion to mix/match / mashup the existing optimizer passes and their own to tailor DataFusion to their own use > > > > There are probably more things I haven't thought of yet Good suggestion, I will write a poc to integrate with datafusion. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
