tustvold commented on PR #2648: URL: https://github.com/apache/arrow-datafusion/pull/2648#issuecomment-1147192902
Thank you for writing this up, I've left some comments on the document. Some high-level thoughts: * datafusion-contrib is probably the right place to experiment with plan-level JIT. I suspect it will need to go through many iterations before it starts to yield discernible performance improvements, and I suspect it will otherwise likely get held up by the limited review capacity on this repo * My suggestion would be to first focus on simpler applications of JIT so that we can all get experience with how the various technologies interplay, before undertaking a more complex effort. Something like #2427 might be a good starting point. I'm sure @alamb would be more than happy to provide guidance should you want to take this on -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
