yahoNanJing commented on issue #2502: URL: https://github.com/apache/arrow-datafusion/issues/2502#issuecomment-1128350711
Hi @andygrove, sorry for late response. I'm not opposed to move Ballista to a new repo. However, I still have some concerns. 1. How to manage some features which needs changes in both datafusion and ballista, like configuration refactoring? 2. For some features, like Morsel-driven parallel execution, it leverages the **partition** for morsel splitting. However, the **partition** is also used for task splitting in Ballista. The same concept may have conflicts between datafusion and ballista, if ballista is moved out and new features are introduced to datafusion. How should we avoid that? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
