thinkharderdev commented on issue #1862: URL: https://github.com/apache/arrow-datafusion/issues/1862#issuecomment-1044333494
I think we need a way to allow the registration of custom optimizers, udfs, etc at startup. Part of the rationale for https://github.com/apache/arrow-datafusion/pull/1677 was to create a global `ExecutionContext` at startup that could serve as a hook to register extension object stores, planners, optimizers and udf/udaf (i.e. that we can use all the extensible features of DataFusion with Ballista). Maybe we can still create the scheduler with an `ExecutionContext`\`SessionContext` and call it `session_template` or something like that. Then new sessions are cloned from that template (with any session-specific settings applied)? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
