milenkovicm opened a new issue, #1098:
URL: https://github.com/apache/datafusion-ballista/issues/1098
**Is your feature request related to a problem or challenge? Please describe
what you are trying to do.**
On the road to library transition I would like to expose more configuration
(DataFusion specific) which user can tune. This would enable us to remove hard
coded object stores, codecs, configuration extension, functions ...
**Describe the solution you'd like**
I would like to expose additional method in `executor/src/standalone.rs`:
```rust
pub async fn new_standalone_executor_from_state<
T: 'static + AsLogicalPlan,
U: 'static + AsExecutionPlan,
>(
scheduler: SchedulerGrpcClient<Channel>,
concurrent_tasks: usize,
session_state: &SessionState,
) -> Result<()> {
```
And optional parameter in `executor/src/executor_process.rs`:
```rust
pub struct ExecutorProcessConfig {
...
/// SessionState which will be used to configure executor
/// if not provided system will configure itself from
/// sensible defaults
pub session_state: Option<SessionState>,
}
```
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features
you've considered.
**Additional context**
- Follow up commit would remove `with_object_store_registry` and
`BallistaObjectStoreRegistry` giving user ability to plug their own and
removing chunk of code from maintenance.
- Config extension would be possible
depends on #1096
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
