doki23 commented on issue #5635:
URL:
https://github.com/apache/arrow-datafusion/issues/5635#issuecomment-1483808708
> But I am curious about the batching format, why do the record batches look
like this?
It's because the 'target partitions' whose default value is determined by
core num.
Setting target partitions to 1 will make the final `batches` vector only
have 1 batch @BubbaJoe .
```rust
let mut session_cfg = SessionConfig::new();
session_cfg = session_cfg.with_target_partitions(1);
let ctx = SessionContext::with_config(session_cfg);
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
