alamb commented on issue #6412: URL: https://github.com/apache/arrow-rs/issues/6412#issuecomment-2377965791
> Based on this I have a relatively easy work-around, similar to how the DataFusion cli handles it. I'll close this case now, but if anyone wants to research why DataFusion filters out empty batches, and if that is necessary, it would be good to know. I suspect it was probably some optimization (e.g. sending empty record batches over the network is wasteful -- that is unless it is the *ONLY* record batch that would be sent) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
