lidavidm commented on PR #870: URL: https://github.com/apache/arrow-adbc/pull/870#issuecomment-1622154532
I think Arrow C++ has recently started favoring smaller batch sizes, but on the other hand here I would guess that slightly larger sizes might amortize more of the conversion overhead? We can stick with 16 MB. An option would be good. We can add a canonical option if/once we see some consensus here. The other drivers that have a batch size option use row-based limits, though. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
