tustvold commented on issue #5450: URL: https://github.com/apache/arrow-rs/issues/5450#issuecomment-1974016289
I agree it is potentially confusing, but I think the solution is to better document what buffer size is, and potentially add separate functionality to ArrowWriter / AsyncArrowWriter to constrain row group size. I am reticent to change this definition as the API breakage would be subtle and not immediately obvious, beyond larger files and worse query performance -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
