pitrou commented on PR #48468: URL: https://github.com/apache/arrow/pull/48468#issuecomment-5128632383
> @pitrou we fully understand the reluctance to bake an estimate into the writer, we'd rather have one well-tested approximation in the library than N slightly different ones downstream. Would documenting max_row_group_bytes as explicitly best-effort, combined with keeping it opt-in, be enough to address your concern? I'm ok with it being best effort. What I'm concerned about is the estimate being too complicated and fragile to maintain. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
