jorisvandenbossche commented on issue #34374: URL: https://github.com/apache/arrow/issues/34374#issuecomment-1449926603
> I don't see how this could have been caused by #34281, but certainly something we should fix as well. Ah, no it was caused by the PR, because it changed `DEFAULT_MAX_ROW_GROUP_LENGTH`, which doesn't set the _default_ `chunksize`, but actually caps the max chunk (row group) size regardless of the user-specified `chunk_size`. It seems this constant is used both for setting this max upper cap, and as the default values for `chunk_size` in `WriteTable`. I assume we will have to distinguish those two meanings? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
