wecharyu commented on PR #48468: URL: https://github.com/apache/arrow/pull/48468#issuecomment-3885720880
> but I think adjust chunk_size logic and add a new default row-group size logic is a bit hacking for a common used library. The first one would change the behavior and performance for write and the second would be a performance break change if the default rowgroup size isn't MAX (or disabled) @mapleFU Thanks for your concerns. For the first one, chunk_size needs to be adjusted since we add a new limit. For the second, the default row group size is followed some other implementations like parquet-java, I think it's OK since it can be replaced by configurations. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
