pitrou commented on pull request #10485: URL: https://github.com/apache/arrow/pull/10485#issuecomment-857953433
Also, the problem with making the block size smaller is that you will get tiny columns in many cases. The current value is probably a lower bound for efficiency, but files with dozens or hundreds of columns may want a larger block size. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
