pitrou commented on PR #13442: URL: https://github.com/apache/arrow/pull/13442#issuecomment-1171233258
Well, there's no reason that 16MB is a "nice" value; it happens to work in your case and may not work in another case. > I don't think we're going to address this in general without implementing JSON reading for which block size is not a user-facing concern. Right, so it doesn't make sense to change the default just to accomodate a particular use case without addressing the others, especially as the performance impact hasn't been researched. I recommend closing this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
