alamb commented on issue #11384: URL: https://github.com/apache/arrow-rs/issues/11384#issuecomment-6006414083
Hi @andygrove -- thank you -- it sounds reasonable Could you explicitly list on this ticket what you are trying to accomplish other than "do what the Java writer does" ? I suspect you are trying to make smaller files (or faster to read files, etc) but that is sort of lost with all the discussion of the details of under what circumstances what kinds of pages are written, etc I think the key design consideration for any change like this is "what are the tradeoffs" -- if there is some class of usecase that will get worse we should have some setting to get the old behavior back as a workaround for downstream users, and then we can figure out what to default the setting to -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
