Thank you all for your input. It sounds like we are *not* expanding the
features of the bundled dependency system,
but instead are focused on better support on major packaging systems. I
will close ARROW-17295 [1].
[1] https://issues.apache.org/jira/browse/ARROW-17295
On Sun, Aug 7, 2022 at 7:26
I did some experiments to try to understand what controls a user has to
constrain how much memory our Parquet readers use, at least as measured by
the memory pools max_memory() method.
I was surprised to find that parquet::ArrowReaderProperties.batch_size
didn't have much of an effect at all on th