Re: [C++] Purpose of C++ bundled dependencies

2022-08-09 Thread Will Jones
Thank you all for your input. It sounds like we are *not* expanding the features of the bundled dependency system, but instead are focused on better support on major packaging systems. I will close ARROW-17295 [1]. [1] https://issues.apache.org/jira/browse/ARROW-17295 On Sun, Aug 7, 2022 at 7:26

Parquet reader memory usage

2022-08-09 Thread Will Jones
I did some experiments to try to understand what controls a user has to constrain how much memory our Parquet readers use, at least as measured by the memory pools max_memory() method. I was surprised to find that parquet::ArrowReaderProperties.batch_size didn't have much of an effect at all on th