DDtKey commented on issue #5450: URL: https://github.com/apache/arrow-rs/issues/5450#issuecomment-1973782360
> Something is wrong here, it should only consume up to 10Mb, perhaps you could use a memory profiler to identify where the usage is coming from Well, it definitely was an `ArrowWriter`. Once I decreased max row group usage became normal - but still it caches up to row number limit ignoring memory limit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
