pitrou commented on issue #46971: URL: https://github.com/apache/arrow/issues/46971#issuecomment-3026858655
> I assume the decryption buffers are held onto by the column readers to avoid the cost of reallocating them for each page, but this should hopefully be pretty cheap if using an allocator other than the system allocator. Yeah, it seems keeping the buffers around is not a tremendous idea for memory consumption. I suppose this is fine for a Parquet file with a small number of columns, but definitely not hundreds or thousands. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
