mapleFU commented on issue #38245: URL: https://github.com/apache/arrow/issues/38245#issuecomment-1766857566
Also the footer would be extremely large and decode the footer will also be cost, so I think we can disable statistics for wide table like this. And when compression enabled, a ColumnReader will have a decompression buffer. Maybe we can try to profile the memory usage here. Though I think it's expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
