lxy-9602 commented on PR #314: URL: https://github.com/apache/paimon-cpp/pull/314#issuecomment-5695337176
In our use cases, files may contain thousands of columns, and the current offset index cache could consume a significant amount of memory. Could you please validate the performance benefit of this optimization, and whether the issue could instead be mitigated by adding caching within the filesystem layer? If not, please at least add a switch and keep it disabled by default. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
