alamb commented on issue #18405: URL: https://github.com/apache/datafusion/issues/18405#issuecomment-3482752945
I think we need to balance tradeoffs here between: 1. Something that is relatively simple to maintain and explain "out of the box" (and configure, etc) 2. More advanced usecases So while I agree with you that the default implementation of the metadata cache is tightly coupled with the eviction strategy, I think it is possible to plug in any arbitrary cache implementation (including eviction strategy) using the trait So I wonder, @abhita. have you considered providing your own complete cache manager (perhaps based on `DefaultFilesMetadataCache`) for your usecase? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
