eric-maynard opened a new pull request, #433: URL: https://github.com/apache/polaris/pull/433
# Description This adds a new flag, `METADATA_CACHING_ENABLED`, that allows the catalog to store table metadata in the metastore and vend it from there when loadTable is called. Entries are cached based on the metadata location. Currently, the cache is implemented as a "lazy" cache where entries are only loaded into the cache when `loadTable` is called Features not included in this PR: * Support for updating the cache when a table is updated * Support for invalidating cache entries in the background, rather than waiting for loadTable to be called * Structured storage for table metadata ## Type of change Please delete options that are not relevant. - [ ] Bug fix (non-breaking change which fixes an issue) - [ ] Documentation update - [x] New feature (non-breaking change which adds functionality) - [ ] Breaking change (fix or feature that would cause existing functionality to not work as expected) - [ ] This change requires a documentation update # How Has This Been Tested? Existing tests vend table metadata correctly when caching is enabled. Added a new suite `MetadataCachingTest` to cover various scenarios related to caching _TODO:_ Manual eclipselink testing to make sure very large metadata.json files don't break anything -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
