JingsongLi opened a new pull request, #600: URL: https://github.com/apache/paimon-rust/pull/600
## What changed - add catalog-level `local-cache.enabled`, `local-cache.dir`, `local-cache.max-size`, `local-cache.block-size`, and `local-cache.whitelist` options - add a persistent, block-based local disk cache with CRC validation, LRU eviction, startup recovery, per-block single-flight loading, and catalog namespace isolation - integrate the shared cache with filesystem and REST catalogs, including token-backed `FileIO` - invalidate cached blocks after successful writes, deletes, copies, and file or directory renames - document configuration and operational boundaries in the getting-started guide ## Why Repeated reads of immutable Paimon metadata and index ranges currently go back to the underlying storage every time. This adds an opt-in local disk cache to reduce remote requests and repeated read latency while keeping storage as the source of truth. ## User impact The feature is disabled by default. When enabled, metadata and global-index files are cached by default. Runtime cache failures fail open to the original storage, while mutable markers and temporary files bypass caching. ## Validation - `cargo test -p paimon --lib` — 1861 passed, 1 ignored - `cargo clippy -p paimon --all-targets -- -D warnings` - `cargo fmt --all -- --check` - `git diff --check` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
