shyjsarah opened a new pull request, #8926:
URL: https://github.com/apache/paimon/pull/8926
### Purpose
`CachingFileIO` stores its `LocalCacheManager` in a transient field. When a
catalog-created table/FileIO is serialized into distributed tasks, the cache
becomes null and reads silently fall through to the delegate.
Persist the local-cache configuration and lazily recreate a JVM-local cache
manager after deserialization. Wrappers with the same configuration share
that
manager, so each task does not allocate an independent max-sized cache.
### Tests
- Added a regression test proving cached streams are restored after
serialization.
- Added a test proving deserialized wrappers reuse the same JVM-local cache.
- `mvn -pl paimon-common -DwildcardSuites=none
-Dtest=CachingFileIOTest,LocalDiskCacheManagerTest test`
- Tests run: 24
- Failures: 0
- Errors: 0
- `mvn -pl paimon-common test`
- Tests run: 12145
- Failures: 0
- Errors: 0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
