JingsongLi opened a new pull request, #9924:
URL: https://github.com/apache/paimon/pull/9924

   ### Purpose
   
   Follow up on the manifest sidecar cache review in #9897.
   
   - Keep filtered scans on the existing sidecar block-selection path.
   - When a manifest cache and an explicit sidecar reference are both 
available, let unfiltered scans select all sidecar blocks so prefetch and later 
filtered reads share the block cache.
   - Keep unfiltered scans without a manifest cache on the existing 
whole-manifest read path.
   - Fall back to the whole-manifest cache when no usable sidecar is referenced.
   - Update the manifest specification for the refined read behavior.
   
   ### Tests
   
   ```shell
   
JAVA_HOME=/Users/lijingsong/Library/Java/JavaVirtualMachines/corretto-17.0.13/Contents/Home
 mvn -pl paimon-core -Pfast-build -DwildcardSuites=none 
-Dtest=ManifestFileTest#testUnfilteredReadWithoutCacheSkipsSidecar+testUnfilteredReadWithCacheAndWithoutSidecarUsesWholeManifestCache+testUnfilteredReadWarmsBlockCacheForFilteredRead
 test
   
JAVA_HOME=/Users/lijingsong/Library/Java/JavaVirtualMachines/corretto-17.0.13/Contents/Home
 mvn -pl paimon-core -DskipTests compile
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to