JingsongLi opened a new pull request, #903:
URL: https://github.com/apache/paimon-rust/pull/903

   ## Dependency
   Depends on apache/paimon-rust#902 for lazy BLOB-view lookup. Until #902 
merges, the diff against `main` also contains that PR; the new change in this 
PR is commit `726cc419`. I will rebase this branch onto `main` after #902 
merges.
   
   ## Summary
   - For `LIMIT` reads whose predicate references a managed BLOB, inline 
descriptor, or resolved BLOB view, read one candidate at a time so the quota 
can stop the next payload/view lookup immediately.
   - Keep ordinary-column predicates and unlimited reads at their existing 
batch size.
   - This intentionally trades throughput for exact no-speculative-payload 
behavior only on payload-dependent predicates.
   
   ## Verification
   - Reproduced pre-fix failures with a corrupt fourth managed BLOB payload and 
an invalid fourth view reference after three matching rows.
   - Added a batch-size boundary test showing ordinary predicates and 
descriptor-output mode retain normal batches.
   - `cargo test -p paimon table::data_evolution_reader:: --lib 
--no-default-features --features storage-memory,storage-fs` (81 passed)
   - `cargo test -p paimon --test rest_catalog_test --no-default-features 
--features storage-memory,storage-fs,storage-oss` (79 passed)
   - `cargo fmt --check` and `git diff --check` passed.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to