Pandas886 opened a new issue, #503:
URL: https://github.com/apache/paimon-rust/issues/503

   ### Describe the feature
   
   Add a first-class Rust API for batch incremental reads over a snapshot 
range, starting with **Delta** mode and **Auto** mode selection.
   
   ### Motivation
   
   Right now you can plan a full table scan for a snapshot, but there isn't a 
clean public API for "give me files between snapshot A (exclusive) and B 
(inclusive)" — which is the building block for incremental ETL and later SQL 
helpers.
   
   ### Proposed scope (this issue)
   
   - `IncrementalScanMode` / `IncrementalScan` / `IncrementalPlan`
   - Snapshot range checks (start exclusive, end inclusive; empty + 
out-of-range)
   - Delta planning over APPEND snapshots in the range
   - Auto: `changelog-producer=none` → Delta; otherwise resolve to Changelog 
(implementation of Changelog itself can be a follow-up)
   - Reuse existing `TableScan` / `TableRead` instead of reimplementing 
manifest readers
   
   Follow-ups (separate issues/PRs): reading existing changelog manifests, Diff 
mode, DataFusion TVF.
   
   ### Additional context
   
   I already have a draft implementation I'm cleaning up against current `main`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to