fresh-borzoni opened a new issue, #3327:
URL: https://github.com/apache/fluss/issues/3327

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/fluss/issues) and 
found nothing similar.
   
   
   ### Description
   
    Follow-up to #3296.
     
   In batch mode on a lake-enabled PK table with no lake snapshot yet, the 
fallback reads every bucket's log from EARLIEST, ignoring existing Fluss KV 
snapshots. This is OOM-prone on large never-tiered tables.
   
   Spark fixed the equivalent in #3317 with per-bucket dispatch (snapshot+tail 
where KV snapshot exists, log-only otherwise).
   
   Flink can't 1:1 port because `FlinkSourceSplitReader` has no sort-merge on 
the Fluss-only path. We may reuse `LakeSnapshotAndLogSplitScanner` (already 
used by Flink's lake reader, already sort-merges per PK) for the fallback or do 
smth similar
   
   ### Willingness to contribute
   
   - [ ] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to