XiaoHongbo-Hope opened a new pull request, #11225:
URL: https://github.com/apache/paimon/pull/11225

   ### Purpose
   
   Avoid advancing one BLOB fallback iterator per sequence number for every 
output row when the BLOB files have disjoint row ID ranges. A large logical 
range can contain many such files from different commits, making 
descriptor-only reads spend substantial CPU advancing synthetic placeholders.
   
   Read disjoint files as one sequence group inside the existing fallback 
reader. Overlapping ranges retain the existing merge path; actual file sequence 
numbers, selected row ranges, gaps, and placeholder handling are preserved. No 
file format changes.
   
   ### Tests
   
   - 45 tests passed across `BlobFallbackRecordReaderTest`, 
`AllPlaceholdersRecordReaderTest`, and `DataEvolutionSplitReadTest`.
   - New regression coverage checks that 128 disjoint sequence groups create no 
per-group synthetic gaps, and verifies selected ranges and both placeholder 
modes.
   - Maven validation (including formatting and Checkstyle) and `git diff 
--check`.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to