bobhan1 opened a new pull request, #70745:
URL: https://github.com/apache/doris/pull/70745

   ### What problem does this PR solve?
   
   Backport #70350 and its GCC unity build fix #70736 to `branch-4.2` as 
separate commits.
   
   Compaction compresses eligible row-ID mappings in bounded source blocks when 
the estimated dense matrix exceeds 500 MiB. The backport uses 4.2's contiguous 
segment IDs for delete bitmap conversion and finalizes the map after all 
segment groups have merged. Cluster-key MoW continues to use the dense matrix 
for the output rowset's internal delete bitmap. CLucene and index compaction 
debug dumps also use the dense layout.
   
   ### Release note
   
   Eligible MoW and Duplicate Key SNII compactions now compress large row-ID 
mappings. The dynamic `compressed_rowid_conversion_threshold_bytes` setting 
controls the threshold, and `enable_compressed_rowid_conversion` controls 
whether eligible mappings use compression.
   
   ### Testing
   
   - `git diff --check upstream/branch-4.2...HEAD` passed.
   - Targeted BE unit tests are building locally. The filter covers the row-ID 
map, SNII consumers, and 4.2's grouped compaction and cluster-key MoW paths.
   
   ### AI Disclosure
   
   OpenAI Codex adapted the backport, resolved conflicts, and prepared this PR.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to