mymeiyi opened a new pull request, #66598: URL: https://github.com/apache/doris/pull/66598
Problem Summary: Cloud cumulative compaction previously removed aggregated pre-rowset delete bitmaps with a Meta Service range clear. This could create a large FoundationDB transaction and remove keys outside the exact reported bitmap set. Collect each original bitmap by segment within the aggregation version range, including its rowset ID, segment ID, version, and serialized size, and encode those statistics in UpdateDeleteBitmapRequest. Meta Service reconstructs and removes the reported legacy and split blob keys individually in bounded transactions using the established transaction-size heuristic. Requests without statistics retain range deletion for compatibility. Reads skip obsolete incomplete blob tails left by underestimated sizes so they can later be recycled with the rowset. Malformed delete bitmap keys now fail with KV_TXN_GET_ERR before decoded fields are accessed. The key-based removal path is enabled by default and can be disabled through configuration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
