bryndenZh opened a new pull request, #6407:
URL: https://github.com/apache/paimon/pull/6407

   ### Purpose
   
   In high-concurrency point query scenarios on the primary key table, we 
observed high CPU usage mainly caused by deserialization overhead of DV 
metadata. Currently, reading deletion vector metadata for a single bucket 
requires reading and deserializing a large number of entries from the index 
manifest, if the table has many partition and buckets.
   <img width="2553" height="955" alt="image" 
src="https://github.com/user-attachments/assets/b557a11e-57f3-4c6b-a3dc-f5bc2b798978";
 />
   
   This PR introduces a bucket-level dv meta cache which  reduces CPU load and 
significantly improves QPS for single-bucket query scenarios on primary key 
tables.
   
   
   ### Tests
   
   ### API and Format
   
   ### Documentation
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to