yihua opened a new issue, #904:
URL: https://github.com/apache/hudi-rs/issues/904

   ### Feature Description
   
   A read that filters on the record key (`id = 'k'`, `id IN (...)`, or the 
same on `_hoodie_record_key`) scans every file slice of the table and applies 
the filter row by row. The record-level index already maps each key to its file 
group for the write path, so a key lookup could read one file group per key 
instead of the whole table.
   
   Proposed: when a snapshot read at the latest commit filters on the table's 
single record key field and the record-level index is populated, look the keys 
up and restrict the planned file slices to the file groups the index names. 
Time travel, composite keys and tables without the index keep the full scan.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to