danny0405 opened a new issue, #17697:
URL: https://github.com/apache/hudi/issues/17697

   ### Task Description
   
   **What needs to be done:**
   
   - [ ] Add the basic cache layer abstraction
   - [ ] Introduce hotspot entries cache: cache A
   - [ ] Introduce inflight entries cache(for uncommitted checkpoint): cache B
   - [ ] Introce smart eviction strategy for cache A & B
   - [ ] support point queries with optional mini-batch access(one access with 
a set of keys)
   - [ ] add tests
   
   **Why this task is needed:**
   
   ms level point query access is required for streaming, otherwise it's very 
prone to trigger backpressure then volatility of the pipeline.
   
   
   ### Task Type
   
   Code improvement/refactoring
   
   ### Related Issues
   
   **Parent feature issue:** (if applicable )
   #17647 
   **Related issues:**
   NOTE: Use `Relationships` button to add parent/blocking issues after issue 
is created.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to