[ 
https://issues.apache.org/jira/browse/HUDI-9469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Shuo Cheng updated HUDI-9469:
-----------------------------
    Description: Currently, `getClosableHoodieRecordIterator` and 
`getClosableKeyIterator` will incur redundant record conversion from 
`BufferedRecord` <--> engine record. We can make a minor refactor to get the 
iterator more efficiently, e.g., providing a method 
`getBufferedRecordIterator`, then implement `getClosableIterator`, 
`getClosableHoodieRecordIterator` and `getClosableKeyIterator` based on it.  
(was: Currently, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` 
will incur redundant record conversion from `BufferedRecord` <--> engine 
record. We can make some minor refactor to get the iterator more efficiently, 
e.g., providing an method `getBufferedRecordIterator`, then implement 
`getClosableIterator`, `getClosableHoodieRecordIterator` and 
`getClosableKeyIterator` based on it.)

> Refactor getting hoodieRecord iterator for file group reader
> ------------------------------------------------------------
>
>                 Key: HUDI-9469
>                 URL: https://issues.apache.org/jira/browse/HUDI-9469
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: core
>            Reporter: Shuo Cheng
>            Assignee: Shuo Cheng
>            Priority: Minor
>             Fix For: 1.1.0
>
>
> Currently, `getClosableHoodieRecordIterator` and `getClosableKeyIterator` 
> will incur redundant record conversion from `BufferedRecord` <--> engine 
> record. We can make a minor refactor to get the iterator more efficiently, 
> e.g., providing a method `getBufferedRecordIterator`, then implement 
> `getClosableIterator`, `getClosableHoodieRecordIterator` and 
> `getClosableKeyIterator` based on it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to