[
https://issues.apache.org/jira/browse/HUDI-163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar updated HUDI-163:
--------------------------------
Status: Closed (was: Patch Available)
> Updates to HoodieRecord are missing during MergeHandle with
> ExternalSpillableMap
> --------------------------------------------------------------------------------
>
> Key: HUDI-163
> URL: https://issues.apache.org/jira/browse/HUDI-163
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Common Core
> Reporter: BALAJI VARADARAJAN
> Assignee: omkar vinit joshi
> Priority: Major
>
> Copy of https://github.com/apache/incubator-hudi/issues/773
> MergeHandle uses ExternalSpillableMap for storing all new inserts to a file.
> Today during merge handle if number of records which we are adding to a file
> are a lot then ExternalSpillableMap may end up writing it to disk and future
> updates done to in memory copy of HoodieRecord will not be reflected into on
> disk copy. This creates duplicate key issue if we are using HBaseIndex.
> Creating this issue to address this.
> [https://github.com/apache/incubator-hudi/blob/master/hoodie-client/src/main/java/com/uber/hoodie/io/HoodieMergeHandle.java#L211]
> Here we are updating HoodieRecord after adding to the map.
>
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
