[
https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17439581#comment-17439581
]
Vinoth Chandar edited comment on HUDI-1492 at 11/7/21, 12:29 AM:
-----------------------------------------------------------------
I am assigning this to [~manojg] to consider this during col stats. to be
specific, we need to collect bloom filters and stats for the appended log block
alone and be able to reflect on the metadata table partition .
was (Author: vc):
I am assigning this to [~manojg] to consider this during col stats.
> Enhance DeltaWriteStat with block level metadata correctly for storage
> schemes that support appends
> ---------------------------------------------------------------------------------------------------
>
> Key: HUDI-1492
> URL: https://issues.apache.org/jira/browse/HUDI-1492
> Project: Apache Hudi
> Issue Type: Sub-task
> Reporter: Vinoth Chandar
> Assignee: Manoj Govindassamy
> Priority: Blocker
> Fix For: 0.10.0
>
>
> Current implementation simply uses the
> {code:java}
> String pathWithPartition = hoodieWriteStat.getPath(); {code}
> to write the metadata table. this is problematic, if the delta write was
> merely an append. and can technically add duplicate files into the metadata
> table
> (not sure if this is a problem per se. but filing a Jira to track and either
> close/fix )
>
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
