[
https://issues.apache.org/jira/browse/HUDI-204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Vinoth Chandar reassigned HUDI-204:
-----------------------------------
Assignee: BALAJI VARADARAJAN
> Make MOR rollback idempotent and disable using rolling stats for small file
> selection
> -------------------------------------------------------------------------------------
>
> Key: HUDI-204
> URL: https://issues.apache.org/jira/browse/HUDI-204
> Project: Apache Hudi (incubating)
> Issue Type: Bug
> Components: Write Client
> Reporter: BALAJI VARADARAJAN
> Assignee: BALAJI VARADARAJAN
> Priority: Major
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> 1. Rollback assumes all fileIds that are affected by rollback to be always
> present. This breaks when rollback fails intermittently and is retried
> 2. Sometime Rolling stats wrongly tracks file sizes to be 0. We had earlier
> discussed to completely revisit rolling stats. We will disable using rolling
> stats to prevent wrong small file selection
--
This message was sent by Atlassian Jira
(v8.3.2#803003)