[
https://issues.apache.org/jira/browse/HUDI-760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17087835#comment-17087835
]
Balaji Varadarajan commented on HUDI-760:
-----------------------------------------
Hi [~baobaoyeye] : Sorry for the delay. Here are extra information.
Hudi had an earlier implementation of keeping all consolidated metadata in
every "commit" files. We had earlier disabled it by not writing this data. But,
the code has still references to Rolling stats.
1. org.apache.hudi.common.model.HoodieRollingStatMetadata
2.
hudi-client/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java
3. hudi-client/src/test/java/org/apache/hudi/table/TestMergeOnReadTable.java
4.
hudi-client/src/test/java/org/apache/hudi/client/TestHoodieClientOnCopyOnWriteStorage.java
Hope this helps !! Let us know if you plan to take it up.
Thanks for offering to contribute.
Balaji.V
> Remove Rolling Stat management from Hudi Writer
> -----------------------------------------------
>
> Key: HUDI-760
> URL: https://issues.apache.org/jira/browse/HUDI-760
> Project: Apache Hudi (incubating)
> Issue Type: Improvement
> Components: Writer Core
> Reporter: Balaji Varadarajan
> Priority: Major
> Labels: help-wanted, newbie,
> Fix For: 0.6.0
>
>
> Current implementation of rolling stat is not scalable. As Consolidated
> Metadata will be implemented eventually, we can have one design to manage
> file-level stats too.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
