Alexey Kudinkin created HUDI-3715:
-------------------------------------
Summary: Make sure Hoodie Max File Configs are respected for all
Formats
Key: HUDI-3715
URL: https://issues.apache.org/jira/browse/HUDI-3715
Project: Apache Hudi
Issue Type: Bug
Reporter: Alexey Kudinkin
Assignee: Alexey Kudinkin
Fix For: 0.12.0
This is an extension of HUDI-3709.
We need to revisit way we track the file sizes and avoid relying on
HoodieWrapperFileSystem, since this method
* Is not reliable: file might be written lazily, therefore at FS level we
won't know how much Writer has accumulated until it's closed (which is what was
causing HUDI-3709)
* Since this method is quite low-level it has performance implications given
that we're no intercepting low-level writes to increment the counters (stored
globally on FS level)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
