sivabalan narayanan created HUDI-7780:
-----------------------------------------
Summary: Avoid 0 record parquet files
Key: HUDI-7780
URL: https://issues.apache.org/jira/browse/HUDI-7780
Project: Apache Hudi
Issue Type: Improvement
Components: writer-core
Reporter: sivabalan narayanan
There are occasions where hudi could produce 0 record files.
For eg,
a. entire set of records deleted in log block and due to small file handling, a
new parquet is created with HoodieMergeHandle.
b. During compaction, again there are chances that hudi might produce 0 record
parquet files.
We need to avoid such files if possible.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
