Dear community, Nice to share Hudi community updates for 2023-05-15 ~ 2023-05-28 with updates on feature and bug fixes.
======================================= Feature [Flink] Update and Delete statements for Flink [1] [Core] Bucket index supports bulk insert row writer [2] [Core] Use Spark 3.2 as default Spark version [3] [1] https://issues.apache.org/jira/browse/HUDI-6235 [2] https://issues.apache.org/jira/browse/HUDI-5994 [3] https://issues.apache.org/jira/browse/HUDI-3088 Bugs [Spark] Failed to add fields in BUCKET index table [1] [Core] Prevent clean run concurrently in flink [2] [Core] Clean deleted partition with clean policy [3] [Flink] HoodieInternalWriteStatus marks failure with totalErrorRecords increment [4] [Core] fix lazy clean schedule rollback on completed instant [5] [Core] Adding hardening checks for transformer output schema for quarantine enabled/disabled [6] [Flink] Fix HoodieMergeHandle shutdown sequence [7] [Hive] Limit MDT deltacommits when data table has pending action [8] [Core] Allow for offline compaction of MOR tables via spark streaming [9] [Core] Parallelize deletion of files during rollback. [10] [Core] create marker file for every log file [11] [1] https://issues.apache.org/jira/browse/HUDI-6210 [2] https://issues.apache.org/jira/browse/HUDI-6134 [3] https://issues.apache.org/jira/browse/HUDI-6104 [4] https://issues.apache.org/jira/browse/HUDI-6229 [5] https://issues.apache.org/jira/browse/HUDI-5675 [6] https://issues.apache.org/jira/browse/HUDI-6115 [7] https://issues.apache.org/jira/browse/HUDI-5238 [8] https://issues.apache.org/jira/browse/HUDI-5520 [9] https://issues.apache.org/jira/browse/HUDI-3775 [10] https://issues.apache.org/jira/browse/HUDI-6213 [11] https://issues.apache.org/jira/browse/HUDI-1517 Best, Leesf
