Dear community, Nice to share Hudi community bi-weekly updates for 2022-08-01 ~ 2022-08-14 with updates on bug fixes.
======================================= Features [Spark] support to create ro/rt table by spark sql [1] [Flink] Support online compaction in the flink batch mode write [2] [Flink] support retain hour cleaning policy for flink [3] [1] https://issues.apache.org/jira/browse/HUDI-4487 [2] https://issues.apache.org/jira/browse/HUDI-4385 [3] https://issues.apache.org/jira/browse/HUDI-4544 ======================================= Bugs [Flink] Repair config "hive_sync.metastore.uris" in flink sql hive schema sync is not effective [1] [Spark] Throwing exception when restore is attempted with hoodie.arhive.beyond.savepoint is enabled [2] [Flink] Adjust partition number of flink sink task [3] [Spark] optimize CTAS to adapt to saveAsTable api in different modes [4] [Spark] Repair the exception when reading optimized query for mor in hive and presto/trino [5] [Flink] Fix 'Not a valid schema field: ts' error in HoodieFlinkCompactor if precombine field is not ts [6] [1] https://issues.apache.org/jira/browse/HUDI-4510 [2] https://issues.apache.org/jira/browse/HUDI-4501 [3] https://issues.apache.org/jira/browse/HUDI-4477 [4] https://issues.apache.org/jira/browse/HUDI-4514 [5] https://issues.apache.org/jira/browse/HUDI-4508 [6] https://issues.apache.org/jira/browse/HUDI-4572 Best, Leesf