Dear community, Nice to share Hudi community weekly update for 2020-08-30 ~ 2020-09-06 with updates on discussion, features, bugfixs.
======================================= Discussion [Community] A discussion about DevX, Test infra Rgdn with the community, as the community become larger, we need more clear roles to extend the community [1] [Writer Core] A discussion to introduce incremental processing API in Hudi to make incremental processing with other systems more easily [2] [Core] A discussion to enable cross AZ consistency and quality checks of hudi datasets [3] [Release] A discussion about formalizing the release process, that would make community release new version in a more standard way [4] [Community] There are new four committers to the community [5] ======================================= Features [Writer Core] Implementation of the HFile base and log file format [6] [Writer Core] Let delete API use "hoodie.delete.shuffle.parallelism". [7] ======================================= Bugs [Writer Core] Spark DataSource and Streaming Write must fail when operation type is misconfigured [8] [1] https://lists.apache.org/thread.html/rfd0d7793e9def7485718d0228e24330dcf7a9dd02ccfbd27554bb9f4%40%3Cdev.hudi.apache.org%3E [2] https://lists.apache.org/thread.html/r7d3006dc5e6db85fbdc6ef714bf4eb1c99534aa52be0ba365a29c772%40%3Cdev.hudi.apache.org%3E [3] https://lists.apache.org/thread.html/r295aa716aac1bdc58a49ede7b50220b29d595531aad9058d7ee33da6%40%3Cdev.hudi.apache.org%3E [4] https://lists.apache.org/thread.html/r3ac49b5ae17734120f13b4403e7c4fc548ba4c772825d3a5c67e09eb%40%3Cdev.hudi.apache.org%3E [5] https://lists.apache.org/thread.html/r53a38909bec9905df096694a75de522fe7bf37d59cc4ce0500300938%40%3Cdev.hudi.apache.org%3E [6] https://issues.apache.org/jira/browse/HUDI-960 [7] https://issues.apache.org/jira/browse/HUDI-993 [8] https://issues.apache.org/jira/browse/HUDI-1153 Best, Leesf
