Dear community, Nice to share Hudi community weekly update for 2020-01-12 ~ 2020-01-19 with updates on development, features, bug fixes.
Development [Release] A discussion about delaying code freeze date for next release until Jan 19 to get blockers on land, most blockers are resolved and hopefully a new release candidate will be cut soon.[1] [Module Reanme] A disscussion about renaming hudi-hadoop-mr module to hudi-query-common to make the module more user-friendly, it is still under discussion and welcome to participate in.[2] [1] https://lists.apache.org/thread.html/rab51d3158eb41659c3ce6e12dd46a8bd56d475d40fc7de356575c518%40%3Cdev.hudi.apache.org%3E [2] https://lists.apache.org/thread.html/ra659be560374a9c2f39007e719bac11a8422e31f42769a49a757ea25%40%3Cdev.hudi.apache.org%3E Features [Common Core] Improvements to DiskBasedMap used by ExternalSpillableMap for write and random/sequential read paths, by introducing bufferedRandmomAccessFile.[3] [Writer Core] Adds new GlobalDeleteKeyGenerator for record_key deletes with global indices.[4] [Code Cleanup] Renaming code in sync with cWiki restructuring.[5] [CLI] Introduce `repair overwrite-hoodie-props` CLI command.[6] [Code Cleanup] This fixes compile warnings as well as unnecessary plugin invocation for most of the modules which do not have scala code[7] [Usability] Make Hudi support Scala 2.12[8] [3] https://issues.apache.org/jira/browse/HUDI-377 [4] https://issues.apache.org/jira/browse/HUDI-326 [5] https://issues.apache.org/jira/browse/HUDI-509 [6] https://issues.apache.org/jira/browse/HUDI-537 [7] https://issues.apache.org/jira/browse/HUDI-527 [8] https://issues.apache.org/jira/browse/HUDI-238 Bugs [Compaction] Inline compact not work[9] [Spark Integration] Datasource Writer throws error on resolving struct fields[10] [Common Core] Ensure Compaction Plan is always written in .aux folder to avoid 0.5.0/0.5.1 reader-writer compatibility issues[11] [Spark Integration] Fix the schema mismatch in Row-to-Avro conversion[12] [9] https://issues.apache.org/jira/browse/HUDI-526 [10] https://issues.apache.org/jira/browse/HUDI-530 [11] https://issues.apache.org/jira/browse/HUDI-535 [12] https://issues.apache.org/jira/browse/HUDI-552 Best, Leesf
