Dear community, happy to share this (and last) week's community update after a short Easter break. A lot has happened in the community in the meantime. Stateful Functions 2.0.0 was released, the releases of Flink 1.10.1 and 1.9.3 are around the corner, a couple of new FLIPs and blog posts...
...and, of course, Flink Forward 2020 Virtual is on next week Wed - Fri! Flink Development ============== * [releases] Apache Flink Stateful Functions 2.0.0 is out. [1] Check out Stephan's announcement blog post for an overview. [2] * [releases] Dian Fu recently proposed releasing Flink 1.9.3 [3]. The only remaining blocker was merged quickly and the first release candidate is out already [4] * [releases] There is only one blocker left for Flink 1.10.1 and we expecting a first release candidate soon. [5] * [sql] Zhenghua Gao has started a discussion on FLIP-71 to finish initial end-to-end view support in Flink SQL. [6] * [sql, hive] Rui Li has authored a FLIP(-123) to increase the compatibility of Flink with Hive's SQL dialect. It proposes to add an additional parser for the Hive dialect and to a support a limited set of DDL and DML features of Hive, that Flink currently does not understand. The vote has already passed. [7,8] * [python] Xingbo has started a discussion support Cython for Python User Defined Functions in the Table API. Quick discussion and vote has already gone through. [9,10] * [distribution] Aljoscha has initiated a discussion on releasing a "fat" and "slim" Flink distribution going forward. The slim distribution would only contain an absolute minimal set of dependencies (less than today), while the fat distribution would contain many convenience dependencies like connectors and formats. The goal is to improve the initial user experience particularly for Table API/SQL users. Discussion still ongoing. [11] * [connectors] Dawid proposes (FLIP-124] to add a "Rich" version of (De)SerializationSchema (adding open/close-method and a Collector). [12] This will allow to emit an arbitrary number of records for a single source record, initialization code as well as the registration of metrics in serializers. Vote has already started. [13,14] * [docs] Marta proposes to apply to Google's Season of Docs 2020. Season of Docs brings together technical writers and Open Source projects to improve their documentation. Marta is looking for (documentation) project ideas as well as volunteers to mentor potential technical writers. [15] * [development process] Yun Tang has enabled autolinks from Github commits to Jirta tickets for all Apache Flink repositories. "FLINK-XXXX" in a commit message will now automatically link to the corresponding Jira ticket. Checkout https://github.com/apache/flink/commits/master. [16] * [development process] Aljoscha reminds everyone to check that their email address is correctly configured in Github so that it shows up in your commits to Apache Flink instead of nore...@github.com. [17] [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-Stateful-Functions-2-0-0-released-tp39963.html [2] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-Flink-1-9-3-tp40086.html [3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-Release-1-9-3-release-candidate-1-tp40441.html [4] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-Flink-1-10-1-tp38689.html [5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-71-E2E-View-support-in-Flink-SQL-tp40059.html [6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-123-DDL-and-DML-compatibility-for-Hive-connector-tp39633.html [7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-123-DDL-and-DML-compatibility-for-Hive-connector-tp40183.html [8] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-121-Support-Cython-Optimizing-Python-User-Defined-Function-tp39577.html [9] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/RESULT-VOTE-FLIP-121-Support-Cython-Optimizing-Python-User-Defined-Function-tp40163.html [10] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Releasing-fat-and-slim-Flink-distributions-tp40237.html [11] https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=148645988&src=contextnavpagetreemode [12] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-124-Add-open-close-and-Collector-to-De-SerializationSchema-tp39864.html [13] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/VOTE-FLIP-124-Add-open-close-and-Collector-to-De-SerializationSchema-tp40318.html [14] https://flink.apache.org/news/2020/04/07/release-statefun-2.0.0.html [15] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/PROPOSAL-Google-Season-of-Docs-2020-td40264.html [16] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Configuring-autolinks-to-Flink-JIRA-ticket-in-github-repos-tp39712.html [17] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/PSA-Please-check-your-github-email-configuration-when-merging-on-Github-tp40016.html Notable Bugs ========== [FLINK-16662] [1.10.0] Currently, you can not convert a DataStream of POJOs to a Table. Fix planned for 1.10.1. [18] [18] https://issues.apache.org/jira/browse/FLINK-16662 Events, Blog Posts, Misc =================== * Hequn Chen joined the Apache Flink PMC. Congratulations! [19] * Seth Wiesman is an Apache Flink Committer now. Congrats! [20] * Flink Forward San Francisco Virtual will happen next week Wed - Fri. You can still register & attend for free and listen to over 40 talks by great speaker. [21] * David would like to contribute the material of Ververica's self-paced Apache Flink training to Apache Flink. [22] The feedback was positive and the details are discussed in a follow up thread. [23] * Abdelkrim Hadjidj has published a blog post that implements an imaginary supply chain use case with an Open Source stream processing stack including among others tools Apache Flink & Zeppelin. [24] * Nico started a series of posts on serialization in Apache Flink. A topic that is often crucial for performance in many DataStream API applications. His first post explains & compares the different available serializers available in Apache Flink. [25] * Also on the Flink blog, Jincheng and Markos recap the latest work on Python UDF support in the Table API, explain how to get started and have a look at future work in this area. [26] [19] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-New-Apache-Flink-PMC-Member-Hequn-Chen-tp40374p40443.html [20] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-New-Flink-committer-Seth-Wiesman-tp39917p39974.html [21] https://www.flink-forward.org/sf-2020/conference-program [22] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/PROPOSAL-Contribute-training-materials-to-Apache-Flink-tp40075.html [23] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Integration-of-training-materials-into-Apache-Flink-tp40299.html [24] https://medium.com/@abdelkrim.hadjidj/event-driven-supply-chain-for-crisis-with-flinksql-be80cb3ad4f9 [25] https://flink.apache.org/news/2020/04/15/flink-serialization-tuning-vol-1.html [26] https://flink.apache.org/2020/04/09/pyflink-udf-support-flink.html Cheers, Konstantin (@snntrable) -- Konstantin Knauf
