Dear community, happy to share this week's community update with the release of Flink 1.9.1, a couple of threads about our development process, the sql ecosystem and more.
Flink Development ============== * [releases] *Apache Flink 1.9.1* was released. [1,2] * [statefun] Stephan has started a separate discussion on whether to maintain *Stateful Functions* in a separate repository or the Flink main repository after its contribution to Apache Flink. The majority seems to prefer a separate repository e.g. to enable quicker iterations on the new code base and not to overwhelm new contributors to Stateful Functions. [3] * [development process] The *NOTICE* file and the directory for licenses of bundled dependencies for binary releases is now auto-generated during the release process. [4] * [development process] According to our *FLIP process* the introduction of a new config option requires a FLIP (and vote). Aljoscha has started a discussion to clarify this point, as this is currently not always the case. Looks like the majority leans towards a vote for every configuration change, but possibly making it more lightweight than a proper FLIP. [5] * [development process] Xiyuan gave an update on *Flink's ARM support.* Travis ARM Support is in alpha now (alternative to previously proposed OpenLab), and regardless of the CI system Xiyuan points the community to a list of PRs/Jiras, which need to be solved/reviewed. [6] * [configuration] The discussion on FLIP-59 to make the execution configuration (ExecutionConfig et al.) configurable via the Flink Configuration has been revived a bit and focuses on alignment with FLIP-73 and naming of the different configurations now. [7] * [sql] Based on feedback from the user community, Timo proposes to rename the "ANY" datatype "OPAQUE" highlighting that a field of type "ANY" does not hold any type, but a data type that is unknown to Flink. [8] * [sql] Jark has started a discussion on FLIP-80 [9] about how to de/serialize expressions in catalogs. [10] [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-9-1-released-tp34170.html [2] https://flink.apache.org/news/2019/10/18/release-1.9.1.html [3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Stateful-Functions-in-which-form-to-contribute-same-or-different-repository-tp34034.html [4] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/NOTICE-Binary-licensing-is-now-auto-generated-tp34121.html [5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-policy-for-introducing-config-option-keys-tp34011p34045.html [6] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ARM-support-Travis-ARM-CI-is-now-in-Alpha-Release-tp34039.html [7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-59-Enable-execution-configuration-from-Configuration-object-tp32359.html [8] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Rename-the-SQL-ANY-type-to-OPAQUE-type-tp34162.html [9] https://docs.google.com/document/d/1LxPEzbPuEVWNixb1L_USv0gFgjRMgoZuMsAecS_XvdE/edit?usp=sharing [10] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISUCSS-FLIP-80-Expression-String-Serializable-and-Deserializable-tp34146.html Notable Bugs ========== * [FLINK-14429] [1.9.1] [1.8.2] When you run a batch job on YARN in non-detached mode, it will be reported as SUCCEEDED if when it actually FAILED. [11] [11] https://issues.apache.org/jira/browse/FLINK-14429 Events, Blog Posts, Misc =================== * This discussion on the dev@ mailing list might be interesting to follow for people using the StreamingFileSink or BucketingSink with S3. [12] * There will be full-day meetup with six talks in the Bangalore Kafka Group on the 2nd of November including at least three Flink talks by *Timo Walter* (Ververica), *Shashank Agarwal* (Razorpay) and *Rasyid Hakim* (GoJek). [13] [12] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/performances-of-S3-writing-with-many-buckets-in-parallel-tp34021p34050.html [13] https://www.meetup.com/Bangalore-Apache-Kafka-Group/events/265285812/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany -- Ververica GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng
