Dear community, happy to share this week's weekly community digest with a release candidate for Flink 1.10, a Pulsar Catalog for Flink, a 50% discount code for Flink Forward SF and bit more.
Flink Development ============== * [releases] The first (preview)* release candidate for Flink 1.10* has been created. Every help in testing the release candidate is highly appreciated. [1] * [sql] I believe I have never covered the contribution of a *Pulsar Catalog* to Flink's SQL ecosystem in the past. So here it is. Apache Pulsar includes a schema registry out-of-the-box. With Flink's Pulsar catalog, Pulsar topics will automatically available as tables in Flink. Pulsar namespaces are mapped to databases in Flink. [2,3] * [deployment] End of last year Patrick Lucas had started a discussion on integrating the *Flink Docker images *into the Apache Flink project. The discussion has stalled a bit by now, but there seems to be a consensus that a) the Flink Docker images should move to Apache Flink and b) the Dockerfiles in apache/flink need to be consolidated. [4] * [statebackends] When using the *RocksDbStatebackend Timer* state is currently - by default - still stored on the Java heap. Stephan proposes to change this behaviour to store Timers in RocksDB by default and has received a lot of positive feedback. [5] [1] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Apache-Flink-1-10-0-release-candidate-0-tp36770.html [2] https://docs.google.com/document/d/1LMnABtXn-wQedsmWv8hopvx-B-jbdr8-jHbIiDhdsoE/edit [3] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-FLIP-72-Introduce-Pulsar-Connector-tp33283.html [4] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Integrate-Flink-Docker-image-publication-into-Flink-release-process-tp36139.html [5] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/DISCUSS-Change-default-for-RocksDB-timers-Java-Heap-in-RocksDB-tp36720.html Notable Bugs ========== * [FLINK-15577] [1.9.1] When using two different windows within on SQL query, Flink might generate an invalid physical execution plan as it incorrectly considers the two window transformations equivalent. More details in the ticket. [6] [6] https://issues.apache.org/jira/browse/FLINK-15577 Events, Blog Posts, Misc =================== * *Dian Fu* is now an Apache Flink Comitter. Congratulations! [7] * *Bird *has published an in-depth blog post on how they use Apache Flink to detect offline scooters. [8] * On the Flink Blog, Alexander Fedulov has published a first blog post of a series on how to implement a *financial fraud detection use case* with Apache Flink. [9] * The extended *Call for Presentations for Flink Forward San Francisco* ends today. Make sure to submit your talk in time. [10,11] * Still on the fence whether to attend *Flink Forward San Francisco*? Let me help you with that: when registering use discount code *FFSF20-MailingList* to get a * 50% discount* on your conference ticket. * Upcoming Meetups * On January 22 my colleague *Alexander Fedulov *will talk about Fraud Detection with Apache Flink at the Apache Flink Meetup in Madrid [12]. * On February 6 *Alexander Fedulov *will talk about Stateful Stream Processing with Apache Flink at the R-Ladies meetup in Kiew. [13] [7] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Dian-Fu-becomes-a-Flink-committer-tp36696p36760.html [8] https://medium.com/bird-engineering/replayable-process-functions-in-flink-time-ordering-and-timers-28007a0210e1 [9] https://flink.apache.org/news/2020/01/15/demo-fraud-detection.html [10] http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/ANNOUNCE-Flink-Forward-San-Francisco-2020-Call-for-Presentation-extended-tp36595.html [11] https://www.flink-forward.org/sf-2020 [12] https://www.meetup.com/Meetup-de-Apache-Flink-en-Madrid/events/267744681/ [13] https://www.meetup.com/rladies-kyiv/events/267948988/ Cheers, Konstantin (@snntrable) -- Konstantin Knauf | Solutions Architect +49 160 91394525 Follow us @VervericaData Ververica <https://www.ververica.com/> -- Join Flink Forward <https://flink-forward.org/> - The Apache Flink Conference Stream Processing | Event Driven | Real Time -- Ververica GmbH | Invalidenstrasse 115, 10115 Berlin, Germany -- Ververica GmbH Registered at Amtsgericht Charlottenburg: HRB 158244 B Managing Directors: Timothy Alexander Steinert, Yip Park Tung Jason, Ji (Tony) Cheng
