[jira] [Created] (FLINK-9610) Add Kafka partitioner that uses the key to partition by

2018-06-18 Thread Niels Basjes (JIRA)
Niels Basjes created FLINK-9610: --- Summary: Add Kafka partitioner that uses the key to partition by Key: FLINK-9610 URL: https://issues.apache.org/jira/browse/FLINK-9610 Project: Flink Issue

[ANNOUNCE] Weekly community update #25.

2018-06-18 Thread Till Rohrmann
Dear community, this is the weekly community update thread #25. Please post any news and updates you want to share with the community to this thread. # Making Flink Table Scala free The community started discussing whether and how to make flink-table Scala free [1]. This change would be an

[jira] [Created] (FLINK-9609) Add bucket ready notification mechanism for BucketingSink when checkpoint complete

2018-06-18 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9609: --- Summary: Add bucket ready notification mechanism for BucketingSink when checkpoint complete Key: FLINK-9609 URL: https://issues.apache.org/jira/browse/FLINK-9609

Re: [DISCUSS] Flink 1.6 features

2018-06-18 Thread zhangminglei
Hi, Sagar Thank your for your review. I will fix it when available. > 2. Will you be able to add more unit tests in the commit ? Eg. Writing some > example data with simple schema which will initialize OrcWriter object and > sinking it to local hdfs node ? Ans: Yes. I will add more unit

[jira] [Created] (FLINK-9611) Allow for user-defined artifacts to be specified as part of a mesos overlay

2018-06-18 Thread Addison Higham (JIRA)
Addison Higham created FLINK-9611: - Summary: Allow for user-defined artifacts to be specified as part of a mesos overlay Key: FLINK-9611 URL: https://issues.apache.org/jira/browse/FLINK-9611 Project:

[jira] [Created] (FLINK-9612) Add option for minimal artifacts being pulled in meseos

2018-06-18 Thread Addison Higham (JIRA)
Addison Higham created FLINK-9612: - Summary: Add option for minimal artifacts being pulled in meseos Key: FLINK-9612 URL: https://issues.apache.org/jira/browse/FLINK-9612 Project: Flink

Improvements to Mesos Deployments Using Docker

2018-06-18 Thread Addison Higham
I am currently in the process of getting flink 1.5 running in a mesos cluster using docker. I have come across a few improvements that I think could be helpful with this configuration (and will probably also apply for any future containerized deployments, like Kubernetes) I have already created

Re: [TABLE][SQL] Unify UniqueKeyExtractor and DataStreamRetractionRules

2018-06-18 Thread Piotr Nowojski
Hi I had some follow up thoughts on this matter over the weekend. I might be mistaken here, since I have never worked with Calcite before, so whatever I’m writing comes with my previous experience with optimisers and mostly guesses/assumptions that Calcite works as I would expect it to work.

Why not put "FLIP: Network Stack Improvements" into Confluence page?

2018-06-18 Thread Tony Wei
Hi, I read Flink 1.5.0 release announcements[1] recently and noticed the improvements to Flink’s Network Stack. Because I'm interested in knowing more design details about this improvements, I tried to find more related issues and discussions about it. I found it has a FLIP proposal[2] but not