Re: [DISCUSS] Releasing Flink-shaded 7.0

2019-04-30 Thread Tzu-Li (Gordon) Tai
+1 -- Sent from: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/

[DISCUSS] Features for Apache Flink 1.9.0

2019-04-30 Thread Tzu-Li (Gordon) Tai
Hi community, Apache Flink 1.8.0 has been released a few weeks ago, so naturally, it’s time to start thinking about what we want to aim for 1.9.0. Kurt and I had collected some features that would be reasonable to consider including for the next release, based on talking with various people as we

Re: The contradiction between event time and natural time from EventTimeTrigger

2019-04-30 Thread Rong Rong
Hi Zhipeng, Please see my explanation below: >From the default EventTimeTrigger source code, I found that only onElement > method (will judge the watermark) and onEventTime method only have a chance > to trigger TriggerResult.FIRE; > Therefore, the default EventTimeTrigger is assumed and must be

[jira] [Created] (FLINK-12379) Parallelism in job/GCS/Hadoop: Could not finalize the pending checkpoint

2019-04-30 Thread Henrik (JIRA)
Henrik created FLINK-12379: -- Summary: Parallelism in job/GCS/Hadoop: Could not finalize the pending checkpoint Key: FLINK-12379 URL: https://issues.apache.org/jira/browse/FLINK-12379 Project: Flink

Re: [DISCUSS] Releasing Flink-shaded 7.0

2019-04-30 Thread Bowen Li
+1 for releasing flink-shaded 7.0 On Tue, Apr 30, 2019 at 3:13 AM Chesnay Schepler wrote: > I'm in favor creating a flink-shaded release soon. I'm not aware of any > other changes being planned for flink-shaded, so let's get this out the > door rather sooner than later. > > Note that this releas

[jira] [Created] (FLINK-12378) Consolidate FileSystem Documentation

2019-04-30 Thread Seth Wiesman (JIRA)
Seth Wiesman created FLINK-12378: Summary: Consolidate FileSystem Documentation Key: FLINK-12378 URL: https://issues.apache.org/jira/browse/FLINK-12378 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-12377) Outdated docs (Flink 0.10) for Google Compute Engine

2019-04-30 Thread Henrik (JIRA)
Henrik created FLINK-12377: -- Summary: Outdated docs (Flink 0.10) for Google Compute Engine Key: FLINK-12377 URL: https://issues.apache.org/jira/browse/FLINK-12377 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12376) GCS runtime exn: Request payload size exceeds the limit

2019-04-30 Thread Henrik (JIRA)
Henrik created FLINK-12376: -- Summary: GCS runtime exn: Request payload size exceeds the limit Key: FLINK-12376 URL: https://issues.apache.org/jira/browse/FLINK-12376 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-12375) flink-container job jar does not have read permissions

2019-04-30 Thread Adam Lamar (JIRA)
Adam Lamar created FLINK-12375: -- Summary: flink-container job jar does not have read permissions Key: FLINK-12375 URL: https://issues.apache.org/jira/browse/FLINK-12375 Project: Flink Issue Type

[jira] [Created] (FLINK-12374) Support translation from StreamExecTableSourceScan/BatchExecTableSourceScan to StreamTransformation.

2019-04-30 Thread Jing Zhang (JIRA)
Jing Zhang created FLINK-12374: -- Summary: Support translation from StreamExecTableSourceScan/BatchExecTableSourceScan to StreamTransformation. Key: FLINK-12374 URL: https://issues.apache.org/jira/browse/FLINK-12374

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-30 Thread Robert Metzger
Hi Fabian, You are right, I made a mistake. I don't think it makes sense to introduce a new permission class. This will make the life of JIRA admins unnecessarily complicated. I updated the task list: 1. I update the contribution guide 2. Update Flinkbot to close invalid PRs, and show warnings on

Your application for Season of Docs 2019 was unsuccessful

2019-04-30 Thread Andrew Chen
Thank you for your interest and enthusiasm for Season of Docs. We’re sorry to say that your organization’s application for Season of Docs was not successful this year. Because 2019 is the program’s pilot year, we were only able to accept 50 organizations out of the almost 200 applications submitte

Re: Why isn't state supported in AsyncFunction?

2019-04-30 Thread Till Rohrmann
Hi Dominik, the reason why the AsyncFunction does not support state atm is that we would to have make sure that the right key is set not only when open and asyncInvoke is set but also when a potential asynchronous callback is being executed. It would be super easy to define a callback which keeps

Why isn't state supported in AsyncFunction?

2019-04-30 Thread Dominik Wosiński
Hey, Currently when trying to get the state inside the *open* method for Flink RichAsyncFunction we will get *State is not supported in rich async functions *exception.Why doesn't AsyncFunction support state ? Thanks in advance, Best Regards, Dom.

Re: [DISCUSS] Releasing Flink-shaded 7.0

2019-04-30 Thread Chesnay Schepler
I'm in favor creating a flink-shaded release soon. I'm not aware of any other changes being planned for flink-shaded, so let's get this out the door rather sooner than later. Note that this release is not just about hadoop, but also eliminates multiple security vulnerabilities in jackson. On

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-30 Thread Fabian Hueske
Hi Robert, If I understood the decision correctly, we also need to ask Infra to make everybody an assignable user, right? Or do we want to add a new permission class "Assignable User" such that everyone still needs to ask for the right Jira permissions? Fabian Am Di., 30. Apr. 2019 um 10:46 Uhr

Re: Apply for contributor permission

2019-04-30 Thread Fabian Hueske
Hi, Welcome to the Flink community. I've given you contributor permissions for Jira. Thanks, Fabian Am Do., 25. Apr. 2019 um 05:58 Uhr schrieb Shi Quan : > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > > My JIRA ID is quan > > Best regard

[jira] [Created] (FLINK-12373) Improve checkpointing metrics

2019-04-30 Thread Gyula Fora (JIRA)
Gyula Fora created FLINK-12373: -- Summary: Improve checkpointing metrics Key: FLINK-12373 URL: https://issues.apache.org/jira/browse/FLINK-12373 Project: Flink Issue Type: New Feature C

Re: [DISCUSS] FLIP-23 Model Serving

2019-04-30 Thread Robert Metzger
Hey all, I'm wondering if somebody on the list can take a look at the PR from FLIP-23: https://github.com/apache/flink/pull/7446 On Mon, Oct 1, 2018 at 6:13 PM Rong Rong wrote: > Thanks for the contribution Boris!! I've been playing around with the basic > model for a while back and loved it.

RE: [DISCUSS] Bump required Maven version to 3.1.1 (from 3.0.3)

2019-04-30 Thread Visser, M.J.H. (Martijn)
I wouldn't consider the version bump blocking for us. We do have Redhat machines for local development, but we can manually upgrade the Maven version there. Yes, Flink is the only npm project build on those machines. There are other projects though that are using npm, so we'll probably can get

[DISCUSS] Releasing Flink-shaded 7.0

2019-04-30 Thread jincheng sun
Since flink-1.8.0, Convenience binaries that include hadoop are no longer released. More detail can be found here: https://ci.apache.org/projects/flink/flink-docs-master/release-notes/flink -1.8.html After flink 1.8 released, @Chesnay Schepler does a lot of efforts to move flink-shaded-hadoop to

Re: I want to contribute to Apache Flink

2019-04-30 Thread Fabian Hueske
Hi, Welcome to the Flink community. I gave you contributor permissions for Jira. Best, Fabian Am Di., 30. Apr. 2019 um 04:02 Uhr schrieb aihua li : > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is aiwa. > >

Re: [DISCUSS] FLIP-39: Flink ML pipeline and ML libs

2019-04-30 Thread Shaoxuan Wang
Thanks for all the feedback. @Jincheng Sun > I recommend It's better to add a detailed implementation plan to FLIP and google doc. Yes, I will add a subsection for implementation plan. @Chen Qin >Just share some of insights from operating SparkML side at scale >- map reduce may not best way to it

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-30 Thread Timo Walther
Hi Robert, thanks for taking care of this. +1 to your suggested steps. Regards, Timo Am 30.04.19 um 10:42 schrieb Robert Metzger: @Stephan: I agree. Auto-closing PRs is quite aggressive. I will only do that for PRs without JIRA ID or "[hotfix]" in the title. We can always revisit this at a la

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-30 Thread Robert Metzger
@Stephan: I agree. Auto-closing PRs is quite aggressive. I will only do that for PRs without JIRA ID or "[hotfix]" in the title. We can always revisit this at a later stage. I'm proposing the following steps: 1. I update the contribution guide 2. Update Flinkbot to close invalid PRs, and show wa

Re: kafka partitions, data locality

2019-04-30 Thread Fabian Hueske
Hi Sergey, You are right, keys are managed in key groups. Each key belongs to a key group and one or more key groups are assigned to each parallel task of an operator. Key groups are not exposed to users and the assignments of keys -> key-groups and key-groups -> tasks cannot be changed without ch

Re: Apply for confluence Wiki edit permission

2019-04-30 Thread Robert Metzger
Hey Shuiqiang, I gave you access to the Wiki. On Tue, Apr 30, 2019 at 4:29 AM Shuiqiang Chen wrote: > Hi, > > I am going to create a new FLIP for Proposal of Flink Driver. > < > https://mail.google.com/mail/u/0/#sent/KtbxLzFrKvFFhHLDqBlJXNXZrfPzVdFvjq?compose=GTvVlcSGMhgHDDqDFxNxFfWzXMKmLCvtbJNj