[jira] [Created] (FLINK-15823) Sync download page translation

2020-01-30 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15823: Summary: Sync download page translation Key: FLINK-15823 URL: https://issues.apache.org/jira/browse/FLINK-15823 Project: Flink Issue Type:

[jira] [Created] (FLINK-15822) Rethink the necessity of the internal Service

2020-01-30 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15822: Summary: Rethink the necessity of the internal Service Key: FLINK-15822 URL: https://issues.apache.org/jira/browse/FLINK-15822 Project: Flink Issue Type:

Re: REST Monitoring Savepoint failed

2020-01-30 Thread Ramya Ramamurthy
Hi Till, I am using flink 1.7. This is my observation. a) I first trigger a savepoint. this is stored on my Google cloud storage. b) When i invoke the rescale HTTP API, i get the error telling savepoints dir is not configured. But post triggering a), i could verify the savepoint directory

Re: REST Monitoring Savepoint failed

2020-01-30 Thread Ramya Ramamurthy
Hi Till, I am using flink 1.7. This is my observation. a) I first trigger a savepoint. this is stored on my Google cloud storage. b) When i invoke the rescale HTTP API, i get the error telling savepoints dir is not configured. But post triggering a), i could verify the savepoint directory

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Tzu-Li (Gordon) Tai
+1 (binding) Cheers, Gordon On Fri, Jan 31, 2020 at 2:16 PM Jingsong Li wrote: > +1 (non-binding) > > Official docker support really looks good to me. > > Best, > Jingsong Lee > > On Fri, Jan 31, 2020 at 12:55 AM aihua li wrote: > > > +1 (non-binding) > > > > > 2020年1月30日 下午7:36,Igal Shilman

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Jingsong Li
+1 (non-binding) Official docker support really looks good to me. Best, Jingsong Lee On Fri, Jan 31, 2020 at 12:55 AM aihua li wrote: > +1 (non-binding) > > > 2020年1月30日 下午7:36,Igal Shilman 写道: > > > > +1 (non-binding) > > > > On Thu, Jan 30, 2020 at 12:18 PM Yu Li wrote: > > > >> +1

[jira] [Created] (FLINK-15821) Allow configuring Kafka partition / topic discovery in StateFun Kafka ingress

2020-01-30 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15821: --- Summary: Allow configuring Kafka partition / topic discovery in StateFun Kafka ingress Key: FLINK-15821 URL: https://issues.apache.org/jira/browse/FLINK-15821

[jira] [Created] (FLINK-15820) Allow disabling / enabling auto offset committing to Kafka in StateFun Kafka ingress

2020-01-30 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15820: --- Summary: Allow disabling / enabling auto offset committing to Kafka in StateFun Kafka ingress Key: FLINK-15820 URL:

[jira] [Created] (FLINK-15819) Add more StateFun Kafka ingress features that are already available in FlinkKafkaConsumer

2020-01-30 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15819: --- Summary: Add more StateFun Kafka ingress features that are already available in FlinkKafkaConsumer Key: FLINK-15819 URL:

[jira] [Created] (FLINK-15818) Add Kafka ingress startup position config to YAML support

2020-01-30 Thread Tzu-Li (Gordon) Tai (Jira)
Tzu-Li (Gordon) Tai created FLINK-15818: --- Summary: Add Kafka ingress startup position config to YAML support Key: FLINK-15818 URL: https://issues.apache.org/jira/browse/FLINK-15818 Project:

[jira] [Created] (FLINK-15817) Kubernetes Resource leak while deployment exception happens

2020-01-30 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15817: Summary: Kubernetes Resource leak while deployment exception happens Key: FLINK-15817 URL: https://issues.apache.org/jira/browse/FLINK-15817 Project: Flink

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-30 Thread felixzheng zheng
Congrats! Benchao Li 于2020年1月31日周五 上午10:02写道: > Congratulations!! > > Biao Liu 于2020年1月29日周三 下午9:25写道: > > > Congrats! > > > > On Wed, Jan 29, 2020 at 10:37 aihua li wrote: > > > > > Congratulations Yu LI, well deserved. > > > > > > > 2020年1月23日 下午4:59,Stephan Ewen 写道: > > > > > > > > Hi

Re: [ANNOUNCE] Yu Li became a Flink committer

2020-01-30 Thread Benchao Li
Congratulations!! Biao Liu 于2020年1月29日周三 下午9:25写道: > Congrats! > > On Wed, Jan 29, 2020 at 10:37 aihua li wrote: > > > Congratulations Yu LI, well deserved. > > > > > 2020年1月23日 下午4:59,Stephan Ewen 写道: > > > > > > Hi all! > > > > > > We are announcing that Yu Li has joined the rank of Flink

[jira] [Created] (FLINK-15816) Limit the maximum length of the value of kubernetes.cluster-id configuration option

2020-01-30 Thread Canbin Zheng (Jira)
Canbin Zheng created FLINK-15816: Summary: Limit the maximum length of the value of kubernetes.cluster-id configuration option Key: FLINK-15816 URL: https://issues.apache.org/jira/browse/FLINK-15816

[jira] [Created] (FLINK-15815) Disable inclusion of original pom under META-INF/maven

2020-01-30 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15815: Summary: Disable inclusion of original pom under META-INF/maven Key: FLINK-15815 URL: https://issues.apache.org/jira/browse/FLINK-15815 Project: Flink

[jira] [Created] (FLINK-15814) Log warning when StreamingFileSink is used with bulk output formats and an ambiguous S3 scheme

2020-01-30 Thread Seth Wiesman (Jira)
Seth Wiesman created FLINK-15814: Summary: Log warning when StreamingFileSink is used with bulk output formats and an ambiguous S3 scheme Key: FLINK-15814 URL: https://issues.apache.org/jira/browse/FLINK-15814

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread aihua li
+1 (non-binding) > 2020年1月30日 下午7:36,Igal Shilman 写道: > > +1 (non-binding) > > On Thu, Jan 30, 2020 at 12:18 PM Yu Li wrote: > >> +1 (non-binding) >> >> Best Regards, >> Yu >> >> >> On Thu, 30 Jan 2020 at 18:35, Arvid Heise wrote: >> >>> +1 (non-binding) >>> >>> On Thu, Jan 30, 2020 at

Re: REST Monitoring Savepoint failed

2020-01-30 Thread Till Rohrmann
Hi Ramya, I think this message is better suited for the user ML list. Which version of Flink are you using? Have you checked the Flink logs to see whether they contain anything suspicious? Cheers, Till On Thu, Jan 30, 2020 at 1:09 PM Ramya Ramamurthy wrote: > Hi, > > I am trying to

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2020-01-30 Thread Till Rohrmann
Would it be easier if FLIP-75 would be the umbrella FLIP and we would vote on the individual improvements as sub FLIPs? Decreasing the scope should make things easier. Cheers, Till On Thu, Jan 30, 2020 at 2:35 PM Robert Metzger wrote: > Thanks a lot for this work! I believe the web UI is very

Re: [DISCUSS] FLIP-75: Flink Web UI Improvement Proposal

2020-01-30 Thread Robert Metzger
Thanks a lot for this work! I believe the web UI is very important, in particular to new users. I'm very happy to see that you are putting effort into improving the visibility into Flink through the proposed changes. I can not judge if all the changes make total sense, but the discussion has been

Re: [RESULT] [VOTE] Release 1.9.2, release candidate #1

2020-01-30 Thread Patrick Lucas
A pull request to update the Flink Docker images to 1.9.2 is open: https://github.com/docker-flink/docker-flink/pull/95 (The "pull" build failed because it rejects changes to the generated Dockerfiles. I would like to improve this after this repo has been contributed to Apache.) On Thu, Jan 30,

REST Monitoring Savepoint failed

2020-01-30 Thread Ramya Ramamurthy
Hi, I am trying to dynamically increase the parallelism of the job. In the process of it, while I am trying to trigger the savepoint, i get the following error. Any help would be appreciated. The URL triggered is : http://stgflink.ssdev.in:8081/jobs/2865c1f40340bcb19a88a01d6ef8ff4f/savepoints/ {

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Igal Shilman
+1 (non-binding) On Thu, Jan 30, 2020 at 12:18 PM Yu Li wrote: > +1 (non-binding) > > Best Regards, > Yu > > > On Thu, 30 Jan 2020 at 18:35, Arvid Heise wrote: > > > +1 (non-binding) > > > > On Thu, Jan 30, 2020 at 11:10 AM Fabian Hueske > wrote: > > > > > Hi Ismael, > > > > > > > Just one

Re: connection timeout during shuffle initialization

2020-01-30 Thread Piotr Nowojski
One more thing. Could you create a JIRA ticket for this issue? We could also move the discussion there. Piotrek > On 30 Jan 2020, at 12:14, Piotr Nowojski wrote: > > Hi, > >>> I think it's perfectly ok to perform IO ops in netty threads, > (…) >>> Removing synchronization *did solve* the

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Yu Li
+1 (non-binding) Best Regards, Yu On Thu, 30 Jan 2020 at 18:35, Arvid Heise wrote: > +1 (non-binding) > > On Thu, Jan 30, 2020 at 11:10 AM Fabian Hueske wrote: > > > Hi Ismael, > > > > > Just one question, we will be able to still be featured as an official > > docker image in this case? > >

Re: connection timeout during shuffle initialization

2020-01-30 Thread Piotr Nowojski
Hi, >> I think it's perfectly ok to perform IO ops in netty threads, (…) >> Removing synchronization *did solve* the problem for me, because it >> allows flink to leverage the whole netty event loop pool and it's ok to >> have a single thread blocked for a little while (we still can accept >>

[jira] [Created] (FLINK-15813) Set default value of jobmanager.execution.failover-strategy to region

2020-01-30 Thread Till Rohrmann (Jira)
Till Rohrmann created FLINK-15813: - Summary: Set default value of jobmanager.execution.failover-strategy to region Key: FLINK-15813 URL: https://issues.apache.org/jira/browse/FLINK-15813 Project:

[jira] [Created] (FLINK-15812) HistoryServer archiving is done in Dispatcher main thread

2020-01-30 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15812: Summary: HistoryServer archiving is done in Dispatcher main thread Key: FLINK-15812 URL: https://issues.apache.org/jira/browse/FLINK-15812 Project: Flink

[jira] [Created] (FLINK-15811) StreamSourceOperatorWatermarksTest#testNoMaxWatermarkOnAsyncCancel fails on Travis

2020-01-30 Thread Chesnay Schepler (Jira)
Chesnay Schepler created FLINK-15811: Summary: StreamSourceOperatorWatermarksTest#testNoMaxWatermarkOnAsyncCancel fails on Travis Key: FLINK-15811 URL: https://issues.apache.org/jira/browse/FLINK-15811

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Arvid Heise
+1 (non-binding) On Thu, Jan 30, 2020 at 11:10 AM Fabian Hueske wrote: > Hi Ismael, > > > Just one question, we will be able to still be featured as an official > docker image in this case? > > Yes, that's the goal. We still want to publish official DockerHub images > for every Flink release. >

Re: [VOTE] Integrate Flink Docker image publication into Flink release process

2020-01-30 Thread Fabian Hueske
Hi Ismael, > Just one question, we will be able to still be featured as an official docker image in this case? Yes, that's the goal. We still want to publish official DockerHub images for every Flink release. Since we're mainly migrating the docker-flink/docker-flink repo to apache/flink-docker,

[ANNOUNCE] Community Discounts for Flink Forward SF 2020 Registrations

2020-01-30 Thread Fabian Hueske
Hi everyone, The registration for Flink Forward SF 2020 is open now! Flink Forward San Francisco 2020 will take place from March 23rd to 25th. The conference will start with one day of training and continue with two days of keynotes and talks. We would like to invite you to join the Apache Flink

Re: [VOTE] Release 1.10.0, release candidate #1

2020-01-30 Thread Piotr Nowojski
Hi, Thanks for creating this RC Gary & Yu. +1 (non-binding) from my side Because of instabilities during the testing period, I’ve manually tested some jobs (and streaming examples) on an EMR cluster, writing to S3 using newly unshaded/not relocated S3 plugin. Everything seems to works fine.

Re: [VOTE] Release 1.9.2, release candidate #1

2020-01-30 Thread Kostas Kloudas
Hi all, +1 (binding) - Compiled locally - Built simple jobs using quickstart - Submitted on Yarn both per-job and session cluster Cheers, Kostas On Thu, Jan 30, 2020 at 6:26 AM Hequn Cheng wrote: > > Hi everyone, > > Thanks a lot for your checking and voting for the release! > I’ll summarize