[jira] [Created] (FLINK-4718) Confusing label in Parallel Streams Diagram

2016-09-29 Thread Neil Derraugh (JIRA)
Neil Derraugh created FLINK-4718: Summary: Confusing label in Parallel Streams Diagram Key: FLINK-4718 URL: https://issues.apache.org/jira/browse/FLINK-4718 Project: Flink Issue Type: Bug

Re: Use specific Task Manager for heavy computations

2016-09-29 Thread amir bahmanyari
Looks like what I am currently doing, or at least close.No need to copy the big file on every node.Copy on one node. Read the data, and send it to a Kafka cluster using KafkaProducer() object.Use KafkaIO() (in case its a Beam app). Deploy to the node where the JM is running.It will be executed

currentLowWatermark metric not reported for all tasks?

2016-09-29 Thread dan bress
I am trying to measure the currentLowWatermark throughout my dataflow, but I am not seeing it for tasks with sources. For those tasks I see these metrics: lastCheckpointSize numBytesInLocal numBytesInRemote numBytesOut why am I not seeing currentLowWatermark on these tasks? Thanks! Dan

Does the job name affect checkpointing?

2016-09-29 Thread dan bress
If I deploy a job to Flink called "A"(set my streamExecutionEnvironment.execute("A"), that checkpoints state. Then I cancel "A" and deploy the same job but call it "B", will it pick up A's state? Or is checkpointing key'd by the job name? The reason I ask is I would like a way to reflect the

[jira] [Created] (FLINK-4717) Naive version of atomic stop signal with savepoint

2016-09-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4717: Summary: Naive version of atomic stop signal with savepoint Key: FLINK-4717 URL: https://issues.apache.org/jira/browse/FLINK-4717 Project: Flink Issue Type:

Re: Releasing Flink 1.1.3

2016-09-29 Thread Stephan Ewen
+1 for including - FLINK-4311 - FLINK-4702 (https://github.com/apache/flink/pull/2574) - FLINK-4329 (https://github.com/apache/flink/pull/2546) On Thu, Sep 29, 2016 at 3:38 PM, Ufuk Celebi wrote: > +1... Personally, I'm a big fan of frequent bugfix releases :-) > > A

[jira] [Created] (FLINK-4716) Add trigger full recovery button to web UI

2016-09-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4716: Summary: Add trigger full recovery button to web UI Key: FLINK-4716 URL: https://issues.apache.org/jira/browse/FLINK-4716 Project: Flink Issue Type:

[jira] [Created] (FLINK-4715) TaskManager should commit suicide after cancellation failure

2016-09-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4715: Summary: TaskManager should commit suicide after cancellation failure Key: FLINK-4715 URL: https://issues.apache.org/jira/browse/FLINK-4715 Project: Flink

[jira] [Created] (FLINK-4713) Implementing ranking evaluation scores for recommender systems

2016-09-29 Thread JIRA
Domokos Miklós Kelen created FLINK-4713: --- Summary: Implementing ranking evaluation scores for recommender systems Key: FLINK-4713 URL: https://issues.apache.org/jira/browse/FLINK-4713 Project:

[jira] [Created] (FLINK-4712) Implementing ranking predictions for ALS

2016-09-29 Thread JIRA
Domokos Miklós Kelen created FLINK-4712: --- Summary: Implementing ranking predictions for ALS Key: FLINK-4712 URL: https://issues.apache.org/jira/browse/FLINK-4712 Project: Flink Issue

[jira] [Created] (FLINK-4711) TaskManager can crash due to failing onPartitionStateUpdate call

2016-09-29 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4711: Summary: TaskManager can crash due to failing onPartitionStateUpdate call Key: FLINK-4711 URL: https://issues.apache.org/jira/browse/FLINK-4711 Project: Flink

Re: Releasing Flink 1.1.3

2016-09-29 Thread Ufuk Celebi
+1... Personally, I'm a big fan of frequent bugfix releases :-) A user already reported running into the file source problem and having a very hard time debugging it. This would be good to fix asap. – Ufuk On Thu, Sep 29, 2016 at 3:20 PM, Fabian Hueske wrote: > Sounds good

Re: Releasing Flink 1.1.3

2016-09-29 Thread Fabian Hueske
Sounds good to me. Can we include a fix for FLINK-4311 as well? There is a PR [1] which is good to go IMO modulo resetting the updated HBase dependency for the 1.1.3 fix. For 1.2.0 we should start a discussion about bumping the version. Cheers, Fabian [1]

Releasing Flink 1.1.3

2016-09-29 Thread Stephan Ewen
Hi all! I wanted to bring up having a Flink 1.1.3 bugfix release in the near future. There are some fixed right now in the release-1.1 branch already (merging windows, optimizer union, ...) and there is a major bug that is currently fixed in the master:

Re: flink 1.1.2 RichFunction not working

2016-09-29 Thread Stephan Ewen
Sorry for that inconvenience. You are right about mentioning that in the release notes (adding it even after the release). We'll take that as feedback for the next release. On Tue, Sep 27, 2016 at 9:42 PM, Chen Bekor wrote: > thanks. worth mentioning in the release

Re: [DISCUSS] Mesos Dispatcher (FF2016)

2016-09-29 Thread Till Rohrmann
I agree with Max since it hard to foresee when Flip-6 is really done. Cheers, Till On Wed, Sep 28, 2016 at 4:24 PM, Maximilian Michels wrote: > Hi Eron, > > Great to see so much progress on the Mesos implementation! Thank you > for sharing the code with us. > > I'm not

[jira] [Created] (FLINK-4710) Remove transitive Guice dependency from Hadoop

2016-09-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4710: --- Summary: Remove transitive Guice dependency from Hadoop Key: FLINK-4710 URL: https://issues.apache.org/jira/browse/FLINK-4710 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-4709) InputStreamFSInputWrapper does not close wrapped stream

2016-09-29 Thread Holger Frydrych (JIRA)
Holger Frydrych created FLINK-4709: -- Summary: InputStreamFSInputWrapper does not close wrapped stream Key: FLINK-4709 URL: https://issues.apache.org/jira/browse/FLINK-4709 Project: Flink

[jira] [Created] (FLINK-4708) Scope Mini Kerberos Cluster dependencies as test dependencies

2016-09-29 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4708: --- Summary: Scope Mini Kerberos Cluster dependencies as test dependencies Key: FLINK-4708 URL: https://issues.apache.org/jira/browse/FLINK-4708 Project: Flink