Re: [VOTE] Release Apache Flink 0.8.1 (RC2)

+1 I've checked the RC on a HDP 2.2 sandbox (using Flink on YARN). Also ran wordcount on it. The hadoop1 quickstarts have the correct version set (that was an issue with the RC before) On Mon, Feb 16, 2015 at 5:59 PM, Fabian Hueske fhue...@gmail.com wrote: +1 (forgot that earlier) 2015-02-16

Re: [VOTE] Release Apache Flink 0.8.1 (RC2)

+1 Checked signatures, checksums, pom. Built from src, run local examples. On Tue, Feb 17, 2015 at 11:59 PM, Robert Metzger rmetz...@apache.org wrote: +1 I've checked the RC on a HDP 2.2 sandbox (using Flink on YARN). Also ran wordcount on it. The hadoop1 quickstarts have the correct

Re: Scala Style Template

Oh, since we are using tabs I think they are counted as one character? On Tuesday, February 17, 2015, Robert Metzger rmetz...@apache.org wrote: I agree with Stephan that we should remove the scalastyle rule enforcing lines of 100 characters length. On Mon, Jan 5, 2015 at 10:21 AM, Henry

Re: Scala Style Template

Sorry Robert and all, pressed Send button too early =( One of the main reasons to keep the max 100 chars line (or 120) is to make sure that the code is readable an understandable, which in Scala you can easily get the code to be complicated and in a single line. - Henry [1]

Re: [DISCUSS] Create a shaded Hadoop fat jar to resolve library version conflicts

I think the way we shaded Guava is a problem for the way IntelliJ uses maven (compile dependency projects, not package them). Since we do not apply relocation to our code for this, it should have no effect on the IDE usability. On Tue, Feb 17, 2015 at 3:37 PM, Ufuk Celebi u...@apache.org wrote:

[jira] [Created] (FLINK-1573) Add per-job metrics to flink.

Robert Metzger created FLINK-1573: - Summary: Add per-job metrics to flink. Key: FLINK-1573 URL: https://issues.apache.org/jira/browse/FLINK-1573 Project: Flink Issue Type: Sub-task

Re: Scala Style Template

I agree with Stephan that we should remove the scalastyle rule enforcing lines of 100 characters length. On Mon, Jan 5, 2015 at 10:21 AM, Henry Saputra henry.sapu...@gmail.com wrote: @Stephan - sure I could work on it. Been wanting to do it for a while. No, it is not the checkstyle issue.

Re: [DISCUSS] Create a shaded Hadoop fat jar to resolve library version conflicts

On 17 Feb 2015, at 09:40, Stephan Ewen se...@apache.org wrote: Hi everyone! We have been time and time again struck by the problem that Hadoop bundles many dependencies in certain versions, that conflict either with versions of the dependencies we use, or with versions that users use.

Re: [DISCUSS] Dedicated streaming mode and start scripts

+1 On Tue, Feb 17, 2015 at 1:34 PM, Till Rohrmann trohrm...@apache.org wrote: +1 On Tue, Feb 17, 2015 at 1:34 PM, Kostas Tzoumas ktzou...@apache.org wrote: +1 On Tue, Feb 17, 2015 at 12:14 PM, Márton Balassi mbala...@apache.org wrote: When it comes to the current use cases I'm for this

[jira] [Created] (FLINK-1575) JobManagerConnectionTest.testResolveUnreachableActorRemoteHost times out on travis

Robert Metzger created FLINK-1575: - Summary: JobManagerConnectionTest.testResolveUnreachableActorRemoteHost times out on travis Key: FLINK-1575 URL: https://issues.apache.org/jira/browse/FLINK-1575

[jira] [Created] (FLINK-1576) Change the examples to be consistent with the other Flink examples

Andra Lungu created FLINK-1576: -- Summary: Change the examples to be consistent with the other Flink examples Key: FLINK-1576 URL: https://issues.apache.org/jira/browse/FLINK-1576 Project: Flink

Re: [DISCUSS] Dedicated streaming mode and start scripts

When it comes to the current use cases I'm for this separation. @Ufuk: As Gyula has already pointed out with the current design of integration it should not be a problem. Even if we submitted programs to the wrong clusters it would only cause performance issues. Eventually it would be nice to

[jira] [Created] (FLINK-1562) Introduce retries for fetching data from the BLOB manager

Stephan Ewen created FLINK-1562: --- Summary: Introduce retries for fetching data from the BLOB manager Key: FLINK-1562 URL: https://issues.apache.org/jira/browse/FLINK-1562 Project: Flink Issue

[jira] [Created] (FLINK-1564) Make sure BLOB client downloads files only once

Stephan Ewen created FLINK-1564: --- Summary: Make sure BLOB client downloads files only once Key: FLINK-1564 URL: https://issues.apache.org/jira/browse/FLINK-1564 Project: Flink Issue Type: Bug

Re: [DISCUSS] Dedicated streaming mode and start scripts

So the current setup is to share results between the two apis by files. So I dont see any reason why this couldnt work with the 2 cluster setup. It makes deployment a little trickier but still feasible. On Tue, Feb 17, 2015 at 11:55 AM, Ufuk Celebi u...@apache.org wrote: I think this separation

[DISCUSS] Dedicated streaming mode and start scripts

Hi everyone! What do you think about making the streaming execution mode of the system explicit? That means that people start a Flink cluster explicitly in Batch mode or in Streaming mode. The rational behind this idea is that I am not sure how batch and streaming clusters are really shared in a

[jira] [Created] (FLINK-1571) Add failure-case tests for blocking data exchange

Ufuk Celebi created FLINK-1571: -- Summary: Add failure-case tests for blocking data exchange Key: FLINK-1571 URL: https://issues.apache.org/jira/browse/FLINK-1571 Project: Flink Issue Type:

Re: [DISCUSS] Dedicated streaming mode and start scripts

+1 On Tue, Feb 17, 2015 at 1:34 PM, Kostas Tzoumas ktzou...@apache.org wrote: +1 On Tue, Feb 17, 2015 at 12:14 PM, Márton Balassi mbala...@apache.org wrote: When it comes to the current use cases I'm for this separation. @Ufuk: As Gyula has already pointed out with the current design of

[jira] [Created] (FLINK-1570) Add failure-case tests for pipelined data exchange

Ufuk Celebi created FLINK-1570: -- Summary: Add failure-case tests for pipelined data exchange Key: FLINK-1570 URL: https://issues.apache.org/jira/browse/FLINK-1570 Project: Flink Issue Type: