[jira] [Created] (FLINK-2622) Scala DataStream API does not have writeAsText method which supports WriteMode

2015-09-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2622: Summary: Scala DataStream API does not have writeAsText method which supports WriteMode Key: FLINK-2622 URL: https://issues.apache.org/jira/browse/FLINK-2622

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Maximilian Michels
Hi Behrouz, I would create a new sub-task under the original issue that introduce the ParameterTool: https://issues.apache.org/jira/browse/FLINK-1525 Cheers, Max On Fri, Sep 4, 2015 at 11:17 AM, Behrouz Derakhshan wrote: > Hi Max, > > What you said makes sense,

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Behrouz Derakhshan
Will do. Thanks, Behrouz On Fri, Sep 4, 2015 at 11:29 AM, Maximilian Michels wrote: > Hi Behrouz, > > I would create a new sub-task under the original issue that introduce > the ParameterTool: https://issues.apache.org/jira/browse/FLINK-1525 > > Cheers, > Max > > On Fri, Sep

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Robert Metzger
If you are referring to this training material ( https://github.com/dataArtisans/flink-training-exercises/blob/master/src/main/java/com/dataArtisans/flinkTraining/exercises/dataStreamJava/rideCleansing/RideCleansing.java), some of the examples are actually already using the ParameterTool. The

[jira] [Created] (FLINK-2620) StreamPartitioner is not properly initialized for shuffle and rebalance

2015-09-04 Thread Matthias J. Sax (JIRA)
Matthias J. Sax created FLINK-2620: -- Summary: StreamPartitioner is not properly initialized for shuffle and rebalance Key: FLINK-2620 URL: https://issues.apache.org/jira/browse/FLINK-2620 Project:

[jira] [Created] (FLINK-2619) Some Scala Tests not being executed by Maven

2015-09-04 Thread Chiwan Park (JIRA)
Chiwan Park created FLINK-2619: -- Summary: Some Scala Tests not being executed by Maven Key: FLINK-2619 URL: https://issues.apache.org/jira/browse/FLINK-2619 Project: Flink Issue Type: Bug

Re: Several Scala Tests not being executed by Maven

2015-09-04 Thread Chiwan Park
I just created the JIRA issue [1]. Regards, Chiwan Park [1] https://issues.apache.org/jira/browse/FLINK-2619 > On Sep 4, 2015, at 6:43 PM, Chiwan Park wrote: > > I also found the same circumstances. Although I add a fail test case in > ExecutionGraphRestartTest, `mvn

Re: [ANNOUNCE] Welcome Matthias Sax as new committer

2015-09-04 Thread Matthias J. Sax
Thanks for the very warm welcome! I am happy to work on Flink as a committer now :) Furthermore, now I can truly claim: Trust me, I am a squirrel. Looking forward to meet other committers and squirrels from the mailing list in person at Flink Forward. Happy hacking. -Matthias On 09/02/2015

[jira] [Created] (FLINK-2621) Add support for positional arguments to ParameterTool

2015-09-04 Thread Behrouz Derakhshan (JIRA)
Behrouz Derakhshan created FLINK-2621: - Summary: Add support for positional arguments to ParameterTool Key: FLINK-2621 URL: https://issues.apache.org/jira/browse/FLINK-2621 Project: Flink

Updating the flink JAR with a single module

2015-09-04 Thread Niklas Semmler
Hi there, I have a question on the setup of the development environment for flink. Is it possible to update the big JAR file (flink-dist/target/.../lib/flink-dist-0.9-SNAPSHOT.jar), which flink apparently uses for deployment, with a single module (flink-runtime)? Recompiling all of the

Re: Several Scala Tests not being executed by Maven

2015-09-04 Thread Chiwan Park
I also found the same circumstances. Although I add a fail test case in ExecutionGraphRestartTest, `mvn clean verify` doesn’t fail. I will create an issue covered this. Regards, Chiwan Park > On Aug 29, 2015, at 10:13 PM, Stephan Ewen wrote: > > Hi! > > I found quite a

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Behrouz Derakhshan
Hi Max, What you said makes sense, for "ParameterTool doesn't seem to support positional arguments :) but we could fix that." should we create a separate ticket or should it also be part of FLINK-2021 ? BR, Behrouz On Fri, Sep 4, 2015 at 10:55 AM, Maximilian Michels wrote: >

Re: Updating the flink JAR with a single module

2015-09-04 Thread Fabian Hueske
Hi Niklas, if you only want to update individual submodules you can do: cd flink-runtime // build this submodule mvn -DskipTests clean install // will put the new flink-runtime jar into the local Maven repository cd ../flink-dist mvn -DskipTests clean install // will fetch all required

Re: Updating the flink JAR with a single module

2015-09-04 Thread Matthias J. Sax
One more remark on this: You need to be a little bit more careful. This approach works only, if the initially changed module has no other dependent modules. For example, flink-clients also depends on flink-runtime and thus, you *might* need to rebuild flink-clients, too, before building

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Behrouz Derakhshan
Yes, I was referring mostly to blog posts and other websites and was wondering if breaking them is an issue or not. I have already created a subtask to add support for positional arguments ( FLINK-2621 ), so the examples would be backward

[jira] [Created] (FLINK-2624) RabbitMQ source / sink should participate in checkpointing

2015-09-04 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-2624: --- Summary: RabbitMQ source / sink should participate in checkpointing Key: FLINK-2624 URL: https://issues.apache.org/jira/browse/FLINK-2624 Project: Flink Issue

[jira] [Created] (FLINK-2623) Extend API completeness check to check signatures

2015-09-04 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-2623: Summary: Extend API completeness check to check signatures Key: FLINK-2623 URL: https://issues.apache.org/jira/browse/FLINK-2623 Project: Flink Issue Type:

Re: Updating the flink JAR with a single module

2015-09-04 Thread Niklas Semmler
Hello Fabian, Hello Matthias, Thank you very much! I am not making API changes at the moment, so I should be fine with this approach. Unfortunately the command "mvn -DskipTests clean install" in the main folder didn't work for me (it hanged in the middle of the operation), so I am using a

Re: Advice on [FLINK-2021]: Rework examples to use new ParameterTool

2015-09-04 Thread Maximilian Michels
Hi Behrouz, Thanks for starting the discussion. If I understand your question correctly, you are asking if it breaks the training or other external material if we convert the Flink examples to make use of the ParameterTool? We could make the changes such that the examples will accept the same