Performance and Latency Chart for Flink

2016-09-15 Thread Chawla,Sumit
Hi Is there any performance run that is done for each Flink release? Or you are aware of any third party evaluation of performance metrics for Flink? I am interested in seeing how performance has improved over release to release, and performance vs other competitors. Regards Sumit Chawla

[jira] [Created] (FLINK-4627) Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties

2016-09-15 Thread Tzu-Li (Gordon) Tai (JIRA)
Tzu-Li (Gordon) Tai created FLINK-4627: -- Summary: Use Flink's PropertiesUtil in Kinesis connector to extract typed values from config properties Key: FLINK-4627 URL:

Re: Gelly Library. Need an example

2016-09-15 Thread Vasiliki Kalavri
Hi, thanks for looking into this Till! I'm not quite sure what the algorithm behavior should be when the vertex value is null (probably skip the record?). Let's wait for Martin's input. Cheers, -V. On 15 September 2016 at 19:19, Olga Golovneva wrote: > Hi Till, > > Thanks

Re: Gelly Library. Need an example

2016-09-15 Thread Till Rohrmann
Hi Olga, it’s indeed an error in Flink’s Summarization algorithm. The problem is the following: The vertex group value of the VertexGroupItem is null in the VertexGroupReducer. This works in the SummarizationIT case because the vertex value is of type String and the StringSerializer can deal with

[jira] [Created] (FLINK-4624) Gelly's summarization algorithm cannot deal with null vertex group values

2016-09-15 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-4624: Summary: Gelly's summarization algorithm cannot deal with null vertex group values Key: FLINK-4624 URL: https://issues.apache.org/jira/browse/FLINK-4624 Project:

Re: Flink HA on AWS: Network related issue

2016-09-15 Thread Deepak Jha
Hi Till, There is a way to shutdown actor systems by setting taskmanager.maxRegistrationDuration to a reasonable duration (eg: 900 seconds). Default value sets it to Inf. In this case I noticed that Taskmanager goes down and runit restarts the service and it gets connected with Jobmanager. As I

[jira] [Created] (FLINK-4623) Create Physical Execution Plan of a DataStream

2016-09-15 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4623: --- Summary: Create Physical Execution Plan of a DataStream Key: FLINK-4623 URL: https://issues.apache.org/jira/browse/FLINK-4623 Project: Flink Issue Type:

Re: build error

2016-09-15 Thread Ivan Mushketyk
Hi Ameet, The new issue that you are facing is caused by a build-time validator that checks if every file in Flink sources has an Apache license text in it. It suggests that there are two files without a proper license: * build_log_maven_flink * log.oracle.jdk If you remove them or move from the

Re: Gelly Library. Need an example

2016-09-15 Thread Olga Golovneva
Hi Till, I've created a simple (Java) example to show you what's going on. The code is in attachment and shown below. This example creates simple graph with Double EV and Long VV. Then it runs Summarization, that should compute a condensed version of the input graph by grouping vertices and edges

[jira] [Created] (FLINK-4622) CLI help message should include 'savepoint' action

2016-09-15 Thread Scott Kidder (JIRA)
Scott Kidder created FLINK-4622: --- Summary: CLI help message should include 'savepoint' action Key: FLINK-4622 URL: https://issues.apache.org/jira/browse/FLINK-4622 Project: Flink Issue Type:

Re: build error

2016-09-15 Thread Till Rohrmann
I agree with Ivan. This does not look like a Flink specific problem. Have you tried building other projects with your maven and JDK version? Cheers, Till On Thu, Sep 15, 2016 at 2:15 PM, Ivan Mushketyk wrote: > Hi Ameet, > > This seems like a possible JVM bug. > Could

Re: Gelly Library. Need an example

2016-09-15 Thread Till Rohrmann
Hi Olga, can you provide us with a little bit more details about the problem. The full stack trace of the exception and the program you're trying to run would be helpful. Cheers, Till On Wed, Sep 14, 2016 at 9:49 PM, Olga Golovneva wrote: > Hi devs, > > Do you know if

Re: build error

2016-09-15 Thread Ivan Mushketyk
Hi Ameet, This seems like a possible JVM bug. Could you try to build Flink using OracleJDK instead? Best regards, Ivan. On Thu, 15 Sep 2016 at 12:30 Ameet BD wrote: > Hi All, > > I am trying to build latest Flink code from github.com by running command > > $ git clone

Re: ML contributions

2016-09-15 Thread Theodore Vasiloudis
That's great to hear Gabor, I'll definitely help out with the review process, and I hope we can get some committer to look into these and other outstanding PRs for FlinkML. On Thu, Sep 15, 2016 at 11:59 AM, Till Rohrmann wrote: > Great to hear Gabor :-) I hope that the

build error

2016-09-15 Thread Ameet BD
Hi All, I am trying to build latest Flink code from github.com by running command $ git clone https://github.com/apache/flink After that I am running command $ mvn clean install -DskipTests The build fails I have attached the build log. Kindly let me know why it may be failing. Regards. Ameet

Re: Savepoint and restart in the same command?

2016-09-15 Thread Till Rohrmann
Hi Ron, Konstantin is absolutely right. One of the missing features is an atomic stop with savepoint operation to shut down a job in a clean manner. We will hopefully have this soon. Cheers, Till On Tue, Sep 13, 2016 at 11:53 AM, Konstantin Knauf < konstantin.kn...@tngtech.com> wrote: > Hi

Re: ML contributions

2016-09-15 Thread Till Rohrmann
Great to hear Gabor :-) I hope that the community will help out with reviewing of the algorithms so that we can give quick feedback. Looking forward to your contributions. Cheers, Till On Mon, Sep 12, 2016 at 10:34 AM, Gábor Hermann wrote: > Hey all, > > We are planning

[jira] [Created] (FLINK-4621) Improve decimal literals of SQL API

2016-09-15 Thread Timo Walther (JIRA)
Timo Walther created FLINK-4621: --- Summary: Improve decimal literals of SQL API Key: FLINK-4621 URL: https://issues.apache.org/jira/browse/FLINK-4621 Project: Flink Issue Type: Improvement