[jira] [Created] (FLINK-3586) Risk of data overflow while use sum/count to calculate AVG value

2016-03-07 Thread Chengxiang Li (JIRA)
Chengxiang Li created FLINK-3586: Summary: Risk of data overflow while use sum/count to calculate AVG value Key: FLINK-3586 URL: https://issues.apache.org/jira/browse/FLINK-3586 Project: Flink

Re: Machine Learning on Apache Fink

2016-03-07 Thread Dmitriy Lyubimov
still in the works (for mahout). but soon. On Sat, Jan 9, 2016 at 3:46 AM, Ashutosh Kumar wrote: > I see lot of study materials and even book available for ml on spark. Spark > seems to be more mature for analytics related work as of now. Please > correct me if I am wrong. As I have already buil

Re: Tuple performance and the curious JIT compiler

2016-03-07 Thread Greg Hogan
The issue is not with the Tuple hierarchy (running Gelly examples had no effect on runtime, and as you note there aren't any subclass overrides) but with CopyableValue. I had been using IntValue exclusively but had switched to using LongValue for graph generation. CopyableValueComparator and Copyab

Dynamically repartitioned sources

2016-03-07 Thread Maxim
I'm looking at using Flink for a streaming project that has to use some internal systems as event sources. They are very similar to Kafka in their semantic. The data is partitioned and each partition can be replayed from a specified offset. The first system creates and deletes such partitions dyna

Re: Remote TaskManager Connection Problem

2016-03-07 Thread Deepak Jha
Hi Stephan, Thanks for the response. I was able to resolve the issue, I was using localhost in jobmanager name instead of container name... There were few more issues which I would like to mention - I'm using S3 for storage/checkpoint in Flink HA mode, I realized that I have to set fs.hdfs.hadoopco

[jira] [Created] (FLINK-3585) Deploy scripts don't support spaces in paths

2016-03-07 Thread Maximilian Michels (JIRA)
Maximilian Michels created FLINK-3585: - Summary: Deploy scripts don't support spaces in paths Key: FLINK-3585 URL: https://issues.apache.org/jira/browse/FLINK-3585 Project: Flink Issue Ty

[jira] [Created] (FLINK-3584) WebInterface: Broken graphical display in Chrome

2016-03-07 Thread Niels Basjes (JIRA)
Niels Basjes created FLINK-3584: --- Summary: WebInterface: Broken graphical display in Chrome Key: FLINK-3584 URL: https://issues.apache.org/jira/browse/FLINK-3584 Project: Flink Issue Type: Bug

Re: Tuple performance and the curious JIT compiler

2016-03-07 Thread Stephan Ewen
Hi Greg! Sounds very interesting. Do you have a hunch what "virtual" Tuple methods are being used that become less jit-able? In many cases, tuples use only field accesses (like "vakle.f1") in the user functions. I have to dig into the serializers, to see if they could suffer from that. The "getF