Memory segment error when migrating functional code from Flink 0.9 to 0.8

Hello everyone, I am implementing a graph algorithm as part of a course and I will also add it to the Flink- Gelly examples. My problem is that I started developing it in the Gelly repository, which runs on flink 0.9. It works like a charm there, but in order to test in on a cluster to see its

Re: Eclipse JDT, Java 8, lambdas

I did try the 4.5 M4 release and it did not go straightforward. -- View this message in context: http://apache-flink-incubator-mailing-list-archive.1008284.n3.nabble.com/Eclipse-JDT-Java-8-lambdas-tp3664p3688.html Sent from the Apache Flink (Incubator) Mailing List archive. mailing list

Re: Memory segment error when migrating functional code from Flink 0.9 to 0.8

Hi Andra, have you tried increasing the number of network buffers in your cluster? You can control by the configuration value: taskmanager.network.numberOfBuffers: #numberBuffers Greets, Till On Mon, Feb 9, 2015 at 9:56 AM, Andra Lungu lungu.an...@gmail.com wrote: Hello everyone, I am

Re: Memory segment error when migrating functional code from Flink 0.9 to 0.8

This is actually a problem of the number of memory segments available to the hash table for the solution set. For complex pipelines, memory currently gets too fragmented. There are two workarounds, until we do the dynamic memory management, or break it into shorter pipelines: Break the job up

Re: Eclipse JDT, Java 8, lambdas

Hey, it seems that 4.4.2 also includes the fix (https://projects.eclipse.org/projects/eclipse/releases/4.4.2/bugs) and will be released end of february. I will try Eclipse Luna SR2 RC2 today and check if it is working. Regards, Timo On 09.02.2015 10:05, Nam-Luc Tran wrote: I did try the

[jira] [Created] (FLINK-1494) Build fails on BlobCacheTest

Fabian Hueske created FLINK-1494: Summary: Build fails on BlobCacheTest Key: FLINK-1494 URL: https://issues.apache.org/jira/browse/FLINK-1494 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-1497) No documentation on MiniCluster

Sergey Dudoladov created FLINK-1497: --- Summary: No documentation on MiniCluster Key: FLINK-1497 URL: https://issues.apache.org/jira/browse/FLINK-1497 Project: Flink Issue Type: Improvement

Re: Planning Release 0.8.1

Went through the streaming commits with Gyula and assembled the ones missing. Pushing it as soon as travis passes. On Fri, Feb 6, 2015 at 2:26 PM, Robert Metzger rmetz...@apache.org wrote: It seems that quite a few important fixes still need some work until they are ready. I'll extend the

Re: Planning Release 0.8.1

Cool. I'm currently also testing my last change (kryo serializers). I think I'll start creating the release candidate in one hour. On Mon, Feb 9, 2015 at 2:24 PM, Márton Balassi balassi.mar...@gmail.com wrote: Went through the streaming commits with Gyula and assembled the ones missing.

[DISCUSS] Distributed TPC-H DataGenerator for flink-contrib

Hi, we recently added the flink-contrib module for user contributed tools etc. On one of the last weekends, I've created a distributed tpch generator, based on this libary: https://github.com/airlift/tpch (which is from a PrestoDB developer and available on Maven central). You can find my code