Re: Multilang Support on Flink

Hi Welly, There is a protocol for communicating with other processes. This is reflected in flink-language-binding-generic module. I'm not aware how Spark or Storm communication protocols work but this protocol is rather low level. Cheers, Max On Fri, Nov 13, 2015 at 9:49 AM, Welly Tambunan

Apache Flink Forward Videos

Hi All, I've just notice that the video has already available for this one. http://flink-forward.org/?post_type=session Another weekend gift for all. Cheers -- Welly Tambunan Triplelands http://weltam.wordpress.com http://www.triplelands.com

Re: Hello World Flink 0.10

Hi, yes, you can remove the line with the trigger. Here is a version of the code without the trigger: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/JobWithoutTrigger.scala On Fri, Nov 13, 2015 at 11:29 AM, Kamil Gorlo wrote: > OK,

Re: Apache Flink Operator State as Query Cache

Hi Aljoscha, Thanks for this one. Looking forward for 0.10 release version. Cheers On Thu, Nov 12, 2015 at 5:34 PM, Aljoscha Krettek wrote: > Hi, > I don’t know yet when the operator state will be transitioned to managed > memory but it could happen for 1.0 (which will

Re: Apache Flink Operator State as Query Cache

Hi Welly, Flink 0.10.0 is out, its just not announced yet. Its available on maven central and the global mirrors are currently syncing it. This mirror for example has the update already: http://apache.mirror.digionline.de/flink/flink-0.10.0/ On Fri, Nov 13, 2015 at 9:50 AM, Welly Tambunan

Re: Flink, Kappa and Lambda

Hi rss rss, Yes. I have already read that book. However given the state of streaming right now, and Kappa Architecture, I don't think we need Lambda Architecture again ? Any thoughts ? On Thu, Nov 12, 2015 at 12:29 PM, rss rss wrote: > Hello, > > regarding the Lambda

Re: Join Stream with big ref table

Hi Arnaud, I'm happy that you were able to resolve the issue. If you are still interested in the first approach, you could try some things, for example using only one slot per task manager (the slots share the heap of the TM). Regards, Robert On Fri, Nov 13, 2015 at 9:18 AM, LINZ, Arnaud

Re: Apache Flink Operator State as Query Cache

Awesome ! This is really the best weekend gift ever. :) Cheers On Fri, Nov 13, 2015 at 3:54 PM, Robert Metzger wrote: > Hi Welly, > Flink 0.10.0 is out, its just not announced yet. > Its available on maven central and the global mirrors are currently > syncing it. This

Hello World Flink 0.10

Hi guys, I was trying to implement Hello World from slide 36 from http://www.slideshare.net/FlinkForward/k-tzoumas-s-ewen-flink-forward-keynote but I have problem with EOFTrigger - is it something I should implement by myself? I cannot find it in Flink libraries. Cheers, Kamil

Re: Hello World Flink 0.10

Hi Kamil, The EOFTrigger is not part of Flink. However, I've also tried implementing the Hello World from the presentation here: https://github.com/rmetzger/scratch/blob/flink0.10-scala2.11/src/main/scala/com/dataartisans/Job.scala Stephan Ewen told me that there is a more elegant way of

Re: Crash in a simple "mapper style" streaming app likely due to a memory leak ?

> On 13 Nov 2015, at 15:49, LINZ, Arnaud wrote: > > Hi Robert, > > Thanks, it works with 50% -- at least way past the previous crash point. > > In my opinion (I lack real metrics), the part that uses the most memory is > the M2 mapper, instantiated once per slot.

Re: local debug Scala

This issue occurs when Flink has been build against another major scala release. Did you build Flink yourself or download it from somewhere (maven central) ? -- View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/local-debug-Scala-tp1764p3481.html

Re: Apache Flink Forward Videos

Thanks Max, I see that's all the videos has already been there. The keynote has also been uploaded. Great stuff !! Cheers On Fri, Nov 13, 2015 at 5:12 PM, Maximilian Michels wrote: > Hi Welly, > > Thanks for sharing! The videos are coming. They soon will all be available. >

Re: Apache Flink Operator State as Query Cache

Hi Robert, Is this version has already handle the stream perfection or out of order event ? Any resource on how this work and the API reference ? Cheers On Fri, Nov 13, 2015 at 4:00 PM, Welly Tambunan wrote: > Awesome ! > > This is really the best weekend gift ever. :) >

Re: Multilang Support on Flink

Hi Max, Do you know where the repo is ? I try to search on the flink staging but seems it's not there anymore ( via google) Cheers On Fri, Nov 13, 2015 at 5:07 PM, Maximilian Michels wrote: > Hi Welly, > > There is a protocol for communicating with other processes. This is >

Re: Apache Flink Forward Videos

Hi Welly, Thanks for sharing! The videos are coming. They soon will all be available. Cheers, Max On Fri, Nov 13, 2015 at 11:08 AM, Welly Tambunan wrote: > Hi All, > > I've just notice that the video has already available for this one. > >

RE: Crash in a simple "mapper style" streaming app likely due to a memory leak ?

Hi Robert, Thanks, it works with 50% -- at least way past the previous crash point. In my opinion (I lack real metrics), the part that uses the most memory is the M2 mapper, instantiated once per slot. The most complex part is the Sink (it does use a lot of hdfs files, flushing threads etc.) ;