Anyone @scale tomorrow?

2016-08-30 Thread Dan Halperin
I'll be giving a talk at the Facebook @scale conference tomorrow. Sorry for the late notice, but if anyone is around to meet in the hallway track or have lunch or drinks, reach out. I'd love to connect. Dan

Re: KafkaIO Windowing Fn

2016-08-30 Thread Aljoscha Krettek
Hi, could you maybe also post the complete that you're using with the FlinkRunner? I could have a look into it. Cheers, Aljoscha On Tue, 30 Aug 2016 at 09:01 Chawla,Sumit wrote: > Hi Thomas > > Sorry i tried with DirectRunner but ran into some kafka issues. Following >

Re: [PROPOSAL] Splittable DoFn - Replacing the Source API with non-monolithic element processing in DoFn

2016-08-30 Thread Aljoscha Krettek
Thanks for the explanation Eugene and JB. By the way, I'm not trying to find holes in this, I really like the feature. I just sometimes wonder how a specific thing might be implemented with this. On Mon, 29 Aug 2016 at 18:00 Eugene Kirpichov wrote: > Hi Aljoscha,

Re: KafkaIO Windowing Fn

2016-08-30 Thread Chawla,Sumit
Hi Thomas Sorry i tried with DirectRunner but ran into some kafka issues. Following is the snippet i am working on, and will post more details once i get it working ( as of now i am unable to read messages from Kafka using DirectRunner) PipelineOptions pipelineOptions =