Re: Beam Samza Runner status update

2018-10-15 Thread Lukasz Cwik
I'm excited to hear about making Samza capable of running non-Java pipelines. On Fri, Oct 12, 2018 at 9:46 AM Xinyu Liu wrote: > @Max: absolutely we should work together! FlinkRunner has been our best > reference since the start of our SamzaRunner, and the previous work in > Flink portable

Re: Beam Samza Runner status update

2018-10-12 Thread Xinyu Liu
@Max: absolutely we should work together! FlinkRunner has been our best reference since the start of our SamzaRunner, and the previous work in Flink portable runner has been extremely valuable to us too. We haven't got to the point of portable stateful processing yet. Our next step is to hook up a

Re: Beam Samza Runner status update

2018-10-12 Thread Maximilian Michels
Thanks for the updating, Xinyu and Hai! Great to see another Running emerging :) I'm on the FlinkRunner. Looking forward to working together with you to make the Beam Runners even better. Particularly, we should sync on the portability, as some things are still to be fleshed out. In Flink, we

Re: Beam Samza Runner status update

2018-10-10 Thread Jesse Anderson
Interesting On Wed, Oct 10, 2018, 3:49 PM Kenneth Knowles wrote: > Welcome, Hai! > > On Wed, Oct 10, 2018 at 3:46 PM Hai Lu wrote: > >> Hi, all >> >> This is Hai from LinkedIn. As Xinyu mentioned, I have been working on >> portable API for Samza runner and made some solid progress. It's been a

Re: Beam Samza Runner status update

2018-10-10 Thread Kenneth Knowles
Welcome, Hai! On Wed, Oct 10, 2018 at 3:46 PM Hai Lu wrote: > Hi, all > > This is Hai from LinkedIn. As Xinyu mentioned, I have been working on > portable API for Samza runner and made some solid progress. It's been a > very smooth process (although not effortless for sure) and I'm really >

Re: Beam Samza Runner status update

2018-10-10 Thread Hai Lu
Hi, all This is Hai from LinkedIn. As Xinyu mentioned, I have been working on portable API for Samza runner and made some solid progress. It's been a very smooth process (although not effortless for sure) and I'm really grateful for the great platform that you all have built. I'm very impressed.

Re: Beam Samza Runner status update

2018-10-10 Thread Kenneth Knowles
Clarification: Thomas Groh wrote the fuser, not me! Thanks for the sharing all this. Really cool. Kenn On Wed, Oct 10, 2018 at 11:17 AM Rui Wang wrote: > Thanks for sharing! it's so exciting to hear that Beam is being used on > Samza in production @LinkedIn! Your feedback will be helpful to

Re: Beam Samza Runner status update

2018-10-10 Thread Rui Wang
Thanks for sharing! it's so exciting to hear that Beam is being used on Samza in production @LinkedIn! Your feedback will be helpful to Beam community! Besides, Beam supports SQL right now and hopefully Beam community could also receive feedback on BeamSQL

Re: Beam Samza Runner status update

2018-10-10 Thread Jean-Baptiste Onofré
Thanks for sharing and congrats for this great work ! Regards JB Le 10 oct. 2018 à 20:23, à 20:23, Xinyu Liu a écrit: >Hi, All, > >It's been over four months since we added the Samza Runner to Beam, and >we've been making a lot of progress after that. Here I would like to >update >your guys and

Beam Samza Runner status update

2018-10-10 Thread Xinyu Liu
Hi, All, It's been over four months since we added the Samza Runner to Beam, and we've been making a lot of progress after that. Here I would like to update your guys and share some really good news happening here at LinkedIn: 1) First Beam job in production @LInkedIn! After a few rounds of