Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-12-10 Thread 송원욱
It's been a while, but just to let you know that there's a PR up regarding the issue! Anyone who's interested can take a look at https://github.com/apache/beam/pull/7236. Wonook 2018년 11월 16일 (금) 오후 1:16, Jangho Seo 님이 작성: > That also sounds good to me. +1 > > Best, > Jangho > > On 11/15/18

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-15 Thread Jangho Seo
That also sounds good to me. +1 Best, Jangho On 11/15/18 7:29 PM, Byung-Gon Chun wrote: > Sounds good! > > On Thu, Nov 15, 2018 at 6:09 PM Joo Yeon Kim wrote: > >> This sounds great to me :) +1 >> >> On Tue, Nov 13, 2018 at 1:13 PM 송원욱 wrote: >> >>> Regarding the discussion, I agree with JB to

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-15 Thread Joo Yeon Kim
This sounds great to me :) +1 On Tue, Nov 13, 2018 at 1:13 PM 송원욱 wrote: > Regarding the discussion, I agree with JB to keep the runner in the Nemo > codebase for now, as there are a number of ongoing developments related to > supporting the streaming functionalities. Also, as Nemo relies on >

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-11 Thread John Yang
Thanks JB for your mail. I think the Beam portability framework is an exciting feature that Nemo wants to support in the future like Flink, although my personal focus at the moment is on streaming and overall performance/reliability. A quick update on the "When"/"How" parts of the capability

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-11 Thread Jean-Baptiste Onofré
Thanks for the update. Regarding the governance, it's also related to visibility. My preference would be to have the runner in nemo codebase. It gives us a complete control and managed our own release cycle. However, it reduces the visibility for the beam community (or we have to send update on

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-11 Thread John Yang
Thanks all for the great discussion. My take on the current status of Beam support in Nemo from the perspective of the Beam Capability Matrix[1]: - What: Full support except for SDF / Metrics / Stateful Processing (Side Inputs for streaming pipelines are not supported yet though) - Where:

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-07 Thread Davor Bonaci
I think the first decision you have to make is around the governance of the runner. It can live in the Beam project (and be governed by the Beam PMC), or in the Nemo project (and be governed by the Nemo PPMC). Both are viable paths, and different folks have chosen different paths. On the

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-07 Thread Jean-Baptiste Onofré
Hi guys, definitely happy to help on that front. Regards JB On 07/11/2018 09:54, Byung-Gon Chun wrote: > Thanks for initiating this discussion, Wonwook! > > Davor and JB, it’d be great to get your guide. > > Thanks. > - Gon > > Sent from my iPhone > > 2018. 11. 7. 오후 3:57, 송원욱 작성: > >>

Re: Sending a pull request to Apache Beam for the Nemo Runner?

2018-11-07 Thread Byung-Gon Chun
Thanks for initiating this discussion, Wonwook! Davor and JB, it’d be great to get your guide. Thanks. - Gon Sent from my iPhone 2018. 11. 7. 오후 3:57, 송원욱 작성: > Hi all, > > It's nice to hear that the first release is coming up pretty soon with the > progress that we are making! > With the