Re: Is Splittable DoFn suitable for fetch data from a socket server?

2018-09-20 Thread flyisland
Hi Reuven, There is no explicit ID in the message itself, and if there is information can be used as an ID is depend on use cases. On Fri, Sep 21, 2018 at 11:05 AM Reuven Lax wrote: > Is there information in the message that can be used as an id, that can be > used for deduplication? > > On

Re: Is Splittable DoFn suitable for fetch data from a socket server?

2018-09-20 Thread Reuven Lax
Is there information in the message that can be used as an id, that can be used for deduplication? On Thu, Sep 20, 2018 at 6:36 PM flyisland wrote: > Hi Lukasz, > > With the current API we provided, messages cannot be acked from a > different client. > > The server will re-send messages to the

Re: Is Splittable DoFn suitable for fetch data from a socket server?

2018-09-20 Thread flyisland
Hi Lukasz, With the current API we provided, messages cannot be acked from a different client. The server will re-send messages to the reconnected client if those messages were not acked. So there'll be duplicate messages, but with a "redeliver times" property in the header. Thanks for your

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Ahmet Altay
Good point. However, we agreed that our release policy would be to patch only long term support (LTS) releases. Given that we have not made any LTS releases yet, perhaps we should use 2.8.0 as the opportunity to make our first LTS release. On Thu, Sep 20, 2018 at 6:26 PM, Thomas Weise wrote: >

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Thomas Weise
That's not the same for a user though. 2.7.1 would be a patch compatible release that only fixes bugs. 2.8.0 adds new features and potentially also new issues.. On Thu, Sep 20, 2018 at 3:16 PM Ahmet Altay wrote: > +1 to Thomas's suggestion. Instead of 2.7.1 we can follow up with 2.8.0 > though.

Re: Retiring runners?

2018-09-20 Thread Lukasz Cwik
Thanks for info, I wasn't aware of what retiring meant, I assumed (incorrectly) that retiring = death of a project. On Thu, Sep 20, 2018 at 4:45 PM Manu Zhang wrote: > Hi Luke, > > (On behalf of Gearpump runner) > > Getting retired (from Apache) doesn't mean the end of Gearpump as a > project

Re: Retiring runners?

2018-09-20 Thread Manu Zhang
Hi Luke, (On behalf of Gearpump runner) Getting retired (from Apache) doesn't mean the end of Gearpump as a project but to make it easier to commit and release for, honestly speaking, a small community. I've been maintaining Gearpump runner and will strive for better integration here. I agree we

Retiring runners?

2018-09-20 Thread Lukasz Cwik
Datatorrent the largest contributor to the Apex project has closed shop[1], the project hasn't retired but development has significantly slowed down. The Gearpump project has voted to retire[2]. Do people know if these runners are being used? Do people spend enough time on supporting/updating

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Reuven Lax
Congratulations Kenn! On Thu, Sep 20, 2018 at 2:31 PM Griselda Cuevas wrote: > Thank you so much Davor for all the work you put into the project since > its inception. > Congrats Kenn on becoming the new Chair! > > On Thu, 20 Sep 2018 at 12:54, Neelesh Salian > wrote: > >> Congratulation Kenn!

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Connell O'Callaghan
+1 to Thomas's suggestion - if Charles or others cannot reproduce. On Thu, Sep 20, 2018 at 2:40 PM Thomas Weise wrote: > We can also consider releasing 2.7.0 and then follow up with 2.7.1 if the > problem can be reproduced and requires a fix. Just food for thought :) > > > On Thu, Sep 20, 2018

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Thomas Weise
We can also consider releasing 2.7.0 and then follow up with 2.7.1 if the problem can be reproduced and requires a fix. Just food for thought :) On Thu, Sep 20, 2018 at 2:13 PM Charles Chen wrote: > My mistake, it looks like the correct beam staging repository ( >

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Griselda Cuevas
Thank you so much Davor for all the work you put into the project since its inception. Congrats Kenn on becoming the new Chair! On Thu, 20 Sep 2018 at 12:54, Neelesh Salian wrote: > Congratulation Kenn! > Thank you for your continued leadership , Davor. > > On Wed, Sep 19, 2018 at 12:54 PM

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Charles Chen
My mistake, it looks like the correct beam staging repository ( https://repository.apache.org/content/repositories/orgapachebeam-1046/) is specified in your pom file. On Thu, Sep 20, 2018 at 2:10 PM Charles Chen wrote: > Hey Romain and JB, do you have any progress on this? One thing I would >

Re: [VOTE] Release 2.7.0, release candidate #1

2018-09-20 Thread Charles Chen
Hey Romain and JB, do you have any progress on this? One thing I would like to point out is that 2.7.0 isn't yet pushed to Maven Central, so referring to it by version is not expected to work (and it looks like this is what is done in your repo: https://github.com/rmannibucau/beam-2.7.0-fails).

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Neelesh Salian
Congratulation Kenn! Thank you for your continued leadership , Davor. On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci wrote: > Hi everyone -- > It is with great pleasure that I announce that at today's meeting of the > Foundation's Board of Directors, the Board has appointed Kenneth Knowles as >

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Henning Rohde
Thank you Davor for your leadership and contributions to the project from the very beginning. And thank you Kenn for accepting the PMC chair role. Henning On Thu, Sep 20, 2018 at 11:21 AM Mikhail Gryzykhin wrote: > Contratulations Kenn! > > --Mikhail > > Have feedback

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Scott Wegner
Congrats, Kenn! On Thu, Sep 20, 2018 at 10:46 AM Daniel Oliveira wrote: > Congrats Kenn! Sounds like you deserve it! > > On Thu, Sep 20, 2018 at 10:20 AM Udi Meiri wrote: > >> Congrats! >> >> On Thu, Sep 20, 2018 at 10:09 AM Raghu Angadi wrote: >> >>> Congrats Kenn! >>> >>> On Wed, Sep 19,

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Daniel Oliveira
Congrats Kenn! Sounds like you deserve it! On Thu, Sep 20, 2018 at 10:20 AM Udi Meiri wrote: > Congrats! > > On Thu, Sep 20, 2018 at 10:09 AM Raghu Angadi wrote: > >> Congrats Kenn! >> >> On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci wrote: >> >>> Hi everyone -- >>> It is with great pleasure

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Udi Meiri
Congrats! On Thu, Sep 20, 2018 at 10:09 AM Raghu Angadi wrote: > Congrats Kenn! > > On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci wrote: > >> Hi everyone -- >> It is with great pleasure that I announce that at today's meeting of the >> Foundation's Board of Directors, the Board has appointed

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Raghu Angadi
Congrats Kenn! On Wed, Sep 19, 2018 at 12:54 PM Davor Bonaci wrote: > Hi everyone -- > It is with great pleasure that I announce that at today's meeting of the > Foundation's Board of Directors, the Board has appointed Kenneth Knowles as > the second chair of the Apache Beam project. > > Kenn

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Huygaa Batsaikhan
Congrats Kenn! On Thu, Sep 20, 2018 at 8:47 AM Pablo Estrada wrote: > Thanks Davor for your work on Beam thus far! And congrats Kenn : ) > Best > -P. > > On Thu, Sep 20, 2018 at 2:38 AM Robert Bradshaw > wrote: > >> Congratulations Kenn! And thank you, Davor, for the hard work you've put >> in

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Mark Liu
Thank you Davor for your hard work all the time! And congratulations Kenn!! On Thu, Sep 20, 2018 at 8:47 AM Pablo Estrada wrote: > Thanks Davor for your work on Beam thus far! And congrats Kenn : ) > Best > -P. > > On Thu, Sep 20, 2018 at 2:38 AM Robert Bradshaw > wrote: > >> Congratulations

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Pablo Estrada
Thanks Davor for your work on Beam thus far! And congrats Kenn : ) Best -P. On Thu, Sep 20, 2018 at 2:38 AM Robert Bradshaw wrote: > Congratulations Kenn! And thank you, Davor, for the hard work you've put > in these last several years. > > On Thu, Sep 20, 2018 at 9:50 AM Tim Robertson >

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Robert Bradshaw
Congratulations Kenn! And thank you, Davor, for the hard work you've put in these last several years. On Thu, Sep 20, 2018 at 9:50 AM Tim Robertson wrote: > Thank you to Davor all the PMC - I can only imagine how much work it has > been to get Beam to where it is today. > > Congratulations

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-20 Thread Tim Robertson
Thank you to Davor all the PMC - I can only imagine how much work it has been to get Beam to where it is today. Congratulations Kenn! On Thu, Sep 20, 2018 at 1:05 AM Tyler Akidau wrote: > Thanks Davor, and congrats Kenn! > > -Tyler > > On Wed, Sep 19, 2018 at 2:43 PM Yifan Zou wrote: > >>