Re: Plan for dropping python 2 support

2019-06-21 Thread Valentyn Tymofieiev
On Tue, Jun 18, 2019 at 2:01 PM Ahmet Altay wrote: > Thank you for the update, very helpful. It might be worthwhile to share a > version of this with user mailing list after 2.14. > I think so too, we can send an update to user list when 2.14.0 is released. > Remaining question for me is:

Re: [2.14.0] Release Progress Update

2019-06-21 Thread Anton Kedin
Not much progress today. Debugging build issues when running global `./gradlew build -PisRelease --scan` Regards, Anton On Thu, Jun 20, 2019 at 4:12 PM Anton Kedin wrote: > Published the snapshots, working through the verify_release_validation > script > > Got another blocker to be

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Ruoyun Huang
Congratulations! Mikhail! On Fri, Jun 21, 2019 at 1:00 PM Yichi Zhang wrote: > Congrats! > > On Fri, Jun 21, 2019 at 11:55 AM Tanay Tummalapalli > wrote: > >> Congratulations! >> >> On Fri, Jun 21, 2019 at 10:35 PM Rui Wang wrote: >> >>> Congrats! >>> >>> >>> -Rui >>> >>> On Fri, Jun 21,

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Yichi Zhang
Congrats! On Fri, Jun 21, 2019 at 11:55 AM Tanay Tummalapalli wrote: > Congratulations! > > On Fri, Jun 21, 2019 at 10:35 PM Rui Wang wrote: > >> Congrats! >> >> >> -Rui >> >> On Fri, Jun 21, 2019 at 9:58 AM Robin Qiu wrote: >> >>> Congrats, Mikhail! >>> >>> On Fri, Jun 21, 2019 at 9:12 AM

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Ahmet Altay
Congratulations! On Fri, Jun 21, 2019 at 12:58 PM Ankur Goenka wrote: > Congrats Mikhail! > > On Fri, Jun 21, 2019 at 11:55 AM Tanay Tummalapalli > wrote: > >> Congratulations! >> >> On Fri, Jun 21, 2019 at 10:35 PM Rui Wang wrote: >> >>> Congrats! >>> >>> >>> -Rui >>> >>> On Fri, Jun 21,

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Ankur Goenka
Congrats Mikhail! On Fri, Jun 21, 2019 at 11:55 AM Tanay Tummalapalli wrote: > Congratulations! > > On Fri, Jun 21, 2019 at 10:35 PM Rui Wang wrote: > >> Congrats! >> >> >> -Rui >> >> On Fri, Jun 21, 2019 at 9:58 AM Robin Qiu wrote: >> >>> Congrats, Mikhail! >>> >>> On Fri, Jun 21, 2019 at

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Tanay Tummalapalli
Congratulations! On Fri, Jun 21, 2019 at 10:35 PM Rui Wang wrote: > Congrats! > > > -Rui > > On Fri, Jun 21, 2019 at 9:58 AM Robin Qiu wrote: > >> Congrats, Mikhail! >> >> On Fri, Jun 21, 2019 at 9:12 AM Alexey Romanenko < >> aromanenko@gmail.com> wrote: >> >>> Congrats, Mikhail! >>> >>>

Re: Discussion/Proposal: support Sort Merge Bucket joins in Beam

2019-06-21 Thread Ahmet Altay
Thank you Claire, this looks promising. Explicitly adding a few folks that might have feedback: +Ismaël Mejía +Robert Bradshaw +Lukasz Cwik +Chamikara Jayalath On Mon, Jun 17, 2019 at 2:12 PM Claire McGinty wrote: > Hey dev@! > > Myself and a few other Spotify data engineers have put

Re: PTransform.expand() guarantees

2019-06-21 Thread Lukasz Cwik
On Fri, Jun 21, 2019 at 10:01 AM Alexey Romanenko wrote: > Thank you for answers, Lukasz. > > On 21 Jun 2019, at 18:15, Lukasz Cwik wrote: > >> Does Beam guarantee where (at “driver” or at "worker” of backend system) " >> *PTransform.expand()*” of provided transform will be called? >> > No.

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Rui Wang
Congrats! -Rui On Fri, Jun 21, 2019 at 9:58 AM Robin Qiu wrote: > Congrats, Mikhail! > > On Fri, Jun 21, 2019 at 9:12 AM Alexey Romanenko > wrote: > >> Congrats, Mikhail! >> >> On 21 Jun 2019, at 18:01, Anton Kedin wrote: >> >> Congrats! >> >> On Fri, Jun 21, 2019 at 3:55 AM Reza Rokni

Re: PTransform.expand() guarantees

2019-06-21 Thread Alexey Romanenko
Thank you for answers, Lukasz. > On 21 Jun 2019, at 18:15, Lukasz Cwik wrote: > Does Beam guarantee where (at “driver” or at "worker” of backend system) > "PTransform.expand()” of provided transform will be called? > No. There are usecases where the driver is run in the "cloud" such as >

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Robin Qiu
Congrats, Mikhail! On Fri, Jun 21, 2019 at 9:12 AM Alexey Romanenko wrote: > Congrats, Mikhail! > > On 21 Jun 2019, at 18:01, Anton Kedin wrote: > > Congrats! > > On Fri, Jun 21, 2019 at 3:55 AM Reza Rokni wrote: > >> Congratulations! >> >> On Fri, 21 Jun 2019, 12:37 Robert Burke, wrote: >>

Re: PTransform.expand() guarantees

2019-06-21 Thread Lukasz Cwik
On Fri, Jun 21, 2019 at 9:07 AM Alexey Romanenko wrote: > Hello, > > I tried to find an answer in documentation for the questions below but I > haven’t managed to do that. Actually, there are 3 related questions: > > Does Beam guarantee where (at “driver” or at "worker” of backend system) " >

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Alexey Romanenko
Congrats, Mikhail! > On 21 Jun 2019, at 18:01, Anton Kedin wrote: > > Congrats! > > On Fri, Jun 21, 2019 at 3:55 AM Reza Rokni > wrote: > Congratulations! > > On Fri, 21 Jun 2019, 12:37 Robert Burke, > wrote: > Congrats > > On Fri, Jun 21,

Re: pipeline status tracing

2019-06-21 Thread Alexey Romanenko
I see that similar questions happen quite often in the last time, so, probably, it would make sense to add this “Wait.on()”-pattern to corresponding website documentation page [1]. [1] https://beam.apache.org/documentation/patterns/file-processing-patterns/

PTransform.expand() guarantees

2019-06-21 Thread Alexey Romanenko
Hello, I tried to find an answer in documentation for the questions below but I haven’t managed to do that. Actually, there are 3 related questions: Does Beam guarantee where (at “driver” or at "worker” of backend system) "PTransform.expand()” of provided transform will be called? Does Beam

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Anton Kedin
Congrats! On Fri, Jun 21, 2019 at 3:55 AM Reza Rokni wrote: > Congratulations! > > On Fri, 21 Jun 2019, 12:37 Robert Burke, wrote: > >> Congrats >> >> On Fri, Jun 21, 2019, 12:29 PM Thomas Weise wrote: >> >>> Hi, >>> >>> Please join me and the rest of the Beam PMC in welcoming a new >>>

Re: Assigning Reviewers in GitHub?

2019-06-21 Thread Lukasz Cwik
Only a few people have permission to update the 'Reviewers' section and I believe you either have to be a project PMC member or committer to be able to update it which is why all people should use "R: @GITHUB-USERNAME" as specified in the contribution guide[1]. 1:

Re: [Discuss] Ideas for Apache Beam presence in social media

2019-06-21 Thread Thomas Weise
>From what I understand, spreadsheets (not docs) provide the functionality that we need: https://support.google.com/docs/answer/91588 Interested PMC members can subscribe and react to changes in the spreadsheet. Lazy consensus requires a minimum wait. How much should that be? Should there be an

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Reza Rokni
Congratulations! On Fri, 21 Jun 2019, 12:37 Robert Burke, wrote: > Congrats > > On Fri, Jun 21, 2019, 12:29 PM Thomas Weise wrote: > >> Hi, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Mikhail Gryzykhin. >> >> Mikhail has been contributing to Beam and

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Tim Robertson
Congratulations Mikhail! On Fri, Jun 21, 2019 at 12:37 PM Robert Burke wrote: > Congrats > > On Fri, Jun 21, 2019, 12:29 PM Thomas Weise wrote: > >> Hi, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Mikhail Gryzykhin. >> >> Mikhail has been contributing to

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Robert Burke
Congrats On Fri, Jun 21, 2019, 12:29 PM Thomas Weise wrote: > Hi, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Mikhail Gryzykhin. > > Mikhail has been contributing to Beam and actively involved in the > community for over a year. He developed the community

[ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-21 Thread Thomas Weise
Hi, Please join me and the rest of the Beam PMC in welcoming a new committer: Mikhail Gryzykhin. Mikhail has been contributing to Beam and actively involved in the community for over a year. He developed the community build dashboard [1] and added substantial improvements to our build

Re: Looping timer blog

2019-06-21 Thread Jan Lukavský
Hi Reza, great prezentation on the Beam Summit. I have had a few posts here in the list during last few weeks, some of which might actually be related to both looping timers and validity windows. But maybe you will be able to see a different approach, than I do, so questions:  a) because of

Re: Looping timer blog

2019-06-21 Thread Reza Rokni
Great question, one thing that we did not cover in the blog and I think we should have is the use case where you would want to bootstrap the pipeline. One option would be on startup to have an extra bounded source that is read and flattened into the main pipeline, the source will need to contain

Re: Request to join Jira as a Contributor - Beam Summit 2019

2019-06-21 Thread Kenneth Knowles
Welcome! On Thu, Jun 20, 2019 at 2:08 AM Robert Bradshaw wrote: > Welcome! You're in. > > On Thu, Jun 20, 2019 at 11:05 AM Jonas Grabber > wrote: > > > > Hello, > > > > I'd like to start contributing to Apache Beam. Could you add me as a > Contributor in ASF Jira? > > My Jira user ID is:

Assigning Reviewers in GitHub?

2019-06-21 Thread Bruce Arctor
Hi Dev, Today at Beam Summit, in Contributing workshop, Robert suggested adding reviewer by assigning someone to 'Reviewers' to the section on the right (where labels, assignees, milestones, etc live). This was not possible without some additional permissions, but it is not clear what that