Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Tanay Tummalapalli
+1 On Tue, Oct 1, 2019 at 8:19 AM Suneel Marthi wrote: > +1 > > On Mon, Sep 30, 2019 at 10:33 PM Manu Zhang > wrote: > >> +1 >> >> On Tue, Oct 1, 2019 at 9:44 AM Austin Bennett < >> whatwouldausti...@gmail.com> wrote: >> >>> +1 >>> >>> On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev >>>

Re: Introduction + Support in Comms for Beam!

2019-09-30 Thread Lukasz Cwik
Welcome to the community. On Mon, Sep 30, 2019 at 3:15 PM María Cruz wrote: > Hi everyone, > my name is María Cruz, I am from Buenos Aires but I live in the Bay Area. > I recently became acquainted with Apache Beam project, and I got a chance > to meet some of the Beam community at Apache Con

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Suneel Marthi
+1 On Mon, Sep 30, 2019 at 10:33 PM Manu Zhang wrote: > +1 > > On Tue, Oct 1, 2019 at 9:44 AM Austin Bennett > wrote: > >> +1 >> >> On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev >> wrote: >> >>> Hi everyone, >>> >>> Please vote whether to sign a pledge on behalf of Apache Beam to sunset

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Manu Zhang
+1 On Tue, Oct 1, 2019 at 9:44 AM Austin Bennett wrote: > +1 > > On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev > wrote: > >> Hi everyone, >> >> Please vote whether to sign a pledge on behalf of Apache Beam to sunset >> Beam Python 2 offering (in new releases) in 2020 on >>

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Austin Bennett
+1 On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev wrote: > Hi everyone, > > Please vote whether to sign a pledge on behalf of Apache Beam to sunset > Beam Python 2 offering (in new releases) in 2020 on > http://python3stament.org as follows: > > [ ] +1: Sign a pledge to discontinue support

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Robert Bradshaw
+1 On Mon, Sep 30, 2019 at 5:35 PM David Cavazos wrote: > > +1 > > On Mon, Sep 30, 2019 at 5:27 PM Ahmet Altay wrote: >> >> +1 >> >> On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev >> wrote: >>> >>> Hi everyone, >>> >>> Please vote whether to sign a pledge on behalf of Apache Beam to

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread David Cavazos
+1 On Mon, Sep 30, 2019 at 5:27 PM Ahmet Altay wrote: > +1 > > On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev > wrote: > >> Hi everyone, >> >> Please vote whether to sign a pledge on behalf of Apache Beam to sunset >> Beam Python 2 offering (in new releases) in 2020 on >>

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Ahmet Altay
+1 On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev wrote: > Hi everyone, > > Please vote whether to sign a pledge on behalf of Apache Beam to sunset > Beam Python 2 offering (in new releases) in 2020 on > http://python3stament.org as follows: > > [ ] +1: Sign a pledge to discontinue support

[VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

2019-09-30 Thread Valentyn Tymofieiev
Hi everyone, Please vote whether to sign a pledge on behalf of Apache Beam to sunset Beam Python 2 offering (in new releases) in 2020 on http://python3stament.org as follows: [ ] +1: Sign a pledge to discontinue support of Python 2 in Beam in 2020. [ ] -1: Do not sign a pledge to discontinue

Re: Plan for dropping python 2 support

2019-09-30 Thread Valentyn Tymofieiev
As suggested and enthusiastically supported by several folks in this thread, I will send a vote to sign a pledge on http://python3statement.org on behalf of Apache Beam to discontinue Python 2 support in or before 2020. The motivation for signing the pledge is: - to provide another signal to Beam

Re: Multiple iterations after GroupByKey with SparkRunner

2019-09-30 Thread Kenneth Knowles
In the car analogy, you have something this: Iterable: car Iterator: taxi ride They are related, but not as variations of a common concept. In the discussion of Combine vs RSBK, if the reducer is required to be an associative and commutative operator, then it is the same thing under a

Introduction + Support in Comms for Beam!

2019-09-30 Thread María Cruz
Hi everyone, my name is María Cruz, I am from Buenos Aires but I live in the Bay Area. I recently became acquainted with Apache Beam project, and I got a chance to meet some of the Beam community at Apache Con North America this past September. I'm testing out a communications framework

Re: Heads-up: Python IT test breakage is investigated in BEAM-8324

2019-09-30 Thread Valentyn Tymofieiev
Should be now fixed by https://github.com/apache/beam/pull/9695. On Mon, Sep 30, 2019 at 1:32 PM Maximilian Michels wrote: > Thanks for letting us know. Was wondering, why the tests suddenly broke. > See https://builds.apache.org/job/beam_PreCommit_Python_Cron/ and >

Re: Heads-up: Python IT test breakage is investigated in BEAM-8324

2019-09-30 Thread Maximilian Michels
Thanks for letting us know. Was wondering, why the tests suddenly broke. See https://builds.apache.org/job/beam_PreCommit_Python_Cron/ and https://builds.apache.org/job/beam_PreCommit_Portable_Python_Cron/ On 30.09.19 10:45, Valentyn Tymofieiev wrote:

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Udi Meiri
Congrats Alan! On Mon, Sep 30, 2019 at 11:12 AM Alan Myrvold wrote: > Thanks!! Looking forward to making more impact to Apache Beam > > On Mon, Sep 30, 2019 at 10:56 AM Mikhail Gryzykhin > wrote: > >> Congratulations! >> >> On Mon, Sep 30, 2019 at 9:47 AM David Cavazos >> wrote: >> >>>

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Alan Myrvold
Thanks!! Looking forward to making more impact to Apache Beam On Mon, Sep 30, 2019 at 10:56 AM Mikhail Gryzykhin wrote: > Congratulations! > > On Mon, Sep 30, 2019 at 9:47 AM David Cavazos wrote: > >> Congratulations Alan! >> >> On Mon, Sep 30, 2019 at 7:57 AM Connell O'Callaghan >> wrote: >>

[DISCUSS] Beam SQL filter push-down

2019-09-30 Thread Kirill Kozlov
The objective is to create a universal way for Beam SQL IO APIs to support filter/project push-down. A proposed way to achieve that is by introducing an interface responsible for identifying what portion(s) of a Calc can be moved down to IO layer. Also, adding following methods to a BeamSqlTable

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Mikhail Gryzykhin
Congratulations! On Mon, Sep 30, 2019 at 9:47 AM David Cavazos wrote: > Congratulations Alan! > > On Mon, Sep 30, 2019 at 7:57 AM Connell O'Callaghan > wrote: > >> Congratulations Alan - well done!!! Ahmet thank you for sharing this >> great news!!! >> >> On Mon, Sep 30, 2019 at 7:34 AM Łukasz

Heads-up: Python IT test breakage is investigated in BEAM-8324

2019-09-30 Thread Valentyn Tymofieiev

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread David Cavazos
Congratulations Alan! On Mon, Sep 30, 2019 at 7:57 AM Connell O'Callaghan wrote: > Congratulations Alan - well done!!! Ahmet thank you for sharing this great > news!!! > > On Mon, Sep 30, 2019 at 7:34 AM Łukasz Gajowy wrote: > >> Congratulations :) >> >> pon., 30 wrz 2019 o 15:41 Reza Rokni

Re: Why is there no standard boolean coder?

2019-09-30 Thread Maximilian Michels
+1 On 29.09.19 13:44, Chad Dombrova wrote: I’m planning on porting the existing Java coder to Python. Any objections to that? -chad On Sun, Sep 29, 2019 at 1:02 PM Robert Burke > wrote: +1 I'm happy to whip together the Go SDK version once the encoding

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Connell O'Callaghan
Congratulations Alan - well done!!! Ahmet thank you for sharing this great news!!! On Mon, Sep 30, 2019 at 7:34 AM Łukasz Gajowy wrote: > Congratulations :) > > pon., 30 wrz 2019 o 15:41 Reza Rokni napisał(a): > >> Woohoo Congratulations! >> >> On Mon, 30 Sep 2019 at 21:06, Thomas Weise

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Łukasz Gajowy
Congratulations :) pon., 30 wrz 2019 o 15:41 Reza Rokni napisał(a): > Woohoo Congratulations! > > On Mon, 30 Sep 2019 at 21:06, Thomas Weise wrote: > >> Congratulations, Alan! >> >> >> On Mon, Sep 30, 2019 at 4:47 AM Ismaël Mejía wrote: >> >>> Congrats Alan! >>> >>> On Mon, Sep 30, 2019,

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Thomas Weise
Congratulations, Alan! On Mon, Sep 30, 2019 at 4:47 AM Ismaël Mejía wrote: > Congrats Alan! > > On Mon, Sep 30, 2019, 11:20 AM Tanay Tummalapalli > wrote: > >> Congratulations, Alan! >> >> >> On Mon, Sep 30, 2019 at 1:03 PM Gleb Kanterov wrote: >> >>> Congratulations! >>> >>> On Sat, Sep 28,

Beam Dependency Check Report (2019-09-30)

2019-09-30 Thread Apache Jenkins Server
High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue mock 2.0.0 3.0.5 2019-05-20

Beam KinesisIO Migration V1 to V2

2019-09-30 Thread Cam Mach
Hello Beam Dev, I have discussed with a couple of Beam dev regarding this topic. We found something interesting in the new AWS Kinesis SDK and Libraries V2, so like to propose a design for this migration. Here is the design doc:

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Ismaël Mejía
Congrats Alan! On Mon, Sep 30, 2019, 11:20 AM Tanay Tummalapalli wrote: > Congratulations, Alan! > > > On Mon, Sep 30, 2019 at 1:03 PM Gleb Kanterov wrote: > >> Congratulations! >> >> On Sat, Sep 28, 2019 at 12:07 AM Valentyn Tymofieiev >> wrote: >> >>> Congratulations, Alan. Well deserved.

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Tanay Tummalapalli
Congratulations, Alan! On Mon, Sep 30, 2019 at 1:03 PM Gleb Kanterov wrote: > Congratulations! > > On Sat, Sep 28, 2019 at 12:07 AM Valentyn Tymofieiev > wrote: > >> Congratulations, Alan. Well deserved. >> >> On Fri, Sep 27, 2019 at 2:09 PM Chamikara Jayalath >> wrote: >> >>> Congrats

Re: Multiple iterations after GroupByKey with SparkRunner

2019-09-30 Thread Jan Lukavský
> The fact that the annotation on the ParDo "changes" the GroupByKey implementation is very specific to the Spark runner implementation. I don't quite agree. It is not very specific to Spark, it is specific to generally all runners, that produce grouped elements in a way that is not

Re: [ANNOUNCE] New committer: Alan Myrvold

2019-09-30 Thread Gleb Kanterov
Congratulations! On Sat, Sep 28, 2019 at 12:07 AM Valentyn Tymofieiev wrote: > Congratulations, Alan. Well deserved. > > On Fri, Sep 27, 2019 at 2:09 PM Chamikara Jayalath > wrote: > >> Congrats Alan!! >> >> On Fri, Sep 27, 2019 at 1:49 PM Jan Lukavský wrote: >> >>> Congrats Alan! >>> On