Re: [ANNOUNCE] New PMC Member: Pablo Estrada

Congrats, Pablo! On Tue, May 14, 2019 at 11:41 PM Tanay Tummalapalli wrote: > > Congratulations Pablo! > > On Wed, May 15, 2019, 12:08 Michael Luckey wrote: >> >> Congrats, Pablo! >> >> On Wed, May 15, 2019 at 8:21 AM Connell O'Callaghan >> wrote: >>> >>> Awesome well done Pablo!!! >>> >>>

Re: [ANNOUNCE] New committer announcement: Mark Liu

Congratulations Mark! On Thu, May 9, 2019 at 1:54 PM Mikhail Gryzykhin wrote: > > Congratulations Mark! > > From: Kenneth Knowles > Date: Sun, Mar 24, 2019 at 9:40 PM > To: dev > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Mark Liu. >> >> Mark

Re: Going on leave for a bit

(A late) Congrats for the newborn! -- Pei On Tue, Jun 26, 2018 at 1:42 PM, Kenneth Knowles wrote: > Hi friends, > > I think I did not mention on dev@ at the time, but my child #2 arrived March > 14 (Pi day!) and I took some weeks off. Starting ~July 4 I will be taking a > more significant

Re: [ANNOUNCEMENT] New committers, May 2018 edition!

Congrats! On Fri, Jun 1, 2018 at 2:12 PM, Charles Chen wrote: > Congratulations everyone! > > > On Thu, May 31, 2018, 10:14 PM Pablo Estrada wrote: >> >> Thanks to the PMC! Very humbled and excited to keep taking part in this >> great community. >> :) >> -P. >> >> >> On Thu, May 31, 2018, 10:10

Re: A personal update

Great to have you back, and congrats! On Wed, Dec 13, 2017 at 3:20 PM, Robert Bradshaw wrote: > Great to hear from you again, and really happy you're sticking around! > > - Robert > > > On Tue, Dec 12, 2017 at 10:47 PM, Ahmet Altay wrote: > > Welcome

Re: [VOTE] Use Gradle for Apache Beam developmental processes

+1 On Thu, Nov 30, 2017 at 8:48 AM, tarush grover wrote: > +1 (binding). > > On Thu, 30 Nov 2017 at 2:06 AM, Eugene Kirpichov > wrote: > >> +1 (binding). >> >> I also think that the process here was handled in an acceptable fashion. >> Due to the

Re: [VOTE] Fixing @yyy.com.INVALID mailing addresses

+1 On Thu, Nov 23, 2017 at 8:43 AM, Holden Karau wrote: > +1 (non-binding) > > On Wed, Nov 22, 2017 at 4:06 PM Kenneth Knowles > wrote: > > > +1 > > > > On Wed, Nov 22, 2017 at 3:43 PM, Lukasz Cwik > > wrote: > > > > >

Re: [VOTE] Drop Spark 1.x support to focus on Spark 2.x

+1 on moving forward with Spark 2.x only. Spark 1 users can still use already released Spark runners, and we can support them with minor version releases for future bug fixes. I don't see how important it is to make future Beam releases available to Spark 1 users. If they choose not to upgrade

Re: [DISCUSSION] using NexMark for Beam

Could any Googlers help to run NexMark on Dataflow streaming and share the numbers with the community? -- Pei On Fri, Aug 25, 2017 at 11:28 PM, Lukasz Cwik wrote: > Etienne, cut some JIRAs for improvements like ValidatesRunner for the > Nexmark suite that you think are

Re: Merge branch DSL_SQL to master

+1 On Thu, Sep 7, 2017 at 4:03 PM, tarush grover wrote: > Thank you all, it was a great learning experience! > > Regards, > Tarush > > On Thu, 7 Sep 2017 at 1:05 PM, Jean-Baptiste Onofré > wrote: > > > +1 > > > > Great work guys ! > > Ready to help

MapReduce Runner needs contributors

Hi all, I am in the process of merge MapReduce Runner to its feature branch, https://github.com/apache/beam/pull/3705 I would like to call for contributors' help for making it more mature. Here are areas that need help: 1. Feature completion Currently, there are few ValidatesRunners tests

Re: Beam spark 2.x runner status

Any updates for upgrading to spark 2.x? I tried to replace the dependency and found a compile error from implementing a scala trait: org.apache.beam.runners.spark.io.SourceRDD.SourcePartition is not abstract and does not override abstract method

Re: [ANNOUNCEMENT] New PMC members, August 2017 edition!

Congratulations! -- Pei On Sat, Aug 12, 2017 at 3:10 PM, Aljoscha Krettek wrote: > Congratulations! :-) > > Best, > Aljoscha > > > On 12. Aug 2017, at 06:39, Robert Bradshaw > wrote: > > > > Congratulations! > > > > On Fri, Aug 11, 2017 at 2:23

Re: [ANNOUNCEMENT] New committers, August 2017 edition!

Congratulations to all! -- Pei On Sat, Aug 12, 2017 at 10:50 AM, James wrote: > Thank you guys, glad to contribute to this great project, congratulate to > all the new committers! > > On Sat, Aug 12, 2017 at 8:36 AM Manu Zhang > wrote: > > >

[DISCUSS] Beam pipeline logical and physical DAGs visualization.

Hi all, While working on JStorm and MapReduce runners, I found that it is very helpful to understand Beam pipelines by visualizing them. Logical graph: https://drive.google.com/file/d/0B6iZ7iRh-LOYc0dUS0Rwb2tvWGM/view?usp=sharing Physical graph:

Re: [DISCUSS] Beam MapReduce Runner One-Pager

; > > > Regards > > JB > > > > > > On 07/13/2017 04:47 AM, Pei HE wrote: > > > >> Thanks guys! > >> > >> I replied Kenn's comments, and looking forward to more feedbacks and > >> suggestions. > >> > >> Al

Re: [DISCUSS] Beam MapReduce Runner One-Pager

b branch and share with you. > > > > Let me take a look on your doc. > > > > Regards > > JB > > > > > > On 07/07/2017 03:11 PM, Pei HE wrote: > > > >> Hi all, > >> While JB is working on MapReduce Runner BEAM-165 > >>

[DISCUSS] Beam MapReduce Runner One-Pager

Hi all, While JB is working on MapReduce Runner BEAM-165 , I have spent time reading Apache Crunch code and drafted Beam MapReduce Runner One-Pager

[Proposal] Fine-grained Resource Configuration in Beam

Hi guys, We are using Blink runner (fork of Flink) and an internal MapReduce-ish runner. We want to configure resources (parallelism, CPU, Memory, e.t.c) in an unified way cross runners. Haozhi and I have drafted a proposal, and would like to have feedback from the community.

Re: First stable release completed!

Congratulations everyone! -- Pei On Wed, May 17, 2017 at 9:00 PM, Ted Yu wrote: > This is great news. > > Congratulations. > > On Wed, May 17, 2017 at 5:22 AM, James wrote: > > > Congratulations to all! > > On Wed, 17 May 2017 at 8:03 PM Prabeesh

Re: First stable release: version designation?

I vote for 2.0. On Sun, May 7, 2017 at 7:50 PM, Prabeesh K. wrote: > I also vote for 2.0. > > On 5 May 2017 at 21:33, Hadar Hod wrote: > > > I also vote for 2.0, for the same reasons Dan stated. > > As Cham mentioned, we can clarify any

Re: [PROPOSAL] Remove KeyedCombineFn

+1 On Sat, Apr 22, 2017 at 12:16 PM, Jean-Baptiste Onofré wrote: > +1 > > Regards > JB > > > On 04/21/2017 07:24 PM, Kenneth Knowles wrote: > >> Hi all, >> >> I propose that we remove KeyedCombineFn before the first stable release. >> >> I don't think it adds enough value for

Re: Apache Storm/JStorm Runner(s) for Apache Beam

Hi Taylor, I am very glad to see the interests in pushing forward Beam Storm runner. However, I cannot convince myself the benefits of having one runner to support all. Beam have three types of users: pipeline writers, library writers, and runner implementers. I can see pros vs cons as

Re: JStorm runner

Pei, > > > > Are you ready to get started on the first PR? I have created the branch > > jstorm-runner for you to issue a PR against. > > > > Kenn > > > > > > On Thu, Apr 6, 2017 at 1:39 AM, Pei HE <p...@apache.org> wrote: > > > &g

JStorm runner

Hi all, I have created jira https://issues.apache.org/jira/browse/BEAM-1899. LIU Jian (basti...@alibaba-inc.com) and I are starting draft PRs. To get started, we need help to: 1. add runner-jstorm JIRA component 2. add jstorm-runner feature branch in github (I don't have access for creating

Re: [ANNOUNCEMENT] New committers, January 2017 edition!

> > > > > > > > > > >to the project in different ways, and we look forward to > > > many > > > > > more > > > > > > > > > > >contributions in the future. > > > > > > > > > > > &