Re: [ANNOUNCE] New committer: Michał Walenia

Thank you Pablo for sharing!!! Well done Michal!!! On Tue, Jan 28, 2020 at 21:07 jincheng sun wrote: > Congrats Michał ！ > > > Hannah Jiang 于2020年1月29日 周三01:43写道： > >> Congrats you Michal! >> >> >> >> On Tue, Jan 28, 2020 at 9:11 AM Gleb Kanterov wrote: >> >>> Congratulations! >>> >>> On Tue,

Re: [ANNOUNCE] New committer: Michał Walenia

Congrats Michał ！ Hannah Jiang 于2020年1月29日 周三01:43写道： > Congrats you Michal! > > > > On Tue, Jan 28, 2020 at 9:11 AM Gleb Kanterov wrote: > >> Congratulations! >> >> On Tue, Jan 28, 2020 at 6:03 PM Łukasz Gajowy wrote: >> >>> Congratulations Michał!  >>> >>> wt., 28 sty 2020 o 16:33 Ryan

Re: [ANNOUNCE] New committer: Hannah Jiang

Congrats Hannah! Ankur Goenka 于2020年1月29日 周三11:35写道： > Congrats Hannah! > > On Tue, Jan 28, 2020 at 7:30 PM Reza Rokni wrote: > >> Congratz! >> >> On Wed, 29 Jan 2020 at 09:52, Valentyn Tymofieiev >> wrote: >> >>> Congratulations, Hannah! >>> >>> On Tue, Jan 28, 2020 at 5:46 PM Udi Meiri

Re: [ANNOUNCE] Beam 2.18.0 Released

Thank you Udi! On Wed, 29 Jan 2020 at 06:34, Ahmet Altay wrote: > Thank you Udi! > > On Tue, Jan 28, 2020 at 2:13 PM kant kodali wrote: > >> Looks like >> https://beam.apache.org/documentation/runners/capability-matrix/ needs >> to be updated? since there seems to be support for spark

Re: [PROPOSAL] Beam Schema Options

Using schema types for the metadata values is a nice touch. Are the options expected to be common across many fields? Perhaps the name should be a URN to make it clear to be careful about collisions? (just a synonym for "name" in practice, but with different connotation) I generally like this...

Re: [DISCUSS][PROPOSAL] Improvements to the Apache Beam website

Technical clarification: Docsy is a set of templates for Hugo. The advantages of Hugo over Jekyll are many. - Its tagline is that it is faster. For large sites maybe that matters more, but for us I don't think it matters much. At least not when I'm working on the site it hasn't. -

Re: [ANNOUNCE] New committer: Hannah Jiang

Congrats Hannah! On Tue, Jan 28, 2020 at 7:30 PM Reza Rokni wrote: > Congratz! > > On Wed, 29 Jan 2020 at 09:52, Valentyn Tymofieiev > wrote: > >> Congratulations, Hannah! >> >> On Tue, Jan 28, 2020 at 5:46 PM Udi Meiri wrote: >> >>> Welcome and congrats Hannah! >>> >>> On Tue, Jan 28, 2020

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratz! On Wed, 29 Jan 2020 at 09:52, Valentyn Tymofieiev wrote: > Congratulations, Hannah! > > On Tue, Jan 28, 2020 at 5:46 PM Udi Meiri wrote: > >> Welcome and congrats Hannah! >> >> On Tue, Jan 28, 2020 at 4:52 PM Robin Qiu wrote: >> >>> Congratulations, Hannah! >>> >>> On Tue, Jan 28,

Re: Executing the runner validation tests for the Twister2 runner

In my opinion it is fine to add the documentation after the runner is added. I do think we should have input from more members of the community about accepting the donation. Since there is time here are places where you should add information about the runner:

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations, Hannah! On Tue, Jan 28, 2020 at 5:46 PM Udi Meiri wrote: > Welcome and congrats Hannah! > > On Tue, Jan 28, 2020 at 4:52 PM Robin Qiu wrote: > >> Congratulations, Hannah! >> >> On Tue, Jan 28, 2020 at 4:50 PM Alan Myrvold wrote: >> >>> Congrats, Hannah >>> >>> On Tue, Jan

Re: [ANNOUNCE] New committer: Hannah Jiang

Welcome and congrats Hannah! On Tue, Jan 28, 2020 at 4:52 PM Robin Qiu wrote: > Congratulations, Hannah! > > On Tue, Jan 28, 2020 at 4:50 PM Alan Myrvold wrote: > >> Congrats, Hannah >> >> On Tue, Jan 28, 2020 at 4:46 PM Connell O'Callaghan >> wrote: >> >>> Thank you for sharing Luke!!!

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations, Hannah! On Tue, Jan 28, 2020 at 4:50 PM Alan Myrvold wrote: > Congrats, Hannah > > On Tue, Jan 28, 2020 at 4:46 PM Connell O'Callaghan > wrote: > >> Thank you for sharing Luke!!! >> >> Well done and congratulations Hannah!! >> >> On Tue, Jan 28, 2020 at 4:45 PM Heejong Lee

Re: [ANNOUNCE] New committer: Hannah Jiang

Congrats, Hannah On Tue, Jan 28, 2020 at 4:46 PM Connell O'Callaghan wrote: > Thank you for sharing Luke!!! > > Well done and congratulations Hannah!! > > On Tue, Jan 28, 2020 at 4:45 PM Heejong Lee wrote: > >> Congratulations! :) >> >> On Tue, Jan 28, 2020 at 4:43 PM Yichi Zhang wrote:

Re: [ANNOUNCE] New committer: Hannah Jiang

Thank you for sharing Luke!!! Well done and congratulations Hannah!! On Tue, Jan 28, 2020 at 4:45 PM Heejong Lee wrote: > Congratulations! :) > > On Tue, Jan 28, 2020 at 4:43 PM Yichi Zhang wrote: > >> Congrats Hannah! >> >> On Tue, Jan 28, 2020 at 3:57 PM Yifan Zou wrote: >> >>>

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations! :) On Tue, Jan 28, 2020 at 4:43 PM Yichi Zhang wrote: > Congrats Hannah! > > On Tue, Jan 28, 2020 at 3:57 PM Yifan Zou wrote: > >> Congratulations Hannah!! >> >> On Tue, Jan 28, 2020 at 3:55 PM Boyuan Zhang wrote: >> >>> Thanks for all your contributions! Congratulations~ >>>

Re: [ANNOUNCE] New committer: Hannah Jiang

Congrats Hannah! On Tue, Jan 28, 2020 at 3:57 PM Yifan Zou wrote: > Congratulations Hannah!! > > On Tue, Jan 28, 2020 at 3:55 PM Boyuan Zhang wrote: > >> Thanks for all your contributions! Congratulations~ >> >> On Tue, Jan 28, 2020 at 3:44 PM Pablo Estrada wrote: >> >>> yoooho : D >>>

Re: [ANNOUNCE] New committer: Hannah Jiang

Congratulations Hannah!! On Tue, Jan 28, 2020 at 3:55 PM Boyuan Zhang wrote: > Thanks for all your contributions! Congratulations~ > > On Tue, Jan 28, 2020 at 3:44 PM Pablo Estrada wrote: > >> yoooho : D >> >> On Tue, Jan 28, 2020 at 3:21 PM Luke Cwik wrote: >> >>> Hi everyone, >>> >>>

Re: [ANNOUNCE] New committer: Hannah Jiang

Thanks for all your contributions! Congratulations~ On Tue, Jan 28, 2020 at 3:44 PM Pablo Estrada wrote: > yoooho : D > > On Tue, Jan 28, 2020 at 3:21 PM Luke Cwik wrote: > >> Hi everyone, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Hannah Jiang >> >>

Re: [ANNOUNCE] New committer: Hannah Jiang

yoooho : D On Tue, Jan 28, 2020 at 3:21 PM Luke Cwik wrote: > Hi everyone, > > Please join me and the rest of the Beam PMC in welcoming a new committer: > Hannah Jiang > > Hannah has contributed to Beam in many ways, including work on building > and releasing the Apache Beam SDK containers.

[ANNOUNCE] New committer: Hannah Jiang

Hi everyone, Please join me and the rest of the Beam PMC in welcoming a new committer: Hannah Jiang Hannah has contributed to Beam in many ways, including work on building and releasing the Apache Beam SDK containers. In consideration of their contributions, the Beam PMC trusts them with the

Re: Apache community contact point

Hi Kenneth Is it possible to help me unblock the migration tasks? There is some progress with the ticket, but the repo was not created as requested and no more response from the assignee. Here is a link to the ticket: https://issues.apache.org/jira/browse/INFRA-19732 Thanks, Hannah On Thu, Jan

Re: Using very slow changing stream of data (KV) as side input

Hi Mohil, I've responded to another thread you started. Please, check on: https://lists.apache.org/thread.html/r93066c4a3daefba954b23dbdb4536159ff3ff29b06052b92e747da17%40%3Cdev.beam.apache.org%3E Regards, Mikhail. On Tue, Jan 28, 2020 at 10:22 AM Mohil Khare wrote: > Hi, > This is Mohil

Re: anyone working on updating com.google.cloud:google-cloud-spanner?

I'm going to take that in the coming weeks. Currently I'm focusing on updating the bigtable-client-core version. On Tue, Jan 28, 2020 at 4:32 PM Luke Cwik wrote: > > +Tomo Suzuki has been working on plenty of dependency updates related to GCP > libraries and could give guidance (e.g. [1]). I

Re: Subclassing MapElements

Jeff, Cool, thanks for the thoughts, the point about naming is a very good one. I think we will probably look to do more with static builder methods as we discussed. Cheers! -J From: Jeff Klukas Reply-To: "dev@beam.apache.org" Date: Tuesday, January 28, 2020 at 12:57 PM To: dev Subject:

Re: [ANNOUNCE] Beam 2.18.0 Released

Thank you Udi! On Tue, Jan 28, 2020 at 2:13 PM kant kodali wrote: > Looks like > https://beam.apache.org/documentation/runners/capability-matrix/ needs to > be updated? since there seems to be support for spark structured streaming? > > On Tue, Jan 28, 2020 at 1:47 PM Connell O'Callaghan >

Re: [ANNOUNCE] Beam 2.18.0 Released

Looks like https://beam.apache.org/documentation/runners/capability-matrix/ needs to be updated? since there seems to be support for spark structured streaming? On Tue, Jan 28, 2020 at 1:47 PM Connell O'Callaghan wrote: > Well done thank you Udi!!! > > On Tue, Jan 28, 2020 at 11:47 AM Ankur

Re: [ANNOUNCE] Beam 2.18.0 Released

Well done thank you Udi!!! On Tue, Jan 28, 2020 at 11:47 AM Ankur Goenka wrote: > Thanks Udi! > > On Tue, Jan 28, 2020 at 11:30 AM Yichi Zhang wrote: > >> Thanks Udi! >> >> On Tue, Jan 28, 2020 at 11:28 AM Hannah Jiang >> wrote: >> >>> Thanks Udi! >>> >>> >>> On Tue, Jan 28, 2020 at 11:09 AM

Re: anyone working on updating com.google.cloud:google-cloud-spanner?

+Tomo Suzuki has been working on plenty of dependency updates related to GCP libraries and could give guidance (e.g. [1]). I have reviewed several. Tomo has updated many of the core libraries so a version bump for the core spanner library should be much easier now and can be validated using the

Re: Subclassing MapElements

Jason - I was going to suggest the same approach that you arrived at. I think using a static method to a MapElements instance is an elegant solution. The one drawback I can think of with that approach is that you lose control over default naming. From your example usage:

anyone working on updating com.google.cloud:google-cloud-spanner?

It's currently at 1.6.0, which a year old. https://github.com/googleapis/java-spanner/releases?after=1.9.0 I would appreciate any help with this. Tracking issues: https://issues.apache.org/jira/browse/BEAM-8758 https://issues.apache.org/jira/browse/BEAM-8682 smime.p7s Description: S/MIME

Re: [ANNOUNCE] Beam 2.18.0 Released

Thanks Udi! On Tue, Jan 28, 2020 at 11:30 AM Yichi Zhang wrote: > Thanks Udi! > > On Tue, Jan 28, 2020 at 11:28 AM Hannah Jiang > wrote: > >> Thanks Udi! >> >> >> On Tue, Jan 28, 2020 at 11:09 AM Pablo Estrada >> wrote: >> >>> Thanks Udi! >>> >>> On Tue, Jan 28, 2020 at 11:08 AM Rui Wang

Re: [PROPOSAL] Add support for writing flattened schemas to pubsub

I filed a few jiras to track the follow-up work we discussed here: BEAM-9208 [1] - Add support for mapping columns to pubsub message attributes in flat schemas DDL BEAM-9209 [2] - Add support for mapping columns to pubsub message event_timestamp when using flat schemas DDL BEAM-9210 [3] -

Re: [ANNOUNCE] Beam 2.18.0 Released

Thanks Udi! On Tue, Jan 28, 2020 at 11:28 AM Hannah Jiang wrote: > Thanks Udi! > > > On Tue, Jan 28, 2020 at 11:09 AM Pablo Estrada wrote: > >> Thanks Udi! >> >> On Tue, Jan 28, 2020 at 11:08 AM Rui Wang wrote: >> >>> Thank you Udi for taking care of Beam 2.18.0 release! >>> >>> >>> >>> -Rui

Re: [ANNOUNCE] Beam 2.18.0 Released

Thanks Udi! On Tue, Jan 28, 2020 at 11:09 AM Pablo Estrada wrote: > Thanks Udi! > > On Tue, Jan 28, 2020 at 11:08 AM Rui Wang wrote: > >> Thank you Udi for taking care of Beam 2.18.0 release! >> >> >> >> -Rui >> >> On Tue, Jan 28, 2020 at 10:59 AM Udi Meiri wrote: >> >>> The Apache Beam team

Re: [ANNOUNCE] Beam 2.18.0 Released

Thanks Udi! On Tue, Jan 28, 2020 at 11:08 AM Rui Wang wrote: > Thank you Udi for taking care of Beam 2.18.0 release! > > > > -Rui > > On Tue, Jan 28, 2020 at 10:59 AM Udi Meiri wrote: > >> The Apache Beam team is pleased to announce the release of version 2.18.0. >> >> Apache Beam is an open

Re: [ANNOUNCE] Beam 2.18.0 Released

Thank you Udi for taking care of Beam 2.18.0 release! -Rui On Tue, Jan 28, 2020 at 10:59 AM Udi Meiri wrote: > The Apache Beam team is pleased to announce the release of version 2.18.0. > > Apache Beam is an open source unified programming model to define and > execute data processing

[ANNOUNCE] Beam 2.18.0 Released

The Apache Beam team is pleased to announce the release of version 2.18.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release

Using very slow changing stream of data (KV) as side input

Hi, This is Mohil Khare from San Jose, California. I work in an early stage startup: Prosimo. We use Apache beam with gcp dataflow for all real time stats processing with Kafka and Pubsub as data source while elasticsearch and GCS as sinks. I am trying to solve the following use with sideinputs.

Re: [ANNOUNCE] New committer: Michał Walenia

Congrats you Michal! On Tue, Jan 28, 2020 at 9:11 AM Gleb Kanterov wrote: > Congratulations! > > On Tue, Jan 28, 2020 at 6:03 PM Łukasz Gajowy wrote: > >> Congratulations Michał!  >> >> wt., 28 sty 2020 o 16:33 Ryan Skraba napisał(a): >> >>> Congratulations! >>> >>> On Tue, Jan 28, 2020

Re: Subclassing MapElements

Yeah it just seems like a lot of boiler plate to do builders with lots of methods just to wrap a MapElements type for syntactic convenience. After thinking this over last night I’m wondering if it wouldn’t be better to use static factory methods for these, so rather than the following, which

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations! On Tue, Jan 28, 2020 at 6:03 PM Łukasz Gajowy wrote: > Congratulations Michał!  > > wt., 28 sty 2020 o 16:33 Ryan Skraba napisał(a): > >> Congratulations! >> >> On Tue, Jan 28, 2020 at 11:26 AM Jan Lukavský wrote: >> >>> Congrats Michał! >>> On 1/28/20 11:16 AM, Katarzyna

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michał!  wt., 28 sty 2020 o 16:33 Ryan Skraba napisał(a): > Congratulations! > > On Tue, Jan 28, 2020 at 11:26 AM Jan Lukavský wrote: > >> Congrats Michał! >> On 1/28/20 11:16 AM, Katarzyna Kucharczyk wrote: >> >> Congratulations Michał!   >> >> On Tue, Jan 28, 2020 at 9:29

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations! On Tue, Jan 28, 2020 at 11:26 AM Jan Lukavský wrote: > Congrats Michał! > On 1/28/20 11:16 AM, Katarzyna Kucharczyk wrote: > > Congratulations Michał!   > > On Tue, Jan 28, 2020 at 9:29 AM Alexey Romanenko > wrote: > >> Congrats, Michał! >> >> On 28 Jan 2020, at 09:20,

Re: Jenkins jobs not running for my PR 10438

done On Tue, Jan 28, 2020 at 12:41 PM Rehman Murad Ali < rehman.murad...@venturedive.com> wrote: > Hi Committer, > > Could anyone run jobs for this PR? > > https://github.com/apache/beam/pull/10627 > > *Thanks* > > > *Rehman Murad Ali* > Software Engineer > Mobile: +92 3452076766 > Skype:

Re: New contributor

Thanks Ismaël ! Le mar. 28 janv. 2020 à 12:08, Ismaël Mejía a écrit : > You were added to JIRA. Enjoy! > > On Tue, Jan 28, 2020 at 12:04 PM Ludovic Boutros > wrote: > >> Dear all, >> >> please, could you add me as a contributor in Jira ? My user name is >> lboutros. >> >> Thank you, >> >>

Re: New contributor

Welcome aboard. Regards JB On 28/01/2020 14:14, Ludovic Boutros wrote: > Thanks Ismaël ! > > > > Le mar. 28 janv. 2020 à 12:08, Ismaël Mejía > a écrit : > > You were added to JIRA. Enjoy! > > On Tue, Jan 28, 2020 at 12:04 PM Ludovic Boutros

Re: Jenkins jobs not running for my PR 10438

Hi Committer, Could anyone run jobs for this PR? https://github.com/apache/beam/pull/10627 *Thanks* *Rehman Murad Ali* Software Engineer Mobile: +92 3452076766 Skype: rehman.muradali On Mon, Jan 27, 2020 at 6:21 PM Rehman Murad Ali < rehman.murad...@venturedive.com> wrote: > Thanks,

Re: New contributor

You were added to JIRA. Enjoy! On Tue, Jan 28, 2020 at 12:04 PM Ludovic Boutros wrote: > Dear all, > > please, could you add me as a contributor in Jira ? My user name is > lboutros. > > Thank you, > > Ludovic. >

New contributor

Dear all, please, could you add me as a contributor in Jira ? My user name is lboutros. Thank you, Ludovic.

Re: [ANNOUNCE] New committer: Michał Walenia

Congrats Michał! On 1/28/20 11:16 AM, Katarzyna Kucharczyk wrote: Congratulations Michał!   On Tue, Jan 28, 2020 at 9:29 AM Alexey Romanenko mailto:aromanenko@gmail.com>> wrote: Congrats, Michał! On 28 Jan 2020, at 09:20, Ismaël Mejía mailto:ieme...@gmail.com>> wrote:

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michał!   On Tue, Jan 28, 2020 at 9:29 AM Alexey Romanenko wrote: > Congrats, Michał! > > On 28 Jan 2020, at 09:20, Ismaël Mejía wrote: > > Congratulations Michał, well deserved! > > On Tue, Jan 28, 2020 at 8:54 AM Kamil Wasilewski < > kamil.wasilew...@polidea.com> wrote: >

Re: [ANNOUNCE] New committer: Michał Walenia

Congrats, Michał! > On 28 Jan 2020, at 09:20, Ismaël Mejía wrote: > > Congratulations Michał, well deserved! > > On Tue, Jan 28, 2020 at 8:54 AM Kamil Wasilewski > mailto:kamil.wasilew...@polidea.com>> wrote: > Congrats, Michał! > > On Tue, Jan 28, 2020 at 3:03 AM Udi Meiri

Re: [ANNOUNCE] New committer: Michał Walenia

Congratulations Michał, well deserved! On Tue, Jan 28, 2020 at 8:54 AM Kamil Wasilewski < kamil.wasilew...@polidea.com> wrote: > Congrats, Michał! > > On Tue, Jan 28, 2020 at 3:03 AM Udi Meiri wrote: > >> Congratulations Michał! >> >> On Mon, Jan 27, 2020 at 3:49 PM Chamikara Jayalath >>