Re: [ANNOUNCE] New Committer: Byron Ellis

Congratulations Byron! On Tue, Oct 17, 2023 at 2:49 AM Jan Lukavský wrote: > Congrats Byron! > On 10/16/23 22:33, Austin Bennett wrote: > > thanks, Byron! > > On Mon, Oct 16, 2023 at 12:38 PM XQ Hu via dev > wrote: > >> Congratulations! >> >> On Mon, Oct 16, 2023 at 1:58 PM Ahmet Altay via dev

Re: [ANNOUNCE] New PMC Member: Robert Burke

Congratulations Robert! On Tue, Oct 3, 2023 at 2:52 PM Danny McCormick via dev wrote: > Congrats Robert, this is very well deserved! > > On Tue, Oct 3, 2023 at 2:50 PM Anand Inguva via dev > wrote: > >> Congratulations!! >> >> On Tue, Oct 3, 2023 at 2:49 PM XQ Hu via dev wrote: >> >>>

Re: [ANNOUNCE] New PMC Member: Valentyn Tymofieiev

Congratulations Valentyn! On Tue, Oct 3, 2023 at 2:53 PM Jack McCluskey via dev wrote: > Congrats Valentyn! > > On Tue, Oct 3, 2023 at 2:40 PM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming Valentyn >> Tymofieiev as our newest PMC member. >>

Re: [ANNOUNCE] New PMC Member: Alex Van Boxel

Congratulations Alex! On Tue, Oct 3, 2023 at 2:54 PM Danny McCormick via dev wrote: > Congrats Alex, this is well deserved! > > On Tue, Oct 3, 2023 at 2:50 PM Jack McCluskey via dev > wrote: > >> Congrats, Alex! >> >> On Tue, Oct 3, 2023 at 2:49 PM XQ Hu via dev wrote: >> >>> Configurations,

Re: [VOTE] Release 2.51.0, release candidate #1

+1 (non-binding) validated Go SDK quickstart and Python Streaming quickstart on Dataflow runner. Thanks! On Tue, Oct 3, 2023 at 5:40 PM XQ Hu via dev wrote: > +1 (non-binding). Tested the simple dataflow ML starter job with >

Re: [ANNOUNCE] New committer: Ahmed Abualsaud

Congrats Ahmed! On Fri, Aug 25, 2023 at 9:53 AM Kerry Donny-Clark via dev < dev@beam.apache.org> wrote: > Well done Ahmed! > > On Fri, Aug 25, 2023 at 9:17 AM Danny McCormick via dev < > dev@beam.apache.org> wrote: > >> Congrats Ahmed! >> >> On Fri, Aug 25, 2023 at 3:16 AM Jan Lukavský wrote:

[RFC] State & Timers API Design for Go SDK

Hey everyone, Danny and I have been working on designing the state and timers for Go SDK. We wrote a design doc with user-facing API, execution details, and different alternatives considered. It would be really helpful if we could get your suggestions/feedback/comments on the design. Design

Re: [ANNOUNCE] New committer: John Casey

Congratulations John! On Fri, Jul 29, 2022 at 5:01 PM Ahmed Abualsaud via dev wrote: > Congrats John, what a great addition! > > On Fri, Jul 29, 2022 at 4:56 PM Kerry Donny-Clark via dev < > dev@beam.apache.org> wrote: > >> John, you have made a huge impact on the many, many users of Kafka and

Re: [VOTE] Release 2.41.0, release candidate #2

+1 (non-binding) validated Go SDK QuickStart on Direct and Dataflow Runner On Fri, Aug 19, 2022 at 11:23 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > +1 (binding) > > Did the same validations as RC1. > > Thanks, > Cham > > On Fri, Aug 19, 2022 at 4:36 AM Alexey Romanenko >

Re: (Golang)HOW TO WRITE BIGQUERY TABLE USING SUSCRIBE TO PUBSUB MESSAGE.THROUGH APACHE BEAM IN GOLANG.

Hi, The bigqueryio.Write() infers a schema type from the PCollection you are writing. In the code, you are directly writing the output of pubsubio.Read which is of []byte. You need to do insert a ParDo that would decode and convert it to schema (Schema in go SDK is just a struct with exported

Re: [VOTE] Release 2.42.0, release candidate #2

+1 (non-binding) Validated Go SDK Quickstart on Direct and Dataflow runner. Thanks, Ritesh Ghorse On Thu, Oct 13, 2022 at 4:01 PM Pablo Estrada via dev wrote: > +1 (binding) > > I've validated local/unit tests for existing dataflow templates. They look > good! > Best > -P. > > On Thu, Oct 13,

Re: Avoid breaking change when adding an additional parameter to the RunInference PTransform

Thanks for the suggestion. The suggested approach looks good to me and wouldn't break the cross-language wrapper as far as RunInference wrapper for Go SDK (in process) is concerned. On Fri, Sep 30, 2022 at 10:48 AM Andy Ye via dev wrote: > Thanks Anand! I think following this framework will

Re: [VOTE] Release 2.42.0, release candidate #1

+1 (non-binding) Validated Go SDK Quickstart on Direct and Dataflow runner On Mon, Oct 3, 2022 at 9:38 AM Alexey Romanenko wrote: > +1 (binding) > > Tested with https://github.com/Talend/beam-samples/ > (Java SDK v8 & v11, Spark 3 runner). > > --- > Alexey > > On 3 Oct 2022, at 14:32,

Re: [VOTE] Release 2.41.0, release candidate #1

+1 (non-binding), Validated Go SDK Quickstart on Direct and Dataflow runner On Tue, Aug 16, 2022 at 4:26 AM Jan Lukavský wrote: > +1 (non-binding) > > Validated Java SDK with classical Flink Runner. > On 8/15/22 23:06, Chamikara Jayalath via dev wrote: > > +1 as well > (I believe Kiley is

[RFC] Tensorflow model handler in Beam Repository

Hey everyone, I've written a short doc to add a new tensorflow model handler to make it easy to use for beam users and consistent with other model handlers. Feel free to add your comments, questions and feedback. Doc:

Re: [ANNOUNCE] New committer: Ritesh Ghorse

Thanks everyone! I'm glad to be a part of this community and I look forward to making more contributions in whatever ways I can. On Fri, Nov 4, 2022 at 12:36 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Congrats, Ritesh! > > On Fri, Nov 4, 2022 at 9:34 AM John Casey via dev >

Re: Support existing IOs with Schema Transforms

Thanks for writing this! Having schema transform supported IOs would ease up writing multi-language wrappers in Go SDK. On Thu, Nov 3, 2022 at 2:36 PM Sachin Agarwal via dev wrote: > I think this is a great idea - making any many existing IOs as possible > available to developers in any

Re: [VOTE] Release 2.43.0, release candidate #1

The Dataframe wrapper in Go SDK is failing because of https://github.com/apache/beam/issues/24065. I have a PR here to unblock the release. The current PR allows Dataframe wrapper to work as expected but proper fix should be added while merging

Re: [ANNOUNCE] New committer: Yi Hu

Congratulations Yi! On Wed, Nov 9, 2022 at 1:34 PM Ahmed Abualsaud via dev wrote: > Congrats Yi! > > On Wed, Nov 9, 2022 at 1:33 PM Sachin Agarwal via dev > wrote: > >> Congratulations Yi! >> >> On Wed, Nov 9, 2022 at 10:32 AM Kenneth Knowles wrote: >> >>> Hi all, >>> >>> Please join me and

Re: [VOTE] Release 2.43.0, release candidate #2

+1 (non-binding) Validated Go SDK quickstart on Direct and Dataflow runner. Also validated Dataframe wrapper on Portable and Dataflow runner. On Tue, Nov 15, 2022 at 5:17 AM Anand Inguva via dev wrote: > +1(non-binding) > > Validated Python wordcount example on Direct and Dataflow runner.

Re: [VOTE] Release 2.46.0, release candidate #1

+1 (non-binding) Validated Go SDK quickstart on direct and dataflow runner On Tue, Mar 7, 2023 at 10:54 AM Alexey Romanenko wrote: > +1 (binding) > > Tested with https://github.com/Talend/beam-samples/ > (Java SDK v8/v11/v17, Spark 3.x runner). > > --- > Alexey > > On 7 Mar 2023, at 07:38,

Re: [ANNOUNCE] New committer: Anand Inguva

Congratulations Anand! On Fri, Apr 21, 2023 at 3:24 PM Ahmed Abualsaud via dev wrote: > Congrats Anand! > > On Fri, Apr 21, 2023 at 3:18 PM Anand Inguva via dev > wrote: > >> Thanks everyone. Really excited to be a part of Beam Committers. >> >> On Fri, Apr 21, 2023 at 3:07 PM XQ Hu via dev

Re: [ANNOUNCE] New committer: Damon Douglas

Congratulations Damon! On Tue, Apr 25, 2023 at 12:03 AM Byron Ellis via dev wrote: > Congrats Damon! > > On Mon, Apr 24, 2023 at 8:57 PM Austin Bennett wrote: > >> thanks for all you do @Damon Douglas ! >> >> On Mon, Apr 24, 2023 at 1:00 PM Robert Burke wrote: >> >>> Congratulations Damon!!!

Re: Go + Apache Beam GCP Dataflow: Could not find the sink for pubsub, Check that the sink library specifies alwayslink = 1

I've added a comment to the StackOverflow question . I guess the suggested approach there is the workaround for now, unfortunately. You have to create a new client in the

Re: [VOTE] Release 2.45.0, Release Candidate #1

+1 (non-binding) Validated: 1. Go SDK Quickstart on Direct & Dataflow runner. 2. Dataframe wrapper 3. RunInference Wrapper for Sklearn On Mon, Feb 13, 2023 at 2:56 PM Robert Bradshaw via dev wrote: > +1 (binding) > > Validated release artifacts and signatures and tested a couple of > Python

[VOTE] Release 2.48.0 release candidate #2

Hi everyone, Please review and vote on the release candidate #2 for the version 2.48.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no

Re: 2.48.0 Release PMC Finalization

Sure, let me know once that is done, I'll send out the announcement email. Thank you! On Thu, Jun 1, 2023 at 1:55 AM Jean-Baptiste Onofré wrote: > Hi > > I can do that today if there's no other PMC available. > > Regards > JB > > On Thu, Jun 1, 2023 at 2:02 AM Ritesh

[RESULT] [VOTE] Release 2.48.0, release candidate #2

I'm happy to announce that we have unanimously approved this release. There are 7 approving votes, 5 of which are binding: * Alexey Romanenko * Ahmet Altay * Reuven Lax * Robert Bradshaw * Chamikara Jayalath Thank you to the following non-binding voters for helping with validation: * Bruno

Re: 2.48.0 Release PMC Finalization

out the announcement email. > > Thank you! > > On Thu, Jun 1, 2023 at 1:55 AM Jean-Baptiste Onofré > wrote: > >> Hi >> >> I can do that today if there's no other PMC available. >> >> Regards >> JB >> >> On Thu, Jun 1, 2023 at 2:02 

Re: [RESULT] [VOTE] Release 2.48.0, release candidate #2

Could someone from the `beammaintainers DockerHub team` please help deploy the docker images for release [1] Thanks! [1] https://beam.apache.org/contribute/release-guide/#9-prepare-documents:~:text=to%20be%20uploaded.)-,Deploy%20docker%20images%20to%20DockerHub,-Note%3A%20if%20you On Wed, May

Re: [Release-2.48.0] Uploading images to dockerhub

>>>>> this should block us from getting an RC out for validation though since it >>>>> just breaks a small set of use cases which we can validate once the >>>>> containers are pushed if needed. >>>>> >>>> >>>> It's great if you ca

Re: [VOTE] Release 2.48.0 release candidate #1

Correction to previous email: ** *Java artifacts were built with Gradle 7.5.1 and OpenJDK/Oracle JDK 8.0.322. *** On Wed, May 24, 2023 at 6:20 PM Ritesh Ghorse wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 2.48.0, > as follows: > [ ] +1, Approve the

[VOTE] Release 2.48.0 release candidate #1

Hi everyone, Please review and vote on the release candidate #1 for the version 2.48.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) Reviewers are encouraged to test their own use cases with the release candidate, and vote +1 if no

Re: [VOTE] Release 2.48.0 release candidate #1

Dataflow containers are now released for Java and Go SDK. But looks like we are likely heading towards RC-2 with critical cherry-picks for BigQuery IO this morning: 1. https://github.com/apache/beam/pull/26887 2. https://github.com/apache/beam/pull/26886 I'll get RC2 going as soon as I can but

[ANNOUNCE] Beam 2.48.0 Released

The Apache Beam Team is pleased to announce the release of version 2.48.0. You can download the release here: https://beam.apache.org/get-started/downloads/ This release includes bug fixes, features, and improvements detailed on the Beam Blog: https://beam.apache.org/blog/beam-2.48.0/ and the

2.48.0 Release PMC Finalization

Could a PMC member help with the PMC-only finalization steps for 2.48.0 [1]? Specifically: - Deploy source release to dist.apache.org - Recordkeeping with ASF Once those steps are done all that's left is to promote the release [2]. Thank you! [1]

Re: [VOTE] Release 2.48.0 release candidate #2

acy runner (runner v2 disabled) will fail. I kicked off the >> container release, so that should hopefully be available later today. >> >> Thanks, >> Danny >> >> On Thu, May 25, 2023 at 11:19 PM Ritesh Ghorse via dev < >> dev@beam.apache.org> wrote: &g

[Release-2.48.0] Uploading images to dockerhub

Hey everyone, I'm at the stage of pushing docker containers to the apache repository of [Dockerhub](https://hub.docker.com/search?q=apache%2Fbeam=image). Since I'm not a part of the `beammaintainers` group, I'm getting permission denied. For the people in the `beammaintainers` group, please let

[Proposal] Hugging Face Model Handler

Hey everyone, I've written a short doc to implement the Hugging Face model handler. This would enable loading models from Hugging Face directly and use it in RunInference. I've discussed a couple of approaches from users' point of view in the doc, feel free to comment and suggest what you think.

Re: [VOTE] Release 2.47.0, release candidate #3

+1 (non-binding) Validated Go SDK Quickstart on Direct and Dataflow runner On Wed, May 10, 2023 at 4:23 AM Jan Lukavský wrote: > +1 (binding) > > Tested with Java SDK and FlinkRunner. > > Jan > On 5/9/23 08:44, Chamikara Jayalath via dev wrote: > > Verified that new containers are valid.

Re: [PROPOSAL] Preparing for 2.48.0 Release

gt;>>> On Thu, May 4, 2023 at 1:58 AM Kenneth Knowles >>>>> wrote: >>>>> >>>>>> Excellent, thank you! >>>>>> >>>>>> On Wed, May 3, 2023 at 7:21 AM Ahmet Altay via dev < >>>>>> dev@be

[PROPOSAL] Preparing for 2.48.0 Release

Hey everyone, The next release branch 2.48.0 cut is scheduled for May 17th, according to the release calendar [1]. I would like to volunteer myself to do this release. I'll cut the branch on the scheduled date, and cherrypick release-blocking fixes later. Please help me make sure the release

Re: [PROPOSAL] Preparing for 2.48.0 Release

;>> >>> >>>>> Thank you! @Ahmet Altay >>> >>>>> >>> >>>>> On Thu, May 4, 2023 at 10:17 AM Ahmet Altay >>> wrote: >>> >>>>>> >>> >>>>>> It is every 6 weeks. There is also a publis

Re: [PROPOSAL] Preparing for 2.48.0 Release

gt;>>> >>>>> >>>> >>>>> On Thu, May 4, 2023 at 10:17 AM Ahmet Altay >>>> wrote: >>>> >>>>>> >>>> >>>>>> It is every 6 weeks. There is also a published calendar for >>>

Beam 2.48.0 Branch Cut

Hey everyone, The release branch for 2.48.0 has been cut. There is currently one outstanding change I'm waiting to be cherry-picked [1]. Also I discovered another task failure [2] on `Run Gradle Publish` linked in the milestone [3]. Once these are resolved, I'll move ahead to building an RC1.

Re: [VOTE] Release 2.54.0, release candidate #2

+1 (non-binding) Ran a few batch and streaming examples for Python SDK on Dataflow Runner Thanks! On Wed, Feb 7, 2024 at 4:08 AM Jan Lukavský wrote: > +1 (binding) > > Validated Java SDK with Flink runner. > > Jan > On 2/7/24 06:23, Robert Burke via dev wrote: > > Hi everyone, > Please

[RFC] Enrichment Transform Design

Hey everyone, I've written a doc for a new Enrichment Transform in Beam. I will note that this transform will be built on top of RequestResponseIO (Implementation

Re: [VOTE] Release 2.52.0, release candidate #3

+1 (non-binding) Validated Python SDK quickstart batch and streaming. Thanks! On Thu, Nov 9, 2023 at 9:25 AM Jan Lukavský wrote: > +1 (binding) > > Validated Java SDK with Flink runner on own use cases. > Jan > > On 11/9/23 03:31, Danny McCormick via dev wrote: > > Hi everyone, > Please

Re: [VOTE] Release 2.55.0, release candidate #3

+1 (non-binding) - Ran a few python batch examples on Direct and Dataflow runner. Thanks! On Tue, Mar 19, 2024 at 10:56 AM Yi Hu via dev wrote: > Hi everyone, > Please review and vote on the release candidate #3 for the version 2.55.0, > as follows: > > [ ] +1, Approve the release > [ ] -1, Do

Re: [VOTE] Release 2.55.0, release candidate #1

+1 (non-binding) Ran a few batch and streaming examples with Python 3.9. Thanks! On Tue, Mar 12, 2024 at 10:21 AM Yi Hu via dev wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 2.55.0, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not

Re: [VOTE] Release 2.56.0, release candidate #2

+1 (non-binding) Ran a few python pipelines on Direct and Dataflow runner Thanks! On Wed, May 1, 2024 at 10:00 AM Jeff Kinard via dev wrote: > +1 (non-binding) > > Validated Dataflow YamlTemplate using Java and Python transforms (xlang) > and several Beam YAML tests. > > Thanks, > Jeff > > On