Re: Beam ML Use Cases - Google Summer of Code 2023

Thank you for your hard work and writing this Reeba! @Danielle Syse - could we please share this on Beam's social channels? On Wed, Sep 13, 2023 at 10:54 AM Danny McCormick via dev < dev@beam.apache.org> wrote: > Thanks for all your hard work this summer Reeba! I've really enjoyed > getting to

Re: [VOTE] Release 2.50.0, release candidate #2

+1 (binding). I validated python quick starts on direct and dataflow runners. Thank you for working on the release! On Mon, Aug 28, 2023 at 8:48 AM Robert Burke wrote: > Good morning! > > RC2 validation and vote is still open! > > On Sun, Aug 27, 2023, 1:28 PM XQ Hu via dev wrote: > >> +1 >>

Re: Disabling Jenkins Jobs

Thank you for doing this. Is there a list of jobs that will be disabled? I am particularly curious about: website publishing job (which I need to use manually sometimes) and the job that publishes daily staging builds (which we share with users sometimes.) Thank you. Ahmet On Tue, Sep 12, 2023

Re: [ANNOUNCE] New Committer: Sam Whittle

Congratulations Sam! On Mon, Oct 16, 2023 at 10:42 AM Byron Ellis via dev wrote: > Congrats Sam! > > On Mon, Oct 16, 2023 at 10:32 AM Chamikara Jayalath via dev < > dev@beam.apache.org> wrote: > >> Congrats Sam! >> >> On Mon, Oct 16, 2023 at 9:32 AM Kenneth Knowles wrote: >> >>> Hi all, >>>

Re: [ANNOUNCE] New Committer: Byron Ellis

Congratulations Byron! On Mon, Oct 16, 2023 at 10:35 AM Tomo Suzuki via dev wrote: > Congratulations! > > > On Mon, Oct 16, 2023 at 1:33 PM Chamikara Jayalath via dev < > dev@beam.apache.org> wrote: > >> Congrats Byron! >> >> On Mon, Oct 16, 2023 at 9:32 AM Kenneth Knowles wrote: >> >>> Hi

Re: Beam High Priority Issue Report (43)

Do people find these emails useful? It does not look like we are acting on these? Could we consider turning them off or finding a way to make those more useful (e.g. just list issues created/changed in th last week, or auto-downgrade to P2 after N month etc.) And this section "P1 Issues with no

Re: [ANNOUNCE] New PMC Member: Alex Van Boxel

Congratulations Alex! Well deserved! On Tue, Oct 3, 2023 at 11:54 AM Ritesh Ghorse via dev wrote: > Congratulations Alex! > > On Tue, Oct 3, 2023 at 2:54 PM Danny McCormick via dev < > dev@beam.apache.org> wrote: > >> Congrats Alex, this is well deserved! >> >> On Tue, Oct 3, 2023 at 2:50 PM

Re: [ANNOUNCE] New PMC Member: Valentyn Tymofieiev

Congratulations Valentyn! Well deserved! On Tue, Oct 3, 2023 at 11:54 AM Ritesh Ghorse via dev wrote: > Congratulations Valentyn! > > On Tue, Oct 3, 2023 at 2:53 PM Jack McCluskey via dev > wrote: > >> Congrats Valentyn! >> >> On Tue, Oct 3, 2023 at 2:40 PM Kenneth Knowles wrote: >> >>> Hi

Re: [ANNOUNCE] New PMC Member: Robert Burke

Congratulations Robert! Well deserved! On Tue, Oct 3, 2023 at 11:54 AM Ritesh Ghorse via dev wrote: > Congratulations Robert! > > On Tue, Oct 3, 2023 at 2:52 PM Danny McCormick via dev < > dev@beam.apache.org> wrote: > >> Congrats Robert, this is very well deserved! >> >> On Tue, Oct 3, 2023 at

Re: [VOTE] Release 2.51.0, release candidate #1

+1 (binding) - reviewed doc updates. On Thu, Oct 5, 2023 at 12:28 AM Jan Lukavský wrote: > +1 (binding) > > Tested Java SDK with Flink Runner on own test-cases. > > Jan > On 10/4/23 21:10, Bruno Volpato via dev wrote: > > +1 (non-binding). > > Tested with

Re: [VOTE] Release 2.51.0, release candidate #1

Thank you for the information. I agree with Kenn in that case. This could wait for the next release. Unless there is another reason to do the RC2. On Tue, Oct 10, 2023 at 12:30 PM Yi Hu wrote: > > Would it impact all python users including breaking the new user, quick >> start experience? Or

Re: [VOTE] Release 2.51.0, release candidate #1

Would it impact all python users including breaking the new user, quick start experience? Or would it impact users of a specific IO or configuration? If it is the former, I think it would be worth fixing it just to have a working new user experience. With new user experience I am thinking about

Re: Beam Website Feedback

Explicitly adding Jonas in case he is not subscribed to the dev list. On Thu, Aug 24, 2023 at 5:50 AM Kerry Donny-Clark via dev < dev@beam.apache.org> wrote: > Thanks Jonas. Can you please submit a quick PR to update the text? I'm > happy to review. > Kerry > > On Wed, Aug 23, 2023, 10:03 PM

[ANNOUNCE] New committer: Ahmed Abualsaud

Hi all, Please join me and the rest of the Beam PMC in welcoming a new committer: Ahmed Abualsaud (ahmedabuals...@apache.org). Ahmed has been part of the Beam community since January 2022, working mostly on IO connectors, made a large amount of contributions to make Beam IOs more usable,

Re: [Request for Feedback] Mechanism for "Beam Website Feedback"

Thank you XQ! For reference, responses are going to this spreadsheet [1] for now. We can set up an email trigger for that if people here think it would be useful. [1] https://docs.google.com/spreadsheets/d/1bvPFLgMamtYXiUULjx3JY-b1SB-voUqaj6o1UMqTgX4/edit?usp=sharing -- not shared by default,

Re: [ANNOUNCE] New committer: Steven Niemitz

Congratulations Steve! On Thu, Jul 21, 2022 at 10:31 AM Steve Niemitz via dev wrote: > Thanks everyone! > > On Thu, Jul 21, 2022 at 2:23 AM Moritz Mack wrote: > >> Congrats, Steven! >> >> >> >> On 21.07.22, 05:25, "Evan Galpin" wrote: >> >> >> >> Congrats! Well deserved! On Wed, Jul 20, 2022

Re: [ANNOUNCE] New committer: John Casey

Congratulations John! On Fri, Jul 29, 2022 at 2:03 PM Svetak Sundhar via dev wrote: > Congrats John!! > > > Svetak Sundhar > > Technical Solutions Engineer, Data > s vetaksund...@google.com > > > > On Fri, Jul 29, 2022 at 5:02 PM Ritesh Ghorse via dev > wrote: > >> Congratulations John! >>

Re: Extending 2.41.0 Java snapshot TTL

Thank you for the email Daniel. Adding people who could help: @Kenneth Knowles @Danny McCormick @Chamikara Jayalath @John Casey @Byron Ellis On Thu, Jul 21, 2022, 4:14 PM Daniel Thevessen via dev wrote: > Hi all, > > The Java Firestore connector had a bug >

Re: Java & Python Project Starter / Example Using Terraform to build Dataflow Custom Templates

Thank you for sharing Damon. On Tue, Aug 23, 2022 at 9:34 AM Damon Douglas via dev wrote: > Hello Everyone, > > You can ignore this email if you do not use the Dataflow runner. > > We just published an example / project starter that shows how to build > Dataflow Custom Templates provisioned

Re: [ANNOUNCE] Apache Beam 2.41.0 Released

Thank you Kiley! On Fri, Aug 26, 2022 at 6:38 AM P Singh wrote: > Hi Team, > > Looking forward to trying and testing the new version, It's always > fascinating. > > On Fri, 26 Aug 2022 at 03:45, Pablo Estrada via user > wrote: > >> Thank you Kiley! >> >> On Thu, Aug 25, 2022 at 10:55 AM Kiley

Re: [VOTE] Release 2.41.0, release candidate #2

+1 - I valited python quickstarts on the directrunner. Thank you Kiley! On Thu, Aug 18, 2022 at 1:31 PM Kiley Sok via dev wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 2.41.0, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the

Re: Beam Website Feedback

Thank you Tianzi. Adding relevant folks: @John Casey On Mon, Aug 22, 2022 at 3:03 PM Tianzi Cai via dev wrote: > According to this page, > https://beam.apache.org/documentation/io/connectors/, KinesisIO doesn't > have Python implementation, but I found >

Re: Beam Website Feedback: Apache Beam WordCount Examples

Thank you for reporting William. Adding @Valentyn Tymofieiev . Perhaps we could start with creating an issue? On Mon, Oct 24, 2022 at 9:25 AM William Pietri wrote: > Hi! I have inherited code using Apache Beam and I'm trying to figure out > the right way to use it. > > This seemed like it

Re: Rest connector

/cc @John Casey On Mon, Sep 12, 2022 at 12:03 PM Reddy annapureddy, Vijayas (V.) < vredd...@ford.com> wrote: > Hi Team, > > We are planning to use Apache beam for a new microservice project which is > in the discovery phase. Apache beam pipeline will read data from GCS and > send data to other

Re: Beam Website Feedback

Thank you for the feedback Peter. /cc @Reza Rokni @David Cavazos for visibility. On Fri, Sep 9, 2022 at 2:51 PM Austin Bennett wrote: > Any chance you've seen a GH Issue for that? If not, please feel free to > file one :-) > > https://github.com/apache/beam/issues > > On Fri, Sep 9, 2022 at

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

+1 - Thank you Cham! On Wed, Oct 5, 2022 at 1:38 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Hi all, > > The next (2.43.0) release branch cut is scheduled for October 19th, > according to the release calendar [1]. > > I would like to volunteer myself to do this release. My plan

Re: [VOTE] Release 2.42.0, release candidate #1

+1 (binding) - I validated python quick starts on direct runner. Thank you for working on the release! Ahmet On Mon, Oct 3, 2022 at 9:06 AM Valentyn Tymofieiev via dev < dev@beam.apache.org> wrote: > I validated that Dataflow and Beam Python containers have dependencies > that match Beam

Re: [VOTE] Release 2.42.0, release candidate #2

+1 (binding) Tested python quickstart examples on the direct runner. Thank you! On Thu, Oct 13, 2022 at 5:35 PM Robert Bradshaw via dev wrote: > +1 (binding) > > Validated release artifacts and signatures. Tested a Python pipeline > on a clean install. > > On Thu, Oct 13, 2022 at 1:22 PM

Re: [Release] 2.41.0 release update

Kiley, do we still have the same blockers? Do you need any help? On Thu, Aug 4, 2022 at 12:18 PM Kiley Sok via dev wrote: > Last remaining issue was cherry-picked. There may be one last issue with > gRPC that's being investigated. > > https://github.com/apache/beam/issues/22283 > > On Thu, Jul

Re: Community event cooperation

ill invest resources to hold this technical exchange meetup, >>>> collide with the developers on speech topics, and promote together, and we >>>> will give the greatest support in China. This event, let more developers >>>> know about Apache Beam >>>> &

Re: [VOTE] Release 2.41.0, release candidate #1

+1 - I validated python quickstarts on direct runner. Thank you Kiley! On Thu, Aug 11, 2022 at 9:56 PM Kiley Sok via dev wrote: > Hi everyone, > Please review and vote on the release candidate #1 for the version 2.41.0, > as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the

Re: Forward StackOverflow questions with the apache-beam tag to a new mailing list

+1 to this idea. I think both options are reasonable. At the same time I also agree with checking with infra first on the feasibility of creating another mailing list. On Wed, Aug 17, 2022 at 10:00 AM Chamikara Jayalath wrote: > > > On Wed, Aug 17, 2022 at 9:18 AM Robert Bradshaw > wrote: >

Re: Community event cooperation

Hi Niko, Thank you for reaching out. We do have contributors who might be interested in participating but they might have limited time for participating in an event. If you can clarify what are you looking for (e.g. speaker? help with coordination? etc.) people might be able to give you a better

Re: Beam Website Feedback

I did a search and found a few places with the broken link. Correct links should be: https://beam.apache.org/get-started/resources/videos-and-podcasts/ I created a PR to update the website ( https://github.com/apache/beam/pull/24733). I do not know if that is the best solution. As an alternative

Re: [VOTE] Release 2.44.0, release candidate #1

I validated python quick starts (direct, dataflow) X (batch, streaming). I ran into an issue with the dataflow batch case, running the wordcount with the standard: python -m apache_beam.examples.wordcount \ --output \ --staging_location \ --temp_location \ --runner DataflowRunner \ --job_name

Fwd: MODERATE for dev@beam.apache.org

Forwarding, because this message got lost in the list moderation. -- Forwarded message -- From: bharataamer...@icloud.com To: dev@beam.apache.org Cc: Bcc: Date: Sat, 24 Dec 2022 13:36:09 +0530 Subject: Wanna contribute to this project guide where to start Hi, I am new to this

Re: Beam Website Feedback

> > > > Btw, I’m not sure that we still check the broken links as it was before, > iirc, but probably it would be a good idea to add such check before > publishing a website. > > > > I agree. I also do not know about the state of this. It would be good to > add that link

Re: [VOTE] Release 2.44.0, release candidate #1

+1 (binding) - my concerns are addressed. On Wed, Jan 11, 2023 at 3:44 PM Valentyn Tymofieiev wrote: > +1. I validated that Dataflow and Beam Python containers include necessary > dependencies of Apache Beam and did additional validation (see inline). > > On Wed, Jan 11, 2023 at 12:48 AM Ahmet

Fwd: Beam Java SDK - ReadableState.read() shouldn't it be Nullable?

Forwarding, because this message got lost in the list moderation. -- Forwarded message -- From: Jeeno Lentin To: dev@beam.apache.org Cc: Bcc: Date: Fri, 23 Dec 2022 00:36:55 -0500 Subject: Beam Java SDK - ReadableState.read() shouldn't it be Nullable? Hi, We use the Beam Java

Re: [Proposal] | Move FileIO and TextIO from :sdks:java:core to :sdks:java:io:file

I agree with Sachin. Keeping components that users will have to bring together anyway leads to a better user experience. Counter example to that is GCP libraries in my opinion. It was a frequent struggle for users to find a working set of libraries until there was a BOM. And even after the BOM it

Re: A Declarative API for Apache Beam

+1 to both of these proposals. In the past 12 months I have heard of at least 3 YAML implementations built on top of Beam in large production systems. Unfortunately, none of those were open sourced. Having these out of the box would be great, and it will clearly have used demand. Thank you all!

Re: [PROPOSAL] Preparing for Apache Beam 2.44.0 Release

rect milestone for the 2.44.0 release should be this one: >>> https://github.com/apache/beam/milestone/7 >>> >>> - Cham >>> >>> >>> On Thu, Nov 17, 2022 at 9:12 AM Ahmet Altay via dev >>> wrote: >>> >>>>

Re: [PROPOSAL] Preparing for Apache Beam 2.44.0 Release

wrote: > I managed to acquire covid for my last work week before vacation, so I > don't expect to make a lot of progress. I'm not sure the best way to hand > off release processes. > > Kenn > > On Fri, Dec 16, 2022 at 5:30 PM Ahmet Altay via dev > wrote: > >> Hell

Re: Beam Website Feedback

ker again. > > — > Alexey > > > > On 20 Dec 2022, at 18:04, Ahmet Altay via dev wrote: > > I did a search and found a few places with the broken link. Correct links > should be: > https://beam.apache.org/get-started/resources/videos-and-podcasts/ > > I created

Re: Beam Website Feedback

t; publishing a website. >> > > I agree. I also do not know about the state of this. It would be good to > add that links checker again. > Adding @Rebecca Szper - in case this is something she can fix or would know who could fix it. > > >> >> — >> Al

Re: Beam Website Feedback

would be a good idea to add such check before >>>> publishing a website. >>>> >>> >>> I agree. I also do not know about the state of this. It would be good to >>> add that links checker again. >>> >> >> Adding @Rebecca Szper - in

Re: [ANNOUNCE] New committer: Yi Hu

Congratulations Yi! On Fri, Nov 11, 2022 at 1:57 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Contrats Yi! > > On Thu, Nov 10, 2022 at 10:48 AM Kerry Donny-Clark via dev < > dev@beam.apache.org> wrote: > >> Great job Yi! I am happy to see your contributions recognized. >> >> On

Re: [Announce] Release tasks available through GitHub Actions workflows

Thank you, that is excellent. Adding the last few release manager, they would have the most applicable feedback: @Kiley Sok @Robert Burke @Chamikara Jayalath On Thu, Nov 10, 2022 at 1:17 PM Fer Morales Martinez < fernando.mora...@wizeline.com> wrote: > Hi everyone, > We would like to share

Re: bhulette stepping back (for now)

Thank you for everything Brian! On Fri, Nov 11, 2022 at 11:27 AM Austin Bennett wrote: > Thanks for everything you've done, @bhule...@apache.org! > > On Fri, Nov 11, 2022 at 11:01 AM Pablo Estrada via dev < > dev@beam.apache.org> wrote: > >> I promised I wouldn't cry so I won't. Cya! >> >> On

Re: [VOTE] Release 2.43.0, release candidate #2

+1 (binding). - I validated the python quick starts on direct runner. Thank you! On Tue, Nov 15, 2022 at 9:51 AM Jean-Baptiste Onofré wrote: > +1 (binding) > > Regards > JB > > On Sun, Nov 13, 2022 at 3:52 PM Chamikara Jayalath via dev > wrote: > > > > Hi everyone, > > Please review and vote

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

Thank you Kenn! :) On Wed, Nov 16, 2022 at 12:45 PM Kenneth Knowles wrote: > Hi all, > > The 2.44.0 release cut is scheduled for Nov 30th [1]. I'd like to > volunteer to do this release. > > As usual, my plan would be to cut right on that date and cherry > pick critical fixes. > > Help me and

Re: Beam Website Feedback

ote: > > Thanks Ahmet! I’d prefer to fix the links as you did and add the redirect > from old one - perhaps, there are other similar links that have been > changed in the same way. > > > > Thank you for the review. I fixed it, and added a redirect too. > > > > &

Re: [ANNOUNCE] New committer: Ritesh Ghorse

Congratulations Ritesh! On Fri, Nov 4, 2022 at 12:18 PM Ritesh Ghorse via dev wrote: > Thanks everyone! I'm glad to be a part of this community and I look > forward to making more contributions in whatever ways I can. > > On Fri, Nov 4, 2022 at 12:36 PM Chamikara Jayalath via dev < >

Re: [Proposal] Beam MultimapState API

Thank you for the message Buqian. Adding @Reuven Lax @Lukasz Cwik explicitly (who are mentioned on the doc). On Mon, Oct 31, 2022 at 12:17 PM 郑卜千 wrote: > Gentle ping. Thanks! > > On Thu, Oct 27, 2022 at 2:55 PM 郑卜千 wrote: > >> Hi all, >> >> I've been working on adding MultimapState support

Re: SSL issue: Kafka Avro write with Schema Registry (GCP)

(moving this to the user list, dev list to bcc.) Adding relevant people: @John Casey . (Keshav, for Dataflow issues you could also reach out to Dataflow support: https://cloud.google.com/dataflow/docs/support) On Mon, Oct 31, 2022 at 1:23 PM Chennakeshavlu Maddela <

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

Any progress on the RC? Any blockers we can help with? On Fri, Nov 4, 2022 at 9:05 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Update: > > RC creation is still ongoing. I hope to get it out for review early next > week > > Thanks, > Cham > > > > On Fri, Nov 4, 2022 at 9:14 AM

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

Thank you! On Tue, Nov 8, 2022 at 1:39 PM Chamikara Jayalath wrote: > External artifacts have been built. I'm working on getting Dataflow > containers and documentation setup so should be out for review/vote soon :) > > On Tue, Nov 8, 2022 at 12:22 PM Ahmet Altay wrote: > >> Any progress on

Re: github reviewer help / tips

On a related note: It is quite easy to miss GitHub notifications. If you are waiting on a review feel free to ping (github, email, slack etc.) the reviewer after a few days. On Tue, Nov 8, 2022 at 11:08 AM Pablo Estrada via dev wrote: > Nice pointer Valentyn. > > If you are willing to open the

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

Thank you Cham! On Thu, Nov 3, 2022 at 10:54 PM Chamikara Jayalath wrote: > Fix for the blocking issue was cherry-picked today. So I hope to build the > RC1 tomorrow. > > Thanks, > Cham > > On Thu, Nov 3, 2022 at 8:19 PM Ahmet Altay wrote: > >> How is the release coming along? Do you need any

Re: [PROPOSAL] Preparing for Apache Beam 2.43.0 Release

How is the release coming along? Do you need any help? On Mon, Oct 31, 2022 at 1:58 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Update: > > Hi All, > > I've been validating the release branch by running all Jenkins test suites > on it (as required by the release guide). This

Re: GSOC

I do not have much time to be a mentor unfortunately. There are lots of people on this mailing list who might be interested. If you can share what projects you would be interested in working on, someone here might be interested te become a GSOC mentor. On Wed, Mar 8, 2023 at 8:49 AM Saifuddin

Re: [Bug]: The item "Contact Us" displayed is in the Resources block of the footer #22695

Hi Saifuddin, It is here: https://github.com/apache/beam/tree/master/website - It is built using Hugo, and README.md has more information for building the website. Thank you for the bug report and the contribution. Feel free to reach out with questions. Ahmet On Wed, Mar 8, 2023 at 8:37 AM

Re: [VOTE] Release 2.46.0, release candidate #1

+1 (binding) - I validated python quickstarts on direct & dataflow runners. Thank you for doing the release! On Sat, Mar 4, 2023 at 8:01 AM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > +1 (binding) > > Validated multi-language Java and Python pipelines. > > On Fri, Mar 3, 2023 at

Re: [RESULT] [VOTE] Release 2.46.0, release candidate #1

Thank you very much for doing the release! On Fri, Mar 10, 2023 at 7:30 PM Danny McCormick via dev wrote: > The release has been finalized, thanks everyone! > > Thanks, > Danny > > On Fri, Mar 10, 2023 at 2:38 PM Danny McCormick > wrote: > >> We determined that the same issue exists in the

Re: [PROPOSAL] Preparing for 2.47.0 Release

Thank you Jack! On Wed, Mar 22, 2023 at 8:39 AM Jack McCluskey via dev wrote: > Hey all, > > The next (2.47.0) release branch cut is scheduled for April 5th, 2023, > according to > the release calendar [1]. > > I will be performing this release. My plan is to cut the branch on that > date, and

Re: [VOTE] Release 2.46.0, release candidate #1

>>>> dev@beam.apache.org> wrote: >>>> >>>>> +1 (non-binding) >>>>> Validated Go SDK quickstart on direct and dataflow runner >>>>> >>>>> On Tue, Mar 7, 2023 at 10:54 AM Alexey Romanenko < >>>>> aromanenko@gmail

Re: [ANNOUNCE] New PMC Member: Jan Lukavský

Congratulations Jan! On Fri, Feb 17, 2023 at 4:52 AM Jan Lukavský wrote: > Thanks everyone! > > This is great honor, I'm grateful for the support of the Apache Beam > community. > > Best, > > Jan > On 2/17/23 11:15, Shivam Singhal wrote: > > Congratulations Jan! > > On Fri, 17 Feb 2023 at

Re: [DISCUSS] @Experimental, @Internal, @Stable, etc annotations

and are OK with, > then 1 is impossible. And so the only way to fix 2 is to just eliminate the > annotation approach entirely and go with language conventions. > +1 to eliminating @Experimental as a Beam level annotation. That is the simplest approach that will get us to a consistent state,

Re: Python 3.11 support in Apache Beam

Thank you, this is great! Python 3.11 announcement had a claim about performance [1]: "CPython 3.11 is an average of 25% faster than CPython 3.10 as measured with the pyperformance benchmark suite, when compiled with GCC on Ubuntu Linux. Depending on your workload, the overall speedup could be

Re: [DISCUSS] @Experimental, @Internal, @Stable, etc annotations

we've been reluctant to call stable (for example, Beam Schemas, >>> portability, metrics related APIs). These APIs have been around for a long >>> time and I don't see them changing so probably this is the right thing to >>> do. But I just wanted to call it out. >>&g

Re: [DISCUSS] @Experimental, @Internal, @Stable, etc annotations

I agree with Alexey and Byron. 1. We do not have any concrete evidence of our users paying attention to any of those annotations. Experimental API that were in that state for a long while are good examples. A possible exception is a deprecated annotation. My preference would be to simplify

Re: [PROPOSAL] Preparing for 2.47.0 Release

Jack, how is the release coming along? On Tue, Apr 4, 2023 at 12:23 PM Jack McCluskey via dev wrote: > Hey everyone, > > I need a PMC member's help adding my pubkey to > https://dist.apache.org/repos/dist/release/beam/KEYS as well as adding > PyPI user jrmccluskey to the maintainers of the

Re: Beam Release DockerHub Group

Thank you for doing this! I try to stay engaged with the releases and would be happy to be kept on this list. At the same time I agree with Robert, release managers should take precedence over PMC members if we cannot get the number to 6. On Mon, Apr 17, 2023 at 10:32 AM Robert Bradshaw via dev

Re: [PROPOSAL] Preparing for 2.47.0 Release

Thank you for the update Jack! On Tue, Apr 18, 2023 at 11:23 AM Jack McCluskey wrote: > Quick update for everyone, the initial release blockers on the 2.47.0 > milestone have been resolved and the RC1 commit has been tagged. I'll be > working on getting RC1 artifacts built now. > > On Thu, Apr

Re: [ANNOUNCE] New committer: Anand Inguva

Congratulations Anand! On Mon, Apr 24, 2023 at 8:05 AM Kerry Donny-Clark via dev < dev@beam.apache.org> wrote: > Great work Anand, this is well deserved. > > > On Mon, Apr 24, 2023 at 10:35 AM Yi Hu via dev > wrote: > >> Congrats Anand! >> >> On Fri, Apr 21, 2023 at 3:54 PM Danielle Syse via

Re: [ANNOUNCE] New committer: Damon Douglas

Congratulations Damon! On Mon, Apr 24, 2023 at 1:00 PM Robert Burke wrote: > Congratulations Damon!!! > > On Mon, Apr 24, 2023, 12:52 PM Kenneth Knowles wrote: > >> Hi all, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Damon Douglas

Re: [LAZY CONSENSUS] Drop @Experimental annotations and concept from Beam

Thank you very much for doing this Kenn! On Mon, May 1, 2023 at 3:49 PM Kenneth Knowles wrote: > https://github.com/apache/beam/pull/26490 > > On Mon, May 1, 2023 at 10:42 AM Austin Bennett wrote: > >> great, thanks, @* Kenneth Knowles ! >> >> On Mon, May 1, 2023 at 10:12 AM Kenneth Knowles

Re: Python 3.11 support in Apache Beam

I forgot to add the link, [1] was meant to be : https://docs.python.org/3/whatsnew/3.11.html#faster-cpython On Thu, Apr 13, 2023 at 10:17 AM Anand Inguva wrote: > Yes Ahmet. That would be great. > > There are some load tests defined in the >

Re: [PROPOSAL] Preparing for 2.47.0 Release

Sounds good. Thank you. And if you need help please reach out. On Thu, Apr 13, 2023 at 6:29 AM Jack McCluskey wrote: > We're making good progress on finding and fixing bugs. Not quite to > building an RC candidate yet, but so far nothing that seems to be a > difficult fix. > > On Wed, Apr 12,

Re: Beam Website Feedback

Adding @John Casey @Bruno Volpato - who might be able to point to relevant docs. On Sat, Feb 4, 2023 at 11:59 AM Shlomi Elbaz wrote: > Hello All, > > > > We developed a service with Apache Beam where we read an Avro file that > locate in GCP bucket, > > We had a load and benchmark tests,

Re: Incorrect python bigquery storage read API docs

Adding @Pablo Estrada who reviewed that issue, hopefully he could help. On Sun, Feb 5, 2023 at 4:37 PM Parth Doshi wrote: > Hi, > > I was reading through the documentation for the python bigquery read API > > and

Re: Community event cooperation

+86 18819063834 <+86%20188%201906%203834> > > Apache DolphinScheduler Committer > zeng...@apache.org > https://twitter.com/Niko_Zeng > > > Ahmet Altay via dev 于2022年8月9日周二 07:03写道： > >> Hi Niko, >> >> Thank you for reaching out. We do have contributo

Re: Community event cooperation

also email me privately, and I will contact you in the future. Another good >>> news is that we have found an evangelist in the United States. If there are >>> offline activities, we can also support them! >>> >>> Regards, >>> >>> Hui Zeng | Commun

Re: [VOTE] Release 2.45.0, Release Candidate #1

+1 (binding) - I validated python quick starts on direct runner and python streaming quickstart on dataflow. Thank you! On Mon, Feb 13, 2023 at 5:17 AM Bruno Volpato via dev wrote: > +1 (non-binding) > > Tested with https://github.com/GoogleCloudPlatform/DataflowTemplates (Java > SDK 11,

Re: [Peer Review] Pull Request Eliminate Finalize in Read

Thank you for reaching out. Adding @Yi Hu for his input. It looks like Yi was reviewing the PR back in December. On Fri, Jan 27, 2023 at 1:52 AM Dejan Spasic wrote: > Hello team, > > I posted a pull request[0] some time ago where I (we) need your support. > In general, it is about the

Re: [PROPOSAL] Preparing for 2.48.0 Release

out the vote of 2.47.0 release, just curious > to know what is beam's release cadence, is it monthly? > > > On Thu, May 4, 2023 at 1:58 AM Kenneth Knowles wrote: > >> Excellent, thank you! >> >> On Wed, May 3, 2023 at 7:21 AM Ahmet Altay via dev >> wrote: >

Re: [VOTE] Release 2.47.0, release candidate #2

https://github.com/apache/beam/issues/26521 was a severe issue. Should we cherry pick the fix (https://github.com/apache/beam/pull/26503) and build an RC3? (/cc @Reuven Lax @John Casey ) On Wed, May 3, 2023 at 2:01 PM Jack McCluskey via dev wrote: > I have just now realized I didn't replace

Re: Beam Infrastructure - GitHub ARC

Thank you Andrey! On Fri, Jul 14, 2023 at 8:02 AM Kenneth Knowles wrote: > Nice! > > On Thu, Jul 13, 2023 at 6:23 PM Andrey Devyatkin < > andrey.devyat...@akvelon.com> wrote: > >> Hi Beam community! >> >> >> >> We are glad to announce that we have implemented GitHub Actions Runner >>

Re: [VOTE] Release 2.49.0, release candidate #2

+1 (binding) Validated python quick start on direct runner. Thank you! On Thu, Jul 13, 2023 at 12:54 PM Svetak Sundhar via dev wrote: > +1 (Non-Binding) > > Python quickstart Dataflow runner. > > > Svetak Sundhar > > Data Engineer > s vetaksund...@google.com > > > > On Thu, Jul 13, 2023 at

Re: [ANNOUNCE] Beam 2.49.0 Released

Congratulations! Thanks to the release manager and all contributors! On Mon, Jul 17, 2023 at 8:54 AM Yi Hu via user wrote: > The Apache Beam Team is pleased to announce the release of version 2.49.0. > > You can download the release here: > > https://beam.apache.org/get-started/downloads/

Re: fastavro Cython fixes

It looks like the fastavro issue marked as fixed now. (/cc @Valentyn Tymofieiev - I saw him on that issue thread.) Work on https://github.com/apache/beam/issues/27526 is still actively ongoing. Thank you for reaching out. On Mon, Jul 17, 2023 at 4:19 PM Eddie Zhou wrote: > Hi folks, > > I

Re: DRAFT - Apache Beam Board Report - June 2023

Thank you Kenn! Added a few items. On Fri, Jun 9, 2023 at 2:28 PM Kenneth Knowles wrote: > Hi all, > > The next Beam board report is due next Wednesday, June 14. Please help me > to draft it at https://s.apache.org/beam-draft-report-2023-06. > > Ideas: > > - highlights from CHANGES.md > -

Re: [Launch Announcement] Beam Quest

Thank you Svetak! I would encourage everyone to try out, and get the badges :) On Fri, Jun 9, 2023 at 7:03 AM Svetak Sundhar via user wrote: > Hi Beam Community, > > We're excited to launch the "Getting Started with Apache Beam" Quest > . This

Re: [Launch Announcement] Beam Quest

(dropping the user list) Please also help us with spreading the word by sharing on your social media: - Twitter: https://twitter.com/ApacheBeam/status/1666915798823084034 - Linkedin post: https://www.linkedin.com/feed/update/urn:li:activity:7072675442012377088 On Fri, Jun 9, 2023 at 10:11 AM

Re: Client-Side Throttling in Apache Beam

Thank you. +1 to adding this to wiki. FYI - @Damon Douglas shared a related doc earlier for alternative ideas for Beam to prevent overloading external services. ( https://docs.google.com/document/d/1VZ9YphDO7kewBSz5oMXVPHWaib3S03Z6aZ66BhciB3E/edit?usp=sharing=0-ItxMSG72EzfSwVedSz-Zeg ) On Tue,

Re: [VOTE] Release 2.48.0 release candidate #2

+1 (binding) On Tue, May 30, 2023 at 2:01 PM Ritesh Ghorse via dev wrote: > Thanks Danny and Jack! Dataflow containers are up! > > Only PMC votes count but feel free to test your use cases and vote on this > thread! > > On Tue, May 30, 2023 at 11:26 AM Alexey Romanenko < >

Re: [DISCUSS] Upgrade vended guava version

Hi Hong, Thank you for reaching out and thank you for offering to help. If you can start the PR and do the testing, one of the committers could help with the process. Thank you! Ahmet On Mon, Jul 31, 2023 at 9:13 AM Hong Teoh wrote: > Hi all, > > The current version of guava that is vended in

Re: [DISCUSS] Upgrade vended guava version

ps://s.apache.org/beam-release-vendored-artifacts > [2] https://github.com/apache/beam/issues/27801 > > > On Mon, Jul 31, 2023 at 1:08 PM Ahmet Altay via dev > wrote: > >> Hi Hong, >> >> Thank you for reaching out and thank you for offering to help. If you can &g

Re: Why there are no certifications for Apache Beam

Hi Abhishek, We recently launched a new Beam certificate. You can find more information here: https://beam.apache.org/get-started/resources/learning-resources/#getting-started-with-apache-beam-quest. As part of the launch we also have a code for completing the program for free (more info here:

Re: [ANNOUNCE] Transform Service

Congratulations! This is a great usability improvement, lowering the bar for using multi language features. On Thu, Aug 10, 2023 at 3:48 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Hi All, > > We recently added a Docker Compose based service named Transform Service > to Beam. >

  1   2   >