Re: Beam starter projects dependency updates

hat we could avoid duplicating the data though. > > [1] > https://github.com/apache/beam/blob/728e8ecc8a40d3d578ada7773b77eca2b3c68d03/.github/REVIEWERS.yml > > On Thu, Oct 27, 2022 at 12:20 PM David Cavazos via dev < > dev@beam.apache.org> wrote: > >> Hi everyo

Beam starter projects dependency updates

Hi everyone! We want to make sure the Beam starter projects always come with the latest (compatible) versions for every dependency. I enabled Dependabot on all of them to automate this as much as possible, and we have automated tests to make sure everything works as expected. However, we still

[Java] Aggregations with FixedSized windows not working as expected

Hi, Tianzi, a coworker of mine, was trying out a streaming Java pipeline. It's reading from Pub/Sub, doing fixed sized windows, doing an aggregation like a GroupByKey or Sum, and then trying to print the elements in each window. But it's not showing anything. The pipeline is basically this:

Re: On Auto-creating GCS buckets on behalf of users

I like the idea of simplifying the user experience by automating part of the initial setup. On the other hand, I see why silently creating billed resources like a GCS bucket could be an issue. I don't think creating an empty bucket is an issue since it doesn't incur any charges yet, but at least

Re: Python2.7 Beam End-of-Life Date

+1 On Mon, Jun 15, 2020 at 6:52 PM Udi Meiri wrote: > +1 > > On Mon, Jun 15, 2020 at 4:27 PM Ahmet Altay wrote: > >> As a concrete proposal, could we commit to removing python 2 support by >> 2.24? In other words, mark the next release 2.23 as the last python 2 >> compatible Beam version. >>

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

019 at 7:17 PM Kenneth Knowles wrote: > >> On Fri, Nov 22, 2019 at 10:24 AM Robert Bradshaw >> wrote: >> >>> On Thu, Nov 21, 2019 at 7:05 PM David Cavazos >>> wrote: >>> >>>> >>>> >>>> I created this Google Form >

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

Responses are here <https://docs.google.com/forms/d/e/1FAIpQLSfiZHnrkEmn0ZJ_68yt0S7A5VJL77AXynS1MjhR9wemLna6eQ/viewanalytics> . On Thu, Nov 21, 2019 at 7:05 PM David Cavazos wrote: > [x] Beaver > [x] Hedgehog > [x] Lemur > [x] Owl > [ ] Salmon > [ ] Trout > [ ] Robot

Re: [VOTE] Beam Mascot animal choice: vote for as many as you want

[x] Beaver [x] Hedgehog [x] Lemur [x] Owl [ ] Salmon [ ] Trout [ ] Robot dinosaur [x] Firefly [x] Cuttlefish [x] Dumbo Octopus [ ] Angler fish I created this Google Form if everyone

GCP libraries up-to-date versions in Java

Hi Beamers, I recently was a part of a discussion about some dependency incompatibilities in the Java SDK. Specifically on the GRPC versions when trying to use one of the Google Cloud client libraries as part of a Beam pipeline. Their workaround was downgrading to an older version of the client

Re: [Discuss] Beam mascot

> >> >> >> >> [1] >> >> >> >> https://www.cnn.com/travel/article/madagascar-lemurs/index.html >> >> >> >> >> >> On Mon, Nov 4, 2019 at 7:33 P

Re: Python Precommit duration pushing 2 hours

+1 to moving the GCP tests outside of core. If there are issues that only show up on GCP tests but not in core, it might be an indication that there needs to be another test in core covering that, but I think that should be pretty rare. On Mon, Nov 4, 2019 at 8:33 PM Kenneth Knowles wrote: > +1

Re: [Discuss] Beam mascot

I like it, a beaver could be a cute mascot :) On Mon, Nov 4, 2019 at 3:33 PM Aizhamal Nurmamat kyzy wrote: > Hi everybody, > > I think the idea of creating a Beam mascot has been brought up a couple > times here in the past, but I would like us to go through with it this time > if we are all in

Re: [VOTE] Sign a pledge to discontinue support of Python 2 in 2020.

+1 On Mon, Sep 30, 2019 at 5:27 PM Ahmet Altay wrote: > +1 > > On Mon, Sep 30, 2019 at 5:22 PM Valentyn Tymofieiev > wrote: > >> Hi everyone, >> >> Please vote whether to sign a pledge on behalf of Apache Beam to sunset >> Beam Python 2 offering (in new releases) in 2020 on >>

Re: [ANNOUNCE] New committer: Alan Myrvold

Congratulations Alan! On Mon, Sep 30, 2019 at 7:57 AM Connell O'Callaghan wrote: > Congratulations Alan - well done!!! Ahmet thank you for sharing this great > news!!! > > On Mon, Sep 30, 2019 at 7:34 AM Łukasz Gajowy wrote: > >> Congratulations :) >> >> pon., 30 wrz 2019 o 15:41 Reza Rokni

Re: [ANNOUNCE] New committer: Valentyn Tymofieiev

Congratulations Valentyn!  On Mon, Sep 2, 2019 at 7:12 PM jincheng sun wrote: > Congrats Valentyn ! > > Cheers, > Jincheng > > Katarzyna Kucharczyk 于2019年9月2日周一 下午5:20写道： > >> Congratulations Valentyn!  >> >> On Wed, Aug 28, 2019 at 3:49 PM Frederik Bode >> wrote: >> >>> Congrats

Re: On Auto-creating GCS buckets on behalf of users

I would go for #1 since it's a better user experience. Especially for new users who don't understand every step involved on staging/deploying. It's just another (unnecessary) mental concept they don't have to be aware of. Anything that makes it closer to only providing the `--runner` flag without

Re: hi from DevRel land

Welcome Reza! On Wed, Mar 13, 2019 at 9:48 AM Mark Liu wrote: > Welcome Reza! > > On Wed, Mar 13, 2019 at 8:09 AM Etienne Chauchot > wrote: > >> Welcome onboard Reza >> >> Etienne >> >> Le mardi 12 mars 2019 à 09:10 -0700, Rose Nguyen a écrit : >> >> Welcome, Reza! Really excited to have you!

Re: Should we mention TF Transform in Beam site?

There are several examples on using TFT on the cloudml-samples repo . Particularly, I've been working on an end-to-end sample using Beam+TFT to do the

[VOTE] Community Examples Repository

Hi everyone! We discussed several options as well as some of the implications of each option. Please vote for your favorite option, feel free to back it up with any reasons that make you feel that way. 1) Move *all* samples to a *new *examples* repository* 2) Move *some* samples to a *new

Re: Community Examples Repository

aks >>>> > >> wordcount, we want to know right away so we can revert. Perhaps >>>> we can >>>> > >> keep these in the repo but more clearly modularize the artifacts >>>> we release? >>>> > >> > >>>>

Re: Community Examples Repository

r unit tests, as tests of functionality. If we move the examples > out, what is a good way to make sure that we continue to have visibility > and test coverage? Can we address this in a section of the doc? > > On Wed, Aug 1, 2018 at 3:12 PM David Cavazos wrote: > >> H

Community Examples Repository

Hi everyone! We wanted to migrate the examples from the core repository to a new Beam community examples repository. As the number of examples grow, it makes sense to modularize and decouple the core functionality from the examples. We will also create some guidelines with the best practices for

[python] Strict type checking on pydoc tool

Hi, Changes introduced in [BEAM-2655 ] will make the pydoc tool (sphinx) be stricter when checking cross references whenever a cross reference is written. Here are some examples with the type syntax highlighted in bold: """ One line description