Re: Beam + Google Summer of Code 2024

Welcome and welcome (back)! Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, May 2, 2024 at 2:06 AM Reeba Qureshi wrote: > Hello everyone! > > I'm really excited to be working with Apache Beam again! Looking forward > to it! > > Thanks, > Reeba > > On Thu, 2 May, 2024,

Re: [ANNOUNCE] New Committer: Svetak Sundhar

Thanks everyone!! Looking forward to the continued collaboration :) Svetak Sundhar Data Engineer s vetaksund...@google.com On Mon, Feb 12, 2024 at 9:58 PM Byron Ellis via dev wrote: > Congrats Svetak! > > On Mon, Feb 12, 2024 at 6:57 PM Shunping Huang via dev < > dev@beam.apache.org>

Re: [VOTE] Release 2.54.0, release candidate #2

+1 (Non-Binding) Tested with Python SDK on DirectRunner and Dataflow Runner Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, Feb 8, 2024 at 12:45 PM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > +1 (binding) > > Tried out Java/Python multi-lang jobs and

Re: [VOTE] Release 2.53.0, release candidate #2

+1 (non binding) Tested with Healthcare notebooks. Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, Dec 28, 2023 at 3:52 AM Jan Lukavský wrote: > +1 (binding) > > Tested Java SDK with Flink Runner. > > Jan > On 12/27/23 14:13, Danny McCormick via dev wrote: > > +1

Re: Free access code for Beam Quest

Hi Jose, Thanks for reaching out. The free access code is currently paused and will be resuming in early January, I'll follow up here once resumed. As per utilizing the access code, once you create an account on Qwiklabs, you'll be able to launch the labs in the quest with credits or with tokens

Re: [Discuss] Idea to increase RC voting participation

>>>>> this can be validated. Creating a "validate this release" issue >>>>>>>>>>> with all >>>>>>>>>>> "contributing" participants could be an interesting way to do this >>>>

Fwd: [VOTE] Release 2.52.0, release candidate #5

Svetak Sundhar Data Engineer s vetaksund...@google.com -- Forwarded message - From: Danny McCormick via dev Date: Mon, Nov 13, 2023 at 6:07 PM Subject: [VOTE] Release 2.52.0, release candidate #5 To: dev Cc: Danny McCormick Hi everyone, Please review and vote on the

Re: [VOTE] Release 2.52.0, release candidate #5

+1 (non binding) validated on python use cases. Svetak Sundhar Data Engineer s vetaksund...@google.com On Wed, Nov 15, 2023 at 8:52 AM Jan Lukavský wrote: > +1 (binding) > > Validated Java SDK with Flink runner on own use cases. > > Jan > > On 11/15/23 11:35, Jean-Baptiste Onofré

Re: [VOTE] Release 2.52.0, release candidate #3

+1 Non Binding -- tested Python SDK batch. Svetak Sundhar Data Engineer s vetaksund...@google.com On Fri, Nov 10, 2023 at 2:58 PM Danny McCormick via dev wrote: > > Note: the release guide >

Re: [VOTE] Release 2.52.0, release candidate #2

Thanks, Danny! @all: Reminder that if there's anything you think that is worth documenting while RC testing, please feel free to add it here . We can then use it to update

Re: Credentials Rotation Failure on IO-Datastores cluster

I took a quick look -- the error is the following: *22:17:26* ERROR: (gcloud.container.clusters.update) ResponseError: code=400, message=Operation operation-1698804621818-e9c8fe33-d4a2-44cd-86aa-9c4e09dea259 is currently upgrading cluster io-datastores. Please wait and try again once it is done.

Re: [Discuss] Idea to increase RC voting participation

>>>>>> >>>>>> I would also strongly suggest that people try out the release against >>>>>> their own codebases. This has the benefit of ensuring the release won't >>>>>> break your own code when they go out, and stress-tests th

[Discuss] Idea to increase RC voting participation

Hi all, I’ve participated in RC testing for a few releases and have observed a bit of a knowledge gap in how releases can be tested. Given that Beam encourages contributors to vote on RC’s regardless of tenure, and that voting on an RC is a relatively low-effort, high leverage way to influence

Re: [VOTE] Release 2.51.0, release candidate #1

+1 Non Binding Tested Python Direct Runner and Dataflow Runner as well. On the spreadsheet, I came across "Dataflow v1 (until 2.49.0, inclusive)", and do not fully understand what this means. Does this mean (1) we shouldn't be testing on Dataflow runner v1 for releases after 2.49 or (2) make

Dicom IO De-ID Transform

Hi Beam Community, I have written up a design for implementing de-identification in our existing Dicom IO (Java SDK), and would appreciate any thoughts or feedback! A tl;dr

Re: [PROPOSAL] Design Doc template for PTransforms

Thanks Kenn! I put up a PR to add this reference to the Beam website. I'm actively using the template now, and one piece of feedback I have is to include a section for prototyped work. Maybe a table that allows the user to post links to Github prototype

Re: Mechanism for "Beam Website Feedback"

Hi Ahmet, I'm +1 on the idea-- one clarification question: Do you propose that when feedback is sent, it gets forwarded to the dev list? If not, we will need to ensure that the backend (eg a Google sheet) is monitored. Svetak Sundhar Data Engineer s vetaksund...@google.com On Mon, Aug

Re: Why there are no certifications for Apache Beam

Hello Abhishek, Thank you for your interest. We do have a skill badge you can earn with Apache Beam (https://www.cloudskillsboost.google/quests/310). You can use this access code (to earn this for free), search "Getting Started

Re: [VOTE] Release 2.49.0, release candidate #2

+1 (Non-Binding) Python quickstart Dataflow runner. Svetak Sundhar Data Engineer s vetaksund...@google.com On Thu, Jul 13, 2023 at 5:03 AM Jan Lukavský wrote: > +1 (binding) > > Tested Java SDK with FlinkRunner. > > Jan > On 7/13/23 02:30, Bruno Volpato via dev wrote: > > +1

Re: [DISCUSS] Enable Github Discussions?

>>>> clear idea of when we'd revisit the discussion, and (c) a clear path to >>>>>> rollback the decision without it being *too *much work (this might >>>>>> mean something like disabling future discussions and keeping the history >>>>>> or &

[DISCUSS] Enable Github Discussions?

Hi all, I wanted to start a discussion to gauge interest on enabling Github Discussions in Apache Beam. Pros: + GH Discussions allows for folks to get unblocked on small/medium implementation blocker (Google employees can often get this help

[DISCUSS] Enable Github Discussions?

Hi all, I wanted to start a discussion to gauge interest on enabling Github Discussions in Apache Beam. Pros: + GH Discussions allows for folks to get unblocked on small/medium implementation blocker (Google employees can often get this help

Re: [Launch Announcement] Beam Quest

Hi, Could you elaborate on your issue here? Are you running into an error? Could you 1) Click on the free access code here 2) Create an account 3) Navigate to "Getting started with apache beam" 4) launch the lab with credits.

Re: DRAFT - Apache Beam Board Report - June 2023

Added an item, thanks Kenn! Svetak Sundhar Data Engineer s vetaksund...@google.com On Sat, Jun 10, 2023 at 1:01 AM Jean-Baptiste Onofré wrote: > It looks good to me, thanks ! > > Regards > JB > > On Fri, Jun 9, 2023 at 11:28 PM Kenneth Knowles wrote: > > > > Hi all, > > > > The next

[Launch Announcement] Beam Quest

Hi Beam Community, We're excited to launch the "Getting Started with Apache Beam" Quest . This quest provides a completion badge that can be shared on social media (such as Linkedin and Twitter) upon completion of four qwiklabs. These labs venture

Re: [VOTE] Release 2.48.0 release candidate #2

+1 (non-binding) (Python) Svetak Sundhar Data Engineer s vetaksund...@google.com On Wed, May 31, 2023 at 1:50 AM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > Nvm, I was running the Kafka cluster and the job in two different > projects. It's working as expected. > > +1

Re: [VOTE] Release 2.47.0, release candidate #3

+1 (Non-Binding) I tested Python Quick Start on Dataflow Runner as well Svetak Sundhar Technical Solutions Engineer, Data s vetaksund...@google.com On Sat, May 6, 2023 at 4:44 AM Chamikara Jayalath via dev < dev@beam.apache.org> wrote: > I'm seeing a regression when running Java x-lang

Re: Starter projects for Beam

Hi Tariq, Thanks for your interest! A good starting point are good first issues: https://github.com/apache/beam/labels/good%20first%20issue?page=2=is%3Aopen+label%3A%22good+first+issue%22 . Feel free to assign an issue to yourself and put up a PR/ask any needed questions when ready. Thanks,

Re: Jenkins Flakes

+1 to the proposal. Regarding the "(and not guaranteed to work)" part, is the resolution that the memory issues may still persist and we restore the normal retention limit (and we look for another fix), or that we never restore back to the normal retention limit? Svetak Sundhar Technical

Re: Regarding Project proposal review and feedback

Hi Siddharth, I left some comments as well on the sentiment analysis proposal. Thanks, Svetak Sundhar Technical Solutions Engineer, Data s vetaksund...@google.com On Sun, Apr 2, 2023 at 1:58 PM Anand Inguva via dev wrote: > I left some comments on the sentiment analysis proposal. > >

Re: Custom Windowing

Hi Sahith, It isn't immediately obvious to me what the error might be, though I was able to sift through the stacktrace and find areas of the codebase that it touches ( https://github.com/apache/beam/blob/master/runners/core-java/src/main/java/org/apache/beam/runners/core/ReduceFnRunner.java#L412

Re: [ANNOUNCE] New committer: John Casey

Congrats John!! Svetak Sundhar Technical Solutions Engineer, Data s vetaksund...@google.com On Fri, Jul 29, 2022 at 5:02 PM Ritesh Ghorse via dev wrote: > Congratulations John! > > On Fri, Jul 29, 2022 at 5:01 PM Ahmed Abualsaud via dev < > dev@beam.apache.org> wrote: > >> Congrats John,