Re: Easy Multi-language via a SchemaTransform-aware Expansion Service

2022-11-23 Thread Chamikara Jayalath via dev
Hi All, The implementation of https://s.apache.org/easy-multi-language (with the dynamic API for Python) was merged and should be available with Beam 2.44.0: https://github.com/apache/beam/pull/23413 Thanks, Cham On Fri, Aug 19, 2022 at 3:35 PM Chamikara Jayalath wrote: > Hi All, > > Thanks

Re: Getting familiar with Go SDK

2022-11-23 Thread Robert Burke
Hello and welcome! On Wed, Nov 23, 2022, 10:40 AM Shivam Singhal wrote: > Hi folks, > > I have been extensively using Java SDK in my daily work, and haven't yet > touched Go SDK. > But I am soon(in ~1month) going to have plenty of time and I would like to > contribute to Go SDK. To help with

Getting familiar with Go SDK

2022-11-23 Thread Shivam Singhal
Hi folks, I have been extensively using Java SDK in my daily work, and haven't yet touched Go SDK. But I am soon(in ~1month) going to have plenty of time and I would like to contribute to Go SDK. To help with this, I have a few questions: 1. I have cloned the beam repo. Would like to know

Re: Beam, Flink state and Avro Schema Evolution is problematic

2022-11-23 Thread Alexey Romanenko
+ dev Many thanks for sharing your observations and findings on this topic, Cristian! I copy it to dev@ as well to attract more attention to this problem. — Alexey > On 18 Nov 2022, at 18:21, Cristian Constantinescu wrote: > > Hi everyone, > > I'm using Beam on Flink with Avro generated

Beam High Priority Issue Report (56)

2022-11-23 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/24313 [Flaky]:

SqlTransform translation deficiencies

2022-11-23 Thread Moritz Mack
Hi all, Not sure who’s best to ping. I spend some time looking into the SqlTransform translation of one of the TPC-DS queries yesterday and noticed it’s generating an overly complex transform hierarchy. I’ve summarized my findings in [1]. It would be great to get some more experienced eyes on