Easy Multi-language via a SchemaTransform-aware Expansion Service

2022-08-04 Thread Chamikara Jayalath via dev
Hi All, I believe we can make the multi-language pipelines offering [1] much easier to use by updating the expansion service to be fully aware of SchemaTransforms. Additionally this will make it easy to register/discover/use transforms defined in one SDK from all other SDKs. Specifically we could

Vendored gRPC update

2022-08-04 Thread Luke Cwik via dev
I was looking to update gRPC that we use to the latest (1.48.1) version to move off of a vulnerable version of Netty that a user pointed out in BEAM-14118. This would supersede the work done in https://github.com/apache/beam/pull/17206 as that PR has stalled. If there aren't any concerns I'll

Re: [RFC] State & Timers API Design for Go SDK

2022-08-04 Thread Robert Burke
Fantastic document! I have a much stronger idea of how state and timers are supposed to work generally by reading it. And the approach is very good, leveraging the new Go Generics in a reasonable way, without breaking the feel of the SDK. I can also see us adopting a similar technique more

Re: [Release] 2.41.0 release update

2022-08-04 Thread Kiley Sok via dev
Last remaining issue was cherry-picked. There may be one last issue with gRPC that's being investigated. https://github.com/apache/beam/issues/22283 On Thu, Jul 28, 2022 at 2:20 PM Kiley Sok wrote: > Quick update for today: > > I'm still working through the validation tests, but we currently

Beam Dependency Check Report (2022-08-04)

2022-08-04 Thread Apache Jenkins Server
<<< text/html; charset=UTF-8: Unrecognized >>>

Beam High Priority Issue Report

2022-08-04 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/22543 [Bug]:

Community event cooperation

2022-08-04 Thread 曾辉
Hey, Developers in the Apache Beam community, How's your day? I'm Apache DolphinScheduler Community Manager, you can call me Niko, nice to meet you all Apache DolphinScheduler is a worldly renowned data orchestration tool that has largely taken the scheduler market in China. Over 1000