[Release] 2.41.0 release update

2022-07-27 Thread Kiley Sok via dev
Hi all, I've cut the release branch: https://github.com/apache/beam/tree/release-2.41.0 There's one known issue that needs to be cherry picked. Please let me know if you have a change that needs to go

Re: BigTable reader for Python?

2022-07-27 Thread Chamikara Jayalath via dev
On Wed, Jul 27, 2022 at 1:39 PM Chamikara Jayalath wrote: > > > On Wed, Jul 27, 2022 at 11:10 AM Lina Mårtensson > wrote: > >> Thanks Cham! >> >> Could you provide some more detail on your preference for developing a >> Python wrapper rather than implementing a source purely in Python? >> > >

Re: BigTable reader for Python?

2022-07-27 Thread Chamikara Jayalath via dev
On Wed, Jul 27, 2022 at 11:10 AM Lina Mårtensson wrote: > Thanks Cham! > > Could you provide some more detail on your preference for developing a > Python wrapper rather than implementing a source purely in Python? > I've mentioned the main advantages of developing a cross-language transform

Re: BigTable reader for Python?

2022-07-27 Thread Lina Mårtensson via dev
Thanks Cham! Could you provide some more detail on your preference for developing a Python wrapper rather than implementing a source purely in Python? If I look at the instructions for using the x-language Spanner connector, then using this - from the user's perspective - would involve

Re: Beam gRPC depedency tracing

2022-07-27 Thread Kenneth Knowles
The vendored gRPC is built by transforming the released gRPC jar. Here is where in the Beam git history you can find the source for the transformation: https://github.com/apache/beam/tree/40293eb52ca914acbbbae51e4b24fa280f2b44f0/vendor/grpc-1_26_0 Kenn On Wed, Jul 27, 2022 at 9:24 AM JDW J

Beam gRPC depedency tracing

2022-07-27 Thread JDW J
Team, Consider me a newbie to Beam and Java world in general. I am trying to trace Beam vendor dependency to gRPC-upstream. 4.0.0 org.apache.beam beam-vendor-grpc-1_26_0 0.3 Apache Beam :: Vendored Dependencies :: gRPC :: 1.26.0 http://beam.apache.org How can I tell what is the

Re: Checkpoints timing out upgrading from Beam version 2.29 with Flink 1.12 to Beam 2.38 and Flink 1.14

2022-07-27 Thread John Casey via dev
Would it be possible to recreate the experiments to try and isolate variables? Right now the 3 cases change both beam and flink versions. On Tue, Jul 26, 2022 at 11:35 PM Kenneth Knowles wrote: > Bumping this and adding +John Casey who knows > about KafkaIO and unbounded sources, though

Beam High Priority Issue Report

2022-07-27 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/22463 [Bug]: Upgrade pip