[Proposal] Go SDK Exits Experimental

2021-06-10 Thread Robert Burke
Hello Beam Community! I propose we stop calling the Apache Beam Go SDK experimental. This thread is to discuss it as a community, and any conditions that remain that would prevent the exit. *tl;dr;* *Ask Questions for answers and links! I have both.* This entails including it officially in the

Re: Removing deprecated oauth2client dependency for Python SDK

2021-06-10 Thread Luke Cwik
I did something very similar during the Dataflow Java 1.x to Beam Java 2.x migration. The work boiled down to: * swapping to a different library to get the application default credentials (including fixing upstream bugs at Google and improving some documentation) * swapping existing API calls to

Re: Multiple architectures support on Beam (ARM)

2021-06-10 Thread Robert Bradshaw
On Thu, Jun 10, 2021 at 3:00 AM Ismaël Mejía wrote: > > As a follow up on this with the merge of > https://github.com/apache/beam/pull/14832 Beam will be producing python > wheels for AARCH64 starting on Beam 2.32.0! Nice. > Also due to the recent version updates (grpc, protobuf and arrow) we

Flaky test issue report (37)

2021-06-10 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

P1 issues report (38)

2021-06-10 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

P0 (outage) report

2021-06-10 Thread Beam Jira Bot
This is your daily summary of Beam's current outages. See https://beam.apache.org/contribute/jira-priorities/#p0-outage for the meaning and expectations around P0 issues. BEAM-12467: java.io.InvalidClassException With Flink Kafka (https://issues.apache.org/jira/browse/BEAM-12467)

Re: [EXTERNAL]

2021-06-10 Thread Alexey Romanenko
> On 9 Jun 2021, at 21:34, Raphael Sanamyan > wrote: > > In this case, we write data to one table and then to the other, but only > after the window of data has been fully written to the first table. It is not > possible to do this with the existing JdbcIO.Write functionality. Well, it’s

Re: [Proposal] Enable Branch Protection for `release-.*` branches

2021-06-10 Thread Robert Burke
Ok. I'll fill a ticket with Infra tomorrow once the objection period has passed. Thanks! On Wed, Jun 9, 2021, 12:51 PM Kenneth Knowles wrote: > Great idea. I think only infra can do it. > > On Tue, Jun 8, 2021, 14:27 Robert Burke wrote: > >> During the last branch cleanup, it appears I

Re: Multiple architectures support on Beam (ARM)

2021-06-10 Thread Ismaël Mejía
As a follow up on this with the merge of https://github.com/apache/beam/pull/14832 Beam will be producing python wheels for AARCH64 starting on Beam 2.32.0! Also due to the recent version updates (grpc, protobuf and arrow) we should be pretty close to fully support it without extra compilation.

Re: contributor permission for Beam Jira tickets

2021-06-10 Thread Ismaël Mejía
Hello Pascal, I added you as a contributor so you can now self assign issues if you want. I assigned BEAM-12471 to you since I saw you opened a PR to fix it. Best, Ismaël On Wed, Jun 9, 2021 at 11:05 PM Pascal Gillet wrote: > Hi, > > This is Pascal. I identified some little but nonetheless