[ANNOUNCE] Beam 2.33.0 Release

2021-10-13 Thread Udi Meiri
The Apache Beam team is pleased to announce the release of version 2.33.0. Apache Beam is an open source unified programming model to define and execute data processing pipelines, including ETL, batch and stream (continuous) processing. See https://beam.apache.org You can download the release

Re: [Proposal] Go SDK Exits Experimental

2021-10-13 Thread Robert Burke
This is a status update. At this point 2.33.0 is released, but there are difficulties with accessing the tagged versions using the standard go tools. It's currently under investigation. Using the v2 path in a go program then running `go mod tidy` will populate the file with a pseudo-version

Flaky test issue report (32)

2021-10-13 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

[BEAM-13019] Potential breaking change adding matchers to `PAssert.that(pcollection).containsInAnyOrder`

2021-10-13 Thread Chris Gray
Hi, I recently noticed that some very useful assertion methods are not available to use in the IterableAssert​ interface. In particular, I wanted to add containsInAnyOrder(SerializableMatcher... matchers)​. I did this in https://github.com/apache/beam/pull/15685. However, this causes some

P1 issues report (46)

2021-10-13 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

[Question] Spanner ServiceCallMetrics on Dataflow runner

2021-10-13 Thread Miguel Hernández Sandoval
Hi team, I've been working on BEAM-11986[1] and opened this PR[2]. In a nutshell, it counts write/read requests made to the Spanner API from the WriteToSpanner transform with a ServiceCallMetric[3]. The issue here is that when running the integration tests[4] on DirectRunner the metrics from

Re: Grafana/InfluxDb/Jenkins manual or doc

2021-10-13 Thread Fernando Morales Martinez
Will do! It took some tweaking here and there to figure it out, but it is a straightforward process. I'll update the wiki with the instructions! Thanks! On Tue, Oct 12, 2021 at 7:49 PM Ahmet Altay wrote: > Do you mind updating the wiki with any relevant information? This is an > area where we

Beam Website Feedback

2021-10-13 Thread Ryan Reynolds
To Whom It May Concern: Thank you so much for putting together such a wide breadth of helpful documentation for beam. It is a pleasure learning about the platform, and the information is presented in an easily consumable manner. Keep up the good work. Respectfully, Ryan Reynolds

Beam Website Feedback

2021-10-13 Thread Dearl Strickland
Could use some guidance maybe highlights