Re: [VOTE] Release 2.30.0, release candidate #1

2021-06-08 Thread Kenneth Knowles
+1 (binding) Verified wordcount with various configuration parameters and they all worked. Particularly confirming that all the containers are chosen correctly. Kenn On Tue, Jun 8, 2021 at 12:40 PM Heejong Lee wrote: > > > On Tue, Jun 8, 2021 at 12:06 PM Kenneth Knowles wrote: > >> I have

Re: [VOTE] Release 2.30.0, release candidate #1

2021-06-08 Thread Heejong Lee
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes: Binding: * Chamikara Jayalath * Ahmet Altay * Robert Bradshaw * Kenneth Knowles Non-binding: * Tomo Suzuki There are no disapproving votes. I will finalize the release. Thanks everyone! On Tue,

beam new feature

2021-06-08 Thread Daria Malkova
Hi community! I've noticed that there is no possibility in Beam JDBC to use partitioning for reading a very large table with millions of rows in parallel (for example when migrating legacy database data to BigQuery). I have some ideas which are decribed here in more detailes:

[Proposal] Enable Branch Protection for `release-.*` branches

2021-06-08 Thread Robert Burke
During the last branch cleanup, it appears I accidentally deleted the release-2.26.0 branch. Lukasz Cwik pointed this out to me, and fortunately I was able to recover and push it back to the repo. However, Brian Hulette then pointed out github lets us set up rules to avoid accidental deletion of

Re: Beam SNAPSHOTS not working since friday

2021-06-08 Thread Ismaël Mejía
Just to finish this thread I double checked and the SNAPSHOTs are published correctly now. On Tue, Jun 8, 2021 at 5:31 PM Ismaël Mejía wrote: > Thanks for clarifying Brian. So we shall wait for Infra then > > On Tue, Jun 8, 2021, 5:15 PM Brian Hulette wrote: > >> You may have already made this

Beam Metrics Report (2021-06-04)

2021-06-08 Thread Apache Jenkins Server
ERROR: File 'src/.test-infra/jenkins/metrics_report/beam-metrics_report.html' does not exist

Beam Dependency Check Report (2021-06-08)

2021-06-08 Thread Apache Jenkins Server
High Priority Dependency Updates Of Beam Python SDK: Dependency Name Current Version Latest Version Release Date Of the Current Used Version Release Date Of The Latest Release JIRA Issue chromedriver-binary 88.0.4324.96.0

P1 issues report (41)

2021-06-08 Thread Beam Jira Bot
This is your daily summary of Beam's current P1 issues, not including flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20priority%20%3D%20P1%20AND%20(labels%20is%20EMPTY%20OR%20labels%20!%3D%20flake). See

Re: PreCommit tests not running

2021-06-08 Thread Brian Hulette
The INFRA ticket indicates this should be resolved now, and things do seem to be working (e.g. Java PreCommit has started on https://github.com/apache/beam/pull/14949). Brian On Tue, Jun 8, 2021 at 7:51 AM Reuven Lax wrote: > Sigh. Hopefully infra addresses this soon. > > On Mon, Jun 7, 2021

Flaky test issue report (37)

2021-06-08 Thread Beam Jira Bot
This is your daily summary of Beam's current flaky tests (https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20statusCategory%20!%3D%20Done%20AND%20labels%20%3D%20flake) These are P1 issues because they have a major negative impact on the community and make it hard to

Re: [VOTE] Release 2.30.0, release candidate #1

2021-06-08 Thread Kenneth Knowles
I have some configurations that did not work properly in 2.29.0 that I'd like to verify against this RC. Sorry I haven't got a chance to verify yet, but can you please wait for that? I am doing the verification right now. Kenn On Mon, Jun 7, 2021 at 4:28 PM Heejong Lee wrote: > FYI, we now

Re: beam new feature

2021-06-08 Thread Luke Cwik
Thanks, I left a few comments in the doc. On Tue, Jun 8, 2021 at 12:26 PM Daria Malkova wrote: > Hi community! > > I've noticed that there is no possibility in Beam JDBC to use partitioning > for reading a very large table with millions of rows in parallel (for > example when migrating legacy

Re: Consider Cloudpickle instead of dill for Python pickling

2021-06-08 Thread Stephan Hoyer
To give a quick update here: I did look into what it could look like to swap out dill -> cloudpickle internally in Beam. In principle, making the switch would be easy: literally just swap out "dill" in favor of "cloudpickle". Both use the same loads/dumps API. The hard part is figuring out how

Re: [VOTE] Release 2.30.0, release candidate #1

2021-06-08 Thread Heejong Lee
On Tue, Jun 8, 2021 at 12:06 PM Kenneth Knowles wrote: > I have some configurations that did not work properly in 2.29.0 that I'd > like to verify against this RC. Sorry I haven't got a chance to verify yet, > but can you please wait for that? I am doing the verification right now. > Sure.

DRAFT - Beam board report June 2021

2021-06-08 Thread Kenneth Knowles
Hi all, The June report is due tomorrow. Through this link anyone should be able to comment and make suggestions. Please help me out by adding highlights. I already grabbed some from CHANGES.md. https://s.apache.org/beam-draft-report-2021-06 You can read past reports at

[GitHub] [beam-site] ihji merged pull request #613: Publish 2.30.0 release

2021-06-08 Thread GitBox
ihji merged pull request #613: URL: https://github.com/apache/beam-site/pull/613 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please

Beam SNAPSHOTS not working since friday

2021-06-08 Thread Ismaël Mejía
While trying to check on the new 2.32.0-SNAPSHOTs this morning I noticed that the daily SNAPSHOTs have not been updating since last friday: https://ci-beam.apache.org/job/beam_Release_NightlySnapshot/ https://repository.apache.org/content/groups/snapshots/org/apache/beam/beam-sdks-java-core/ Can

Re: PreCommit tests not running

2021-06-08 Thread Reuven Lax
Sigh. Hopefully infra addresses this soon. On Mon, Jun 7, 2021 at 9:34 PM Boyuan Zhang wrote: > There is an infra issue ongoing: > https://issues.apache.org/jira/browse/INFRA-21976, which affects all beam > tests. > > On Mon, Jun 7, 2021 at 9:21 PM Reuven Lax wrote: > >>

Re: Beam SNAPSHOTS not working since friday

2021-06-08 Thread Brian Hulette
You may have already made this connection, but this is likely the same issue discussed in [1][2]. [1] https://lists.apache.org/thread.html/r658cdfa643c44a3fa18c226238e537ad221c8f65337f0eab3ad6dad9%40%3Cdev.beam.apache.org%3E [2] https://issues.apache.org/jira/browse/INFRA-21976 On Tue, Jun 8,

Re: Beam SNAPSHOTS not working since friday

2021-06-08 Thread Ismaël Mejía
Thanks for clarifying Brian. So we shall wait for Infra then On Tue, Jun 8, 2021, 5:15 PM Brian Hulette wrote: > You may have already made this connection, but this is likely the same > issue discussed in [1][2]. > > [1] >