[DISCUSS] Dependency management in Apache Beam Python SDK

2022-08-23 Thread Valentyn Tymofieiev via dev
Hi everyone, Recently, several issues [1-3] have highlighted outage risks and developer inconveniences due to dependency management practices in Beam Python. With dependabot and other tooling that we have integrated with Beam, one of the missing pieces seems to be having a clear guideline of

Re: 2.41.0 Release PMC Finalization

2022-08-23 Thread Chamikara Jayalath via dev
Should be done. Thanks, Cham On Tue, Aug 23, 2022 at 4:53 PM Chamikara Jayalath wrote: > I can look into it. > > On Tue, Aug 23, 2022 at 2:02 PM Kiley Sok via dev > wrote: > >> Could a PMC member help with the PMC-only finalization steps for 2.41.0 >> [1]? Specifically: >> >> - Deploy source

Re: 2.41.0 Release PMC Finalization

2022-08-23 Thread Chamikara Jayalath via dev
I can look into it. On Tue, Aug 23, 2022 at 2:02 PM Kiley Sok via dev wrote: > Could a PMC member help with the PMC-only finalization steps for 2.41.0 > [1]? Specifically: > > - Deploy source release to dist.apache.org > - Recordkeeping with ASF > > Once those steps are done all that's left is

2.41.0 Release PMC Finalization

2022-08-23 Thread Kiley Sok via dev
Could a PMC member help with the PMC-only finalization steps for 2.41.0 [1]? Specifically: - Deploy source release to dist.apache.org - Recordkeeping with ASF Once those steps are done all that's left is to promote the release [2]. Thank you! Kiley [1]

Re: Java & Python Project Starter / Example Using Terraform to build Dataflow Custom Templates

2022-08-23 Thread Kenneth Knowles
Nice! On Tue, Aug 23, 2022 at 11:00 AM Ahmet Altay via dev wrote: > Thank you for sharing Damon. > > On Tue, Aug 23, 2022 at 9:34 AM Damon Douglas via dev > wrote: > >> Hello Everyone, >> >> You can ignore this email if you do not use the Dataflow runner. >> >> We just published an example /

Re: Representation of logical type beam:logical_type:datetime:v1

2022-08-23 Thread Yi Hu via dev
Hi, It now appears that if we want a clean solution then we have to add a fixed size primitive type to Beam atomic types. Or, we then have a millis_instant logical type that does not have to_language_type and to_representation_type implementations. Any suggestions are welcome! Best, Yi On Thu,

[GitHub] [beam-site] kileys merged pull request #633: Publish 2.41.0 release

2022-08-23 Thread GitBox
kileys merged PR #633: URL: https://github.com/apache/beam-site/pull/633 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Fwd: New mailing list queued for creation: stackoverf...@beam.apache.org

2022-08-23 Thread Kenneth Knowles
FYI -- Forwarded message - From: ASF Self-Service Platform Date: Tue, Aug 23, 2022 at 11:40 AM Subject: New mailing list queued for creation: stackoverf...@beam.apache.org To: , ASF Infrastructure Hi there, As requested by k...@apache.org, a new mailing list has been

Re: Java & Python Project Starter / Example Using Terraform to build Dataflow Custom Templates

2022-08-23 Thread Ahmet Altay via dev
Thank you for sharing Damon. On Tue, Aug 23, 2022 at 9:34 AM Damon Douglas via dev wrote: > Hello Everyone, > > You can ignore this email if you do not use the Dataflow runner. > > We just published an example / project starter that shows how to build > Dataflow Custom Templates provisioned

[RESULT] [VOTE] Release 2.41.0, release candidate #2

2022-08-23 Thread Kiley Sok via dev
I'm happy to announce that we have unanimously approved this release. There are 5 approving votes, 3 of which are binding: * Ahmet Altay * Alexey Romanenko * Chamikara Jayalath There are no disapproving votes. Thanks everyone!

Java & Python Project Starter / Example Using Terraform to build Dataflow Custom Templates

2022-08-23 Thread Damon Douglas via dev
Hello Everyone, You can ignore this email if you do not use the Dataflow runner. We just published an example / project starter that shows how to build Dataflow Custom Templates provisioned using terraform on Cloud Build. The README also links to an "open in cloud shell walkthrough" that allows

Re: Benchmark tests for the Beam RunInference API

2022-08-23 Thread Andy Ye via dev
Appreciate the super clear summary of the different benchmark experiments! This will add lots of value to potential users, especially when we integrate GPU benchmarks. Thanks Anand! Best, Andy On Thu, Aug 18, 2022 at 10:22 AM Danny McCormick via dev < dev@beam.apache.org> wrote: > I left a few

Beam High Priority Issue Report (72)

2022-08-23 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/22808 [Bug]: Dataflow