Re: [PROPOSAL] Preparing for Apache Beam 2.44.0 Release

2022-12-16 Thread Ahmet Altay via dev
Hello! How is the RC coming along? Do you need help? On Wed, Dec 14, 2022 at 2:33 PM Kenneth Knowles wrote: > I've edited the subject for this update. There are no more open bugs > targeting the release milestone. I will prepare RC1 shortly. > > Kenn > > On Thu, Dec 1, 2022 at 12:55 PM Kenneth

Re: A Declarative API for Apache Beam

2022-12-16 Thread Byron Ellis via dev
So, I picked dbt for the simple reason that it's what all the data practitioners I know seem to be using and/or complaining about. Hell, I even found articles about people

Re: A Declarative API for Apache Beam

2022-12-16 Thread Sachin Agarwal via dev
While dbt and Dataform clearly can solve some of the same problems, there is a large dbt community that Beam could serve. If the Beam community thinks joining forces with thr dbt community to bring dbt to ETL use cases beyond just data warehouses where dbt is used for ELT, that is great for

Re: A Declarative API for Apache Beam

2022-12-16 Thread Austin Bennett
Seems a worthwhile addition which can expand the community by making Beam increasingly accessible to additional users and for more use-cases. A bit of a tangent, since commenting on @Byron Ellis 's part, but ... Ensuring some have also seen Dataform [ ex:

Re: [Proposal] Adopt a Beam I/O Standard

2022-12-16 Thread Andrew Pilloud via dev
By "Relational" I mean things like: Column Pruning, Filter Pushdown, Table Statistics, Partition Metadata, Metastore. We have a bunch of one-off implementations in various IOs (mostly BigQueryIO) and have been waiting for IO standards to push them out to all IOs. This was section "F5 - Relational"

Beam High Priority Issue Report (39)

2022-12-16 Thread beamactions
This is your daily summary of Beam's current high priority issues that may need attention. See https://beam.apache.org/contribute/issue-priorities for the meaning and expectations around issue priorities. Unassigned P1 Issues: https://github.com/apache/beam/issues/24675 [Bug]: POM of