Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats! On Tue, Aug 6, 2019, 7:24 PM Reza Rokni wrote: > Congratz! > > On Wed, 7 Aug 2019 at 06:40, Chamikara Jayalath > wrote: > >> Congrats!! >> >> On Tue, Aug 6, 2019 at 3:33 PM Udi Meiri wrote: >> >>> Congrats Kyle! >>> >>> On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak >>> wrote: >>>

Re: [ANNOUNCE] New committer: Jan Lukavský

Well done Jan!!! On Tue, Aug 6, 2019 at 15:44 Chamikara Jayalath wrote: > Congrats Jan! > > On Thu, Aug 1, 2019 at 11:10 AM Thomas Weise wrote: > >> Congrats! >> >> >> On Thu, Aug 1, 2019 at 8:44 AM jincheng sun >> wrote: >> >>> Congratulations Jan! >>> Best, Jincheng >>> >>> Gleb Kanterov

Re: [ANNOUNCE] New committer: Kyle Weaver

Well done congratulations Kyle!!! On Tue, Aug 6, 2019 at 21:58 Thomas Weise wrote: > Congrats! > > On Tue, Aug 6, 2019, 7:24 PM Reza Rokni wrote: > >> Congratz! >> >> On Wed, 7 Aug 2019 at 06:40, Chamikara Jayalath >> wrote: >> >>> Congrats!! >>> >>> On Tue, Aug 6, 2019 at 3:33 PM Udi Meiri

Re: [ANNOUNCE] New committer: Rui Wang

Well done Rui!!! On Tue, Aug 6, 2019 at 15:41 Chamikara Jayalath wrote: > Congrats Rui. > > On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak > wrote: > >> Congrats Rui! >> >> On Tue, Aug 6, 2019 at 1:37 PM Yichi Zhang wrote: >> >>> Congrats Rui! >>> >>> On Tue, Aug 6, 2019 at 1:29 PM Aizhamal

Re: (mini-doc) Beam (Flink) portable job templates

Hi Kyle, [document doesn't have comments enabled currently] As noted, worker deployment is an open question. I believe pipeline submission and worker execution need to be considered together for a complete deployment story. The idea of creating a self containing jar file is interesting, but

Re: [DISCUSS] Dependency management for Python SDK Container

On Wed, Aug 7, 2019 at 1:53 AM Ahmet Altay wrote: > > > On Mon, Aug 5, 2019 at 9:49 PM Valentyn Tymofieiev > wrote: > >> On Tue, Aug 6, 2019 at 2:29 AM Ahmet Altay wrote: >> >>> >>> >>> On Mon, Aug 5, 2019 at 1:43 AM Valentyn Tymofieiev >>> wrote: >>> - The purpose of install_requires in

Re: [ANNOUNCE] New committer: Kyle Weaver

Congratulations Kyle! On Tue, Aug 6, 2019 at 9:48 AM Anton Kedin wrote: > Congrats! > > On Tue, Aug 6, 2019, 9:37 AM Ankur Goenka wrote: > >> Congratulations Kyle! >> >> On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: >> >>> Hi, >>> >>> Please join me and the rest of the Beam PMC in

Re: [ANNOUNCE] New committer: Kyle Weaver

Congratulations Kyle!! Sent from my iPhone > On 6 Aug 2019, at 18:47, Anton Kedin wrote: > > Congrats! > >> On Tue, Aug 6, 2019, 9:37 AM Ankur Goenka wrote: >> Congratulations Kyle! >> >>> On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: >>> Hi, >>> >>> Please join me and the rest of the

Re: [DISCUSS] Dependency management for Python SDK Container

On Mon, Aug 5, 2019 at 9:49 PM Valentyn Tymofieiev wrote: > On Tue, Aug 6, 2019 at 2:29 AM Ahmet Altay wrote: > >> >> >> On Mon, Aug 5, 2019 at 1:43 AM Valentyn Tymofieiev >> wrote: >> >>> - The purpose of install_requires in setup.py is to define the maximally >>> permissive set of

Re: [ANNOUNCE] New committer: Rui Wang

Congrats! On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka wrote: > Congratulations Rui! > Well deserved  > > On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: > >> Hi, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: Rui >> Wang. >> >> Rui has been an active

Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats! On Tue, Aug 6, 2019, 9:37 AM Ankur Goenka wrote: > Congratulations Kyle! > > On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: > >> Hi, >> >> Please join me and the rest of the Beam PMC in welcoming a new committer: >> Kyle >> Weaver. >> >> Kyle has been contributing to Beam for a

Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats Kyle! On Tue, Aug 6, 2019 at 9:52 AM David Morávek wrote: > Congratulations Kyle!! > > Sent from my iPhone > > On 6 Aug 2019, at 18:47, Anton Kedin wrote: > > Congrats! > > On Tue, Aug 6, 2019, 9:37 AM Ankur Goenka wrote: > >> Congratulations Kyle! >> >> On Tue, Aug 6, 2019 at 9:35

Re: [ANNOUNCE] New committer: Rui Wang

Congrats Rui! On Tue, Aug 6, 2019 at 9:50 AM Yifan Zou wrote: > Congratulations Rui! > > On Tue, Aug 6, 2019 at 9:47 AM Anton Kedin wrote: > >> Congrats! >> >> On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka wrote: >> >>> Congratulations Rui! >>> Well deserved  >>> >>> On Tue, Aug 6, 2019 at 9:35

Re: [ANNOUNCE] New committer: Rui Wang

Congratulations Rui! Well deserved  On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: > Hi, > > Please join me and the rest of the Beam PMC in welcoming a new committer: Rui > Wang. > > Rui has been an active contributor since May 2018. Rui has been very > active in Beam SQL [1] and continues

[ANNOUNCE] New committer: Kyle Weaver

Hi, Please join me and the rest of the Beam PMC in welcoming a new committer: Kyle Weaver. Kyle has been contributing to Beam for a while now. And in that time period Kyle got the portable spark runner feature complete for batch processing. [1] In consideration of Kyle's contributions, the Beam

[ANNOUNCE] New committer: Rui Wang

Hi, Please join me and the rest of the Beam PMC in welcoming a new committer: Rui Wang. Rui has been an active contributor since May 2018. Rui has been very active in Beam SQL [1] and continues to help out on user@ and StackOverflow. Rui is one of the top answerers for apache-beam tag [2]. In

Re: [ANNOUNCE] New committer: Kyle Weaver

Congratulations Kyle! On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: > Hi, > > Please join me and the rest of the Beam PMC in welcoming a new committer: Kyle > Weaver. > > Kyle has been contributing to Beam for a while now. And in that time > period Kyle got the portable spark runner feature

Re: [ANNOUNCE] New committer: Rui Wang

Congratulations Rui! On Tue, Aug 6, 2019 at 9:47 AM Anton Kedin wrote: > Congrats! > > On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka wrote: > >> Congratulations Rui! >> Well deserved  >> >> On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: >> >>> Hi, >>> >>> Please join me and the rest of the

Re: [ANNOUNCE] New committer: Rui Wang

Congratulations Rui! On Tue, Aug 6, 2019 at 12:09 PM Hannah Jiang wrote: > Congrats Rui! > > On Tue, Aug 6, 2019 at 9:50 AM Yifan Zou wrote: > >> Congratulations Rui! >> >> On Tue, Aug 6, 2019 at 9:47 AM Anton Kedin wrote: >> >>> Congrats! >>> >>> On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka

Perf regression

I noticed there is a perf regression that appeared on Nexmark dashboard on July 30. It seems to be limited to SQL Query3 and most obvious in Dataflow runner. Direct runner shows a slight increase as well but Spark runner doesn't seem to be affected. I looked at the history of changes of Beam SQL

Re: [ANNOUNCE] New committer: Rui Wang

Congrats!  On Tue, Aug 6, 2019 at 09:47 Anton Kedin wrote: > Congrats! > > On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka wrote: > >> Congratulations Rui! >> Well deserved  >> >> On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: >> >>> Hi, >>> >>> Please join me and the rest of the Beam PMC in

Re: [ANNOUNCE] New committer: Rui Wang

Congrats Rui! On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy wrote: > Congratulations, Rui! Thank you for your contributions to Beam! > > On Tue, Aug 6, 2019 at 10:35 AM sridhar inuog > wrote: > >> Congratulations Rui! >> >> On Tue, Aug 6, 2019 at 12:09 PM Hannah Jiang >> wrote: >> >>>

Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats Kyle! On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy wrote: > Thank you, Kyle! And congratulations :) > > On Tue, Aug 6, 2019 at 10:09 AM Hannah Jiang > wrote: > >> Congrats Kyle! >> >> On Tue, Aug 6, 2019 at 9:52 AM David Morávek >> wrote: >> >>> Congratulations Kyle!! >>>

Re: [ANNOUNCE] New committer: Kyle Weaver

Thank you, Kyle! And congratulations :) On Tue, Aug 6, 2019 at 10:09 AM Hannah Jiang wrote: > Congrats Kyle! > > On Tue, Aug 6, 2019 at 9:52 AM David Morávek > wrote: > >> Congratulations Kyle!! >> >> Sent from my iPhone >> >> On 6 Aug 2019, at 18:47, Anton Kedin wrote: >> >> Congrats! >> >>

Re: [ANNOUNCE] New committer: Rui Wang

Congratulations, Rui! Thank you for your contributions to Beam! On Tue, Aug 6, 2019 at 10:35 AM sridhar inuog wrote: > Congratulations Rui! > > On Tue, Aug 6, 2019 at 12:09 PM Hannah Jiang > wrote: > >> Congrats Rui! >> >> On Tue, Aug 6, 2019 at 9:50 AM Yifan Zou wrote: >> >>> Congratulations

Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats Kyle! On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak wrote: > Congratulations Kyle! > > On Tue, Aug 6, 2019 at 1:36 PM Yichi Zhang wrote: > >> Congrats Kyle! >> >> On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy < >> aizha...@google.com> wrote: >> >>> Thank you, Kyle! And

Re: [ANNOUNCE] New committer: Rui Wang

Congrats Rui. On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak wrote: > Congrats Rui! > > On Tue, Aug 6, 2019 at 1:37 PM Yichi Zhang wrote: > >> Congrats Rui! >> >> On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy < >> aizha...@google.com> wrote: >> >>> Congratulations, Rui! Thank you for

Re: Beam IO python connector for Oracle

I don't believe we have such a connector yet. Will you be able to create a feature request JIRA ? On Thu, Aug 1, 2019 at 8:39 AM saman Liyanage wrote: > Hi Dev team, > > Appreciate if you could share if you have already build python IO > connector for oracle. > Thank you. > > Regards, > Saman >

Re: [ANNOUNCE] New committer: Kyle Weaver

Congratulations Kyle! On Tue, Aug 6, 2019 at 1:36 PM Yichi Zhang wrote: > Congrats Kyle! > > On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy > wrote: > >> Thank you, Kyle! And congratulations :) >> >> On Tue, Aug 6, 2019 at 10:09 AM Hannah Jiang >> wrote: >> >>> Congrats Kyle! >>> >>>

Re: [ANNOUNCE] New committer: Rui Wang

Congrats Rui! On Tue, Aug 6, 2019 at 1:37 PM Yichi Zhang wrote: > Congrats Rui! > > On Tue, Aug 6, 2019 at 1:29 PM Aizhamal Nurmamat kyzy > wrote: > >> Congratulations, Rui! Thank you for your contributions to Beam! >> >> On Tue, Aug 6, 2019 at 10:35 AM sridhar inuog >> wrote: >> >>>

Re: [ANNOUNCE] New committer: Kyle Weaver

Congrats!! On Tue, Aug 6, 2019 at 3:33 PM Udi Meiri wrote: > Congrats Kyle! > > On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak > wrote: > >> Congratulations Kyle! >> >> On Tue, Aug 6, 2019 at 1:36 PM Yichi Zhang wrote: >> >>> Congrats Kyle! >>> >>> On Tue, Aug 6, 2019 at 1:29 PM Aizhamal

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Just take a look at https://issues.apache.org/jira/browse/CALCITE-2280 which introduced Babel parser in Calcite to support varied dialects, this may be an easier way to support BigQuery syntax. @Rui do you notice any big difference between Calcite engine and ZetaSQL, like parsing, optimization? If

Caused by: java.lang.IllegalArgumentException: URI is not hierarchical

Getting following error while trying to run DataFloeRunner example in Self executing JAR mode. I have example word count spring boot application running fine with spring-boot:run maven, but fails with self executing

Re: [ANNOUNCE] New committer: Jan Lukavský

Congrats Jan! On Thu, Aug 1, 2019 at 11:10 AM Thomas Weise wrote: > Congrats! > > > On Thu, Aug 1, 2019 at 8:44 AM jincheng sun > wrote: > >> Congratulations Jan! >> Best, Jincheng >> >> Gleb Kanterov 于2019年8月1日周四 下午5:09写道： >> >>> Congratulations! >>> >>> On Thu, Aug 1, 2019 at 3:11 PM Reza

Re: Support ZetaSQL as a new SQL dialect in BeamSQL

Hi Mingmin, Honestly I don't have an answer to it: a SQL dialect is complicated and I don't have enough understanding on Calcite (Calcite has a big repo). Based on my read from CALCITE-2280 , the closer to standard sql that a dialect is, the

Re: [Update] Beam 2.15 Release Progress

Hi, There is a perf regression on SQL Query3 on dataflow runner. This was treated as a release blocker. We would appreciate if someone could look into this issue? For more details, please see Anton's email [1] and JIRA [2]. [1]

(mini-doc) Beam (Flink) portable job templates

Hi all, Following up on discussion about portable Beam on Flink on Kubernetes [1], I have drafted a short document on how I propose we bundle portable Beam applications into jars that can be run on OSS runners, similar to Dataflow templates (but without the actual template part, at least for the

Re: [ANNOUNCE] New committer: Kyle Weaver

Congratz! On Wed, 7 Aug 2019 at 06:40, Chamikara Jayalath wrote: > Congrats!! > > On Tue, Aug 6, 2019 at 3:33 PM Udi Meiri wrote: > >> Congrats Kyle! >> >> On Tue, Aug 6, 2019 at 2:00 PM Melissa Pashniak >> wrote: >> >>> Congratulations Kyle! >>> >>> On Tue, Aug 6, 2019 at 1:36 PM Yichi Zhang

Re: Snapshots not been updated

Everything back to normal. Thanks for fixing this quickly. On Mon, Aug 5, 2019 at 1:52 PM Valentyn Tymofieiev wrote: > > I think https://issues.apache.org/jira/browse/BEAM-7892 is the reason. > > On Sun, Aug 4, 2019 at 11:02 PM Ismaël Mejía wrote: >> >> Hello, >> >> It seems the

Re: [PROPOSAL] An initial Schema API in Python

On Sun, Aug 4, 2019 at 12:03 AM Chad Dombrova wrote: > > Hi, > > This looks like a great feature. > > Is there a plan to eventually support custom field types? > > I assume adding support for dataclasses in python 3.7+ should be trivial to > do in a follow up PR. Do you see any complications

Re: beam_PreCommit_Java_Commit is broken

Thank you for tracking and fixing this! > On 5 Aug 2019, at 18:26, Rui Wang wrote: > > It's being tracked by https://issues.apache.org/jira/browse/BEAM-7892 > . > > > -Rui > > On Mon, Aug 5, 2019 at 9:18 AM Alexey Romanenko