Re: [NEED HELP] how to revert a PR in branch DSL_SQL

2017-07-19 Thread Kai Jiang
Or another option is solve merge conflict. This might not be the best way. Because once master branch has some changes, we still need to do this same way. I tried merge locally. We could solve conflict files and open PR for that. conflict files are: both modified:

Re: [DISCUSSION] Encouraging more contributions

2017-06-29 Thread Kai Jiang
That's an interesting experiment. From new contributor's aspect, I would see more small feature project ideas (just like rust community do). Since existing beginner issues give new contributors a vague roadmap what they should do next. On Thu, Jun 29, 2017 at 1:53 PM, Sourabh Bajaj <

Re: Merge branch DSL_SQL to master

2017-09-07 Thread Kai Jiang
nd developer-facing documentation > > >> > > > > >> > > * A web page[4] is added to describe the usage of SQL DSL and how > it > > >> > works; > > >> > > > > >> > > > > >> > > 3. Have at l

[SQL] Cross Join Operation

2018-05-15 Thread Kai Jiang
Hi everyone, To prove the idea of GSoC project, I was working on some simple TPC-DS queries running with given generated data on direct runner. query example The example is executed with TPC-DS query 9

[SQL] Unsupported features

2018-05-30 Thread Kai Jiang
Hi all, Based on pull/5481 , I manually did a coverage test with TPC-ds queries (65%) and TPC-h queries (100%) and want to see what features Beam SQL is currently not supporting. Test was running on DirectRunner. I want to share the result.​ TPC-DS

Re: [SQL] Unsupported features

2018-06-04 Thread Kai Jiang
really interesting to have this also as part of some kind of > IT for the future. > > > On Fri, Jun 1, 2018 at 7:43 PM Kai Jiang wrote: > >> Sounds a good idea! I will file the major problems later and use a task >> issue to track. >> >> Best, >> Ka

Re: [SQL] Unsupported features

2018-06-05 Thread Kai Jiang
FYI, Umbrella JIRA ticket: https://issues.apache.org/jira/browse/BEAM-4476 ᐧ ᐧ On Mon, Jun 4, 2018 at 3:08 PM Kai Jiang wrote: > Ismaël, I was running this naive code snippet > <https://gist.github.com/vectorijk/7c54f90aeebfd6fd9e9d2ee224bfed50>. > Yes, IT would be interestin

Re: [SQL] Unsupported features

2018-06-01 Thread Kai Jiang
ing with sub-tasks for specific problems. > > Regards, > Anton > > On Wed, May 30, 2018 at 9:12 AM Kenneth Knowles wrote: > >> This is extremely useful. Thanks for putting so much information together! >> >> Kenn >> >> On Wed, May 30, 2018 at 8:19 AM

Re: Going on leave for a bit

2018-06-26 Thread Kai Jiang
Congrats! Enjoy your family time. Best, Kai On Tue, Jun 26, 2018, 09:11 Alan Myrvold wrote: > Congrats, Kenn and have a great break. > > On Tue, Jun 26, 2018 at 9:10 AM Alexey Romanenko > wrote: > >> Best wishes to you and your family, Kenneth! >> >> Alexey >> >> On 26 Jun 2018, at 15:45,

Google Summer of Code Project Intro

2018-05-03 Thread Kai Jiang
Hi Beam Dev, I am Kai. GSoC has announced selected projects last week. During community bonding period, I want to share some basics about this year's project with Apache Beam. Project abstract: https://summerofcode.withgoogle.com/projects/#6460770829729792 Issue Tracker: BEAM-3783

Re: Fwd: Google Summer of Code 2018 is coming

2018-02-26 Thread Kai Jiang
ale up some examples on different runners to do some optimization, or > > implementing new join algorithms and/or using Calcite's rule system to > > select the right one. I will see about writing these up more clearly. > > > > Kenn > > > > On Mon, Feb 26, 2018

Re: Community Examples Repository

2018-08-02 Thread Kai Jiang
Agreed with Rui. We could also add more SQL examples (like, different IOs ) for everyone to get started with. Best, Kai On 2018/08/02 17:40:32, Rui Wang wrote: > I might miss it: are examples to be moved including those which are not > under example/? For example there are some BeamSQL

Re: Beam Docs Contributor

2018-07-29 Thread Kai Jiang
Welcome Rose! ᐧ On Sun, Jul 29, 2018 at 8:53 PM Rui Wang wrote: > Welcome! > > -Rui > > On Sun, Jul 29, 2018 at 7:07 PM Griselda Cuevas wrote: > >> Welcome Rose, very glad to have you in the community :) >> >> >> >> On Fri, 27 Jul 2018 at 16:29, Ahmet Altay wrote: >> >>> Welcome Rose! Looking

Re: Issues with Beam SQL on Spark

2018-07-29 Thread Kai Jiang
d this thread to dev@calcite and to see if we can connect between calcite modules without using the DriverManager. Best, Kai ᐧ On Tue, Jul 24, 2018 at 1:04 PM Kai Jiang wrote: > Thank you Andrew! I will take a look at if it is feasible to rewrite > "jdbc:calcite:" in Beam's

Re: Hello Beam Community!!!

2018-08-04 Thread Kai Jiang
Welcome! On Fri, Aug 3, 2018, 23:59 Rui Wang wrote: > Welcome! > > -Rui > > On Fri, Aug 3, 2018 at 11:29 PM Griselda Cuevas wrote: > >> Welcome! >> >> On Fri, Aug 3, 2018, 9:44 PM Jean-Baptiste Onofré >> wrote: >> >>> Welcome aboard ! >>> >>> Regards >>> JB >>> >>> On 04/08/2018 04:39,

Re: Status of IntelliJ with Gradle

2018-08-22 Thread Kai Jiang
On 2018/08/22 21:11:06, Xinyu Liu wrote: > We experienced the same issues too in intellij after switching to latest > version. I did the trick Luke mentioned before to include the > beam-model-fn-execution and beam-model-job-management jars in the dependent > modules to get around

Re: Status of IntelliJ with Gradle

2018-08-22 Thread Kai Jiang
I encountered same error with Xinyu when I was launching unit tests in Intellij. For now, I am only using gradle to test unit tests. Thanks, Kai On 2018/08/22 21:11:06, Xinyu Liu wrote: > We experienced the same issues too in intellij after switching to latest > version. I did the trick Luke

Re: [Vote] Dev wiki engine

2018-07-19 Thread Kai Jiang
+1 Apache Confluence On Thu, Jul 19, 2018, 15:18 Lukasz Cwik wrote: > +1 for confluence. > > On Thu, Jul 19, 2018 at 3:17 PM Anton Kedin wrote: > >> +1 for Confluence >> >> >> On Thu, Jul 19, 2018 at 2:56 PM Andrew Pilloud >> wrote: >> >>> +1 Apache Confluence >>> >>> Because .md files in

Re: Issues with Beam SQL on Spark

2018-07-24 Thread Kai Jiang
to connect > between calcite modules). > > Andrew > > On Mon, Jul 23, 2018 at 11:18 PM Kai Jiang wrote: > > > Hi all, > > > > I met an issue when I ran Beam SQL on Spark. I want to check and see if > > anyone has same issue with me. I believe let beam

Re: Issues with Beam SQL on Spark

2018-07-24 Thread Kai Jiang
sing the problem by relocating calcite's path but > not also modifying the global state it creates. > > Andrew > > On Tue, Jul 24, 2018 at 12:03 PM Kai Jiang wrote: > > > Thanks Andrew! It's really helpful. I'll take a try on shade calcite with > > rewriting the &qu

Re: [ANNOUNCEMENT] Nexmark included to the CI

2018-07-11 Thread Kai Jiang
Hi Etienne, It's awesome for working on these useful dashboards. I am getting TPC-H benchmark running on Flink and Dataflow Runner. I could work on similar dashboards for TPC benchmark after code merged. Also, it's great to have a dashboards for Dataflow. Best, Kai ᐧ On Wed, Jul 11, 2018 at

Re: Permissions for confluence

2018-07-13 Thread Kai Jiang
Same question. I think only committers have permission to edit page. Also, looking forward to working on some pages. On Fri, Jul 13, 2018, 16:28 Mikhail Gryzykhin wrote: > Hi everyone, > > I believe that last month we decided to keep developers documentation on > Apache confluence wiki

Re: Fwd: Google Summer of Code 2018 is coming

2018-02-26 Thread Kai Jiang
@Kenneth, Thanks for getting back to me! I am excited to hear that you want to be the mentor. Definitely, I am very willing to work on SQL. I will ping you offline (slack or email) and talk more about that. Best, Kai On Mon, Feb 26, 2018 at 9:40 AM, Kai Jiang <jiang...@gmail.com>

Re: Fwd: Google Summer of Code 2018 is coming

2018-02-26 Thread Kai Jiang
Hi Beam Community, I am Kai Jiang, a master student majoring in CS from Portland State University, highly interested in big data and distributed System. I have contributed code to Apache Spark as a selected GSoC project in 2016. Besides, I've been contributing to Beam codebase. Some my Pull

Re: Help! Beam SQL needs more committer support

2018-06-28 Thread Kai Jiang
I am very interested in supporting SQL PRs to help you reduce your bandwidths. Best, Kai On Thu, Jun 28, 2018, 11:52 Austin Bennett wrote: > Same as Pablo - you can count me in, though am vastly less experience in > the Beam way, as him, etc. > > > On Thu, Jun 28, 2018 at 11:36 AM, Pablo

Jira Integration with Github

2018-10-08 Thread Kai Jiang
Hi all, Github has announced the official support for Jira integraton https://blog.github.com/2018-10-04-announcing-the-new-github-and-jira-software-cloud-integration/ . Is it possible to enable it for Apache Beam's Jira tickets? It could help with automation of issue workflows in Jira. Maybe,

Re: Jira Integration with Github

2018-10-09 Thread Kai Jiang
> This needs to be supported by the ASF first. So the best idea would be >>> to propose this to the INFRA team. Or post it on the ASF community >>> mailing list. >>> >>> Best, >>> Max >>> >>> On 09.10.18 06:37, Kai Jiang wrote: >>> >

Re: Move mock classes out of test directory in BeamSQL

2018-10-03 Thread Kai Jiang
Big +1. Best, Kai ᐧ On Mon, Oct 1, 2018 at 10:42 PM Jean-Baptiste Onofré wrote: > +1 > > it makes sense. > > Regards > JB > > On 02/10/2018 01:32, Rui Wang wrote: > > Hi Community, > > > > BeamSQL defines some mock classes (see mock > > < >

Re: [ANNOUNCEMENT] New Beam chair: Kenneth Knowles

2018-09-19 Thread Kai Jiang
Congrats, Kenn! ᐧ On Wed, Sep 19, 2018 at 1:23 PM Alan Myrvold wrote: > Congrats, Kenn. > > On Wed, Sep 19, 2018 at 1:08 PM Maximilian Michels wrote: > >> Congrats! >> >> On 19.09.18 22:07, Robin Qiu wrote: >> > Congratulations, Kenn! >> > >> > On Wed, Sep 19, 2018 at 1:05 PM Lukasz Cwik > >

Re: Donating the Dataflow Worker code to Apache Beam

2018-09-13 Thread Kai Jiang
+1 (non googler) big help for transparency and for future runners. Best, Kai On Thu, Sep 13, 2018, 11:45 Xinyu Liu wrote: > Big +1 (non-googler). > > From Samza Runner's perspective, we are very happy to see dataflow worker > code so we can learn and compete :). > > Thanks, > Xinyu > > On

Re: [ANNOUNCE] New committer announcement: Gleb Kanterov

2019-01-25 Thread Kai Jiang
Congratulations! On Fri, Jan 25, 2019 at 10:01 AM Rui Wang wrote: > Congratulations! > > -Rui > > On Fri, Jan 25, 2019 at 9:58 AM Ruoyun Huang wrote: > >> Congratulations Gleb! >> >> On Fri, Jan 25, 2019 at 9:18 AM Scott Wegner wrote: >> >>> Congrats, and welcome Gleb! >>> >>> On Fri, Jan 25,

Re: [ANNOUNCE] New committer: Mikhail Gryzykhin

2019-06-24 Thread Kai Jiang
Congrats! On Mon, Jun 24, 2019 at 1:46 PM Chamikara Jayalath wrote: > Congrats!! > > On Mon, Jun 24, 2019 at 11:12 AM Mikhail Gryzykhin > wrote: > >> Thank you everyone. >> >> On Mon, Jun 24, 2019 at 2:28 AM Aizhamal Nurmamat kyzy < >> aizha...@google.com> wrote: >> >>> Congrats Misha! >>> >>>

Re: [VOTE] Vendored Dependencies Release

2019-07-10 Thread Kai Jiang
pull/8357 proposes to vendor bytebuddy artifact. Is it possible to release "beam-vendor-bytebuddy-1_9_3" in next release candidate? Best, Kai On Wed, Jul 10, 2019 at 11:31 AM Kenneth Knowles wrote: > grpc: jar contains certs, keys, protos at the top

Re: [VOTE] Vendored Dependencies Release

2019-07-12 Thread Kai Jiang
+1 (non-binding) On Thu, Jul 11, 2019 at 8:27 PM Lukasz Cwik wrote: > Please review the release of the following artifacts that we vendor: > * beam-vendor-grpc_1_21_0 > * beam-vendor-guava-26_0-jre > * beam-vendor-bytebuddy-1_9_3 > > Hi everyone, > Please review and vote on the release

[Discuss] Propose Calcite Vendor Release

2019-08-21 Thread Kai Jiang
Hi Community, As a part of effort to unblock for vendor calcite in SQL module, we broke it into pull/9333 for going through vendored dependencies release process separately. I want to propose Calcite vendor release and look for a release manager to help

Re: [Discuss] Propose Calcite Vendor Release

2019-08-22 Thread Kai Jiang
> > > [1]: https://s.apache.org/beam-release-vendored-artifacts > > -Rui > > On Wed, Aug 21, 2019 at 5:00 PM Kai Jiang wrote: > >> Hi Community, >> >> As a part of effort to unblock for vendor calcite in SQL module, we broke >> it into pull/9333 <ht

Re: [VOTE] Vendored Dependencies Release

2019-08-28 Thread Kai Jiang
+1 (non-binding)Thanks Rui! On Tue, Aug 27, 2019 at 10:46 PM Rui Wang wrote: > Please review the release of the following artifacts that we vendor: > > * beam-vendor-calcite-1_20_0 > > Hi everyone, > > Please review and vote on the release candidate #1 for the >

Re: [VOTE] Vendored Dependencies Release

2019-08-28 Thread Kai Jiang
Hi Rui, For accessing artifacts [1] in Maven Central Repository, is this intent to be not public exposed? Best, Kai [1] https://repository.apache.org/content/repositories/orgapachebeam-1083/ On Wed, Aug 28, 2019 at 11:57 AM Kai Jiang wrote: > +1 (non-binding)Thanks Rui! > > On

Re: [ANNOUNCE] New committer: Rui Wang

2019-08-06 Thread Kai Jiang
Congrats!  On Tue, Aug 6, 2019 at 09:47 Anton Kedin wrote: > Congrats! > > On Tue, Aug 6, 2019, 9:36 AM Ankur Goenka wrote: > >> Congratulations Rui! >> Well deserved  >> >> On Tue, Aug 6, 2019 at 9:35 AM Ahmet Altay wrote: >> >>> Hi, >>> >>> Please join me and the rest of the Beam PMC in

Failed Nexmark non-Direct runner tests with vendored Calcite

2019-09-19 Thread Kai Jiang
Hi Community, When vendoring Calcite in Beam SQL (pull/9189 ), we only pass direct runner nexmark test, but, all non-Direct runners tests were not passed (Spark runner , Flink runner

Re: beam_PostCommit_Java_Nexmark_Flink are failing continuously

2019-10-16 Thread Kai Jiang
I checked the logs of failure jobs. It might be related to the issue when vendoring calcite. Investigating on this issue. Best, Kai On Wed, Oct 16, 2019 at 11:06 AM Boyuan Zhang wrote: > Hey team, > > beam_PostCommit_Java_Nexmark_Flink >

Re: [spark structured streaming runner] available on master

2019-11-20 Thread Kai Jiang
Cool, cool! Love to see Nexmark on Spark structured streaming runner perfkit dashboard On Wed, Nov 20, 2019 at 2:12 PM Pablo Estrada wrote: > Very cool! : ) Thanks to everyone involved moving this forward. > Best > -P. > > On Wed, Nov 20, 2019 at 8:50 AM Etienne Chauchot > wrote: > >> Forgot

Re: [Discuss] Propose Calcite Vendor Release (1.22.0)

2020-03-04 Thread Kai Jiang
Thanks, Rui! Big +1 for calcite vendor release (1.22.0) Curious, what's the progress of Calcite 1.22.0 official release? I saw Calcite community just passes the vote for 1.22.0 rc3. Best, Kai On Wed, Mar 4, 2020 at 9:24 PM Rui Wang wrote: > Hi Community, > > As Calcite is closing to finish

Re: [VOTE] Vendored Dependencies Release Byte Buddy 1.10.8 RC2

2020-02-26 Thread Kai Jiang
+1 (non-binding) On Wed, Feb 26, 2020 at 01:23 Ismaël Mejía wrote: > Please review the release of the following artifacts that we vendor: > * beam-vendor-bytebuddy-1_10_8 > > Hi everyone, > Please review and vote on the release candidate #2 for the version 0.1, as > follows: > [ ] +1, Approve

Re: [VOTE] Vendored Dependencies Release gRPC 1.26.0 v0.2 for BEAM-9252

2020-02-21 Thread Kai Jiang
+1 (non-binding) On Fri, Feb 21, 2020 at 5:03 PM Robin Qiu wrote: > +1 (verified) > > On Fri, Feb 21, 2020 at 4:55 PM Robert Bradshaw > wrote: > >> +1 (binding) >> >> >> On Fri, Feb 21, 2020 at 4:48 PM Ahmet Altay wrote: >> > >> > +1 >> > >> > On Fri, Feb 21, 2020 at 4:39 PM Luke Cwik wrote:

Re: [PROPOSAL] Vendored bytebuddy dependency release

2020-02-22 Thread Kai Jiang
+1 On Sat, Feb 22, 2020 at 09:50 Alex Van Boxel wrote: > +1 > > _/ > > _/ Alex Van Boxel > > > On Sat, Feb 22, 2020 at 5:45 PM Jean-Baptiste Onofré > wrote: > >> +1 >> >> Regards >> JB >> >> Le sam. 22 f?vr. 2020 ? 15:02, Isma?l Mej?a a ?crit : >> >>> The version of bytebuddy Beam is

Re: beam_PostCommit_Java_Nexmark_Flink are failing continuously

2020-01-08 Thread Kai Jiang
git bisect on commits. this issue is fixed by https://github.com/apache/beam/commit/4af507f567605723af940c2af3b2912d0948adf5 On Thu, Oct 17, 2019 at 3:14 AM Maximilian Michels wrote: > Definitely not expected :) Thanks for investigating Kai. > > On 16.10.19 20:29, Kai Jiang wrote: >

Re: [VOTE] Vendored Dependencies Release

2020-01-10 Thread Kai Jiang
+1 (non-binding) On Thu, Jan 9, 2020 at 8:48 PM jincheng sun wrote: > +1,checked list as follows: > - verified the hash and signature > - verified that there is no linkage errors > - verified that the content of the pom is expected: the shaded > dependencies are not exposed, the scope of the

Re: Jenkins job execution policy

2020-01-14 Thread Kai Jiang
Nice! I took a look at Beam Jenkins job properties ( CommonJobProperties.groovy#L108-L111 ) and it uses jenkinsci/ghprb-plugin

Re: Jenkins jobs not running for my PR 10438

2020-01-02 Thread Kai Jiang
same for https://github.com/apache/beam/pull/9903 as well On Thu, Jan 2, 2020 at 1:40 PM Chamikara Jayalath wrote: > Seems like Jenkins tests are not being triggered for this PR as well: > https://github.com/apache/beam/pull/10427 > > On Fri, Dec 20, 2019 at 2:16 PM Tomo Suzuki wrote: > >>

Re: Jenkins jobs not running for my PR 10438

2020-01-02 Thread Kai Jiang
>> Maybe the PR status is not being updated when the jobs run? >> >> >> On Thu, Jan 2, 2020 at 2:37 PM Kai Jiang wrote: >> >>> same for https://github.com/apache/beam/pull/9903 as well >>> >>> On Thu, Jan 2, 2020 at 1:40 PM Chamikara Jayal

Re: Jenkins jobs not running for my PR 10438

2020-01-06 Thread Kai Jiang
pushing again. retest this please. nothing works :( >>> >>> On Fri, Jan 3, 2020 at 12:55 AM Michał Walenia < >>> michal.wale...@polidea.com> wrote: >>> >>>> Hi, >>>> I'm also affected by this - I touched my PRs opened before the ho

Re: Jenkins jobs not running for my PR 10438

2020-01-07 Thread Kai Jiang
e was a >>>>> change in Jenkins job execution policy - non-committers can't run Jenkins >>>>> workflows now, as it would be a security flaw in terms of arbitrary code >>>>> execution. >>>>> Does anyone know about this? When exactly was thi

Re: GSoC 2020: Congratulations, your proposal with The Apache Software Foundation has been accepted!

2020-05-04 Thread Kai Jiang
Congratulations! On Mon, May 4, 2020 at 8:07 PM John Mora wrote: > Hi all. > > My proposal for GSoC was accepted, so this summer I will be working with > you guys in the aggregation analytics functionality of Beam. Thanks so much > for your support during the application period, specially to my

Re: [VOTE] Vendored Dependencies Release Byte Buddy 1.11.0

2021-05-19 Thread Kai Jiang
+1 (non-binding) On Wed, May 19, 2021 at 12:23 PM Jan Lukavský wrote: > +1 (non-binding) > > verified correct shading. > > Jan > On 5/19/21 8:53 PM, Ismaël Mejía wrote: > > This release is only to publish the vendored dependency artifacts. We need > those to integrate it and be able to verify

Re: [VOTE] Release vendor-calcite-1_26_0 version 0.1, release candidate #1

2021-03-08 Thread Kai Jiang
+1 (non-binding) On Mon, Mar 8, 2021 at 11:37 AM Andrew Pilloud wrote: > Hi everyone, > Please review and vote on the release candidate #1 for > beam-vendor-calcite-1_26_0 version 0.1, as follows: > [ ] +1, Approve the release > [ ] -1, Do not approve the release (please provide specific