Re: [ANNOUNCE] Stamatis Zampetakis joins Calcite PMC

2019-04-30 Thread Julian Hyde
It’s unusual for someone to go from committer to PMC member in only a few months, but you’ve totally earned this. Congratulations and welcome, Stamatis. > On Apr 30, 2019, at 3:26 AM, Stamatis Zampetakis wrote: > > Thank you all for your kind words and for entrusting me this new role! > >

Re: calcite overhead for simple queries (optimization and conversion phase)

2019-04-30 Thread Julian Hyde
> As temporary work-around can I re-use PreparedStatement ? If you mean re-execute PreparedStatement, yes. Its main purpose is to only pay the cost of preparation once, but execute multiple times (possibly with different parameter values). But each time you execute it will be the same query

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Lai Zhou
how about these: [CALCITE-2973] Allow theta joins that have equi conditions to be executed using a hash join algorithm [CALCITE-2282] Allow OperatorTable to be pluggable in the parser [CALCITE-2992] Enhance implicit conversions when generating hash join keys for an equi condition Julian Hyde

calcite overhead for simple queries (optimization and conversion phase)

2019-04-30 Thread Andrei Sereda
Hello, One of our applications uses Calcite as translation layer between SQL and destination source (mongo, elastic, etc.). The queries are fairly simple and similar to the one below: select col1, col2, agg3(col3), agg4(col4), ..., aggN(colN) from table where id in (1, 2, 3) group by col1, col2

[jira] [Created] (CALCITE-3040) Avatica drops exception messages starting in 1.14.0

2019-04-30 Thread Andrew Pilloud (JIRA)
Andrew Pilloud created CALCITE-3040: --- Summary: Avatica drops exception messages starting in 1.14.0 Key: CALCITE-3040 URL: https://issues.apache.org/jira/browse/CALCITE-3040 Project: Calcite

Re: calcite overhead for simple queries (optimization and conversion phase)

2019-04-30 Thread Julian Hyde
Consider using Hep planner rather than Volcano planner. (Measure the number of rule firings. Is it higher than you think is necessary, given the complexity of the query?) If you reduce the number of columns (to say 10), does the time reduce significantly? That might be a clue that there is a

Re: calcite overhead for simple queries (optimization and conversion phase)

2019-04-30 Thread Andrei Sereda
> Consider using Hep planner rather than Volcano planner. Will check with Hep. Working on isolated unit test. > If you reduce the number of columns (to say 10), does the time reduce significantly? That might be a clue that there is a performance bug somewhere. Number of columns seems to be

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Ruben Q L
Thanks for starting this discussion, Michael. I would also add to the list (even though it will be flagged as "experimental"): CALCITE-2812 Add algebraic operators to allow expressing recursive queries Best regards, Ruben Le mar. 30 avr. 2019 à 17:15, Michael Mior a écrit : > Calcite

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Francis Chuang
Since Avatica 1.14.0 is now release, I think the Avatica dependency can also be upgraded. However, CALCITE-3040 [1] was just opened for Avatica and appears to be caused by CALCITE-2845 [2]. If this is a blocker for Calcite, we can (maybe) wait until Avatica 1.15.0 is released and upgrade it in

[DISCUSS] Towards Avatica 1.15.0

2019-04-30 Thread Francis Chuang
After Avatica 1.14.0 was released, it was reported that the fix for CALCITE-2845 [1] broke some existing clients. This is currently being tracked in CALCITE-3040 [2]. We need to release Avatica 1.15.0 to fix this issue, so that Calcite can upgrade its version of Avatica. While this is a

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Julian Hyde
I don’t feel strongly about it, but my vote is for 1.15 rather than 1.14.1. I don’t want people to infer that it’s easy for us to do patch releases and start requesting them on a whim. (It’s not that hard, but we’re all volunteers.) Julian > On Apr 30, 2019, at 4:16 PM, Francis Chuang wrote:

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Julian Hyde
I think that CALCITE-3040 means that Avatica 1.14.0 is not a useful release. (I do take Vladimir’s point that clients should be smarter. But they are not. We changed, and we broke them.) So let’s release an Avatica 1.14.1 or 1.15 before we release Calcite 1.20. > On Apr 30, 2019, at 3:20 PM,

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Francis Chuang
I am happy to be RM for the next version of Avatica. This should be a pretty small release with 1 bug fix. Before I open a separate thread for it, should it be 1.14.1 or 1.15.0? We have never made patch releases and have always made minor or major releases. On 1/05/2019 9:12 am, Kai Jiang

Re: [ANNOUNCE] New committers: Zhiwei Peng

2019-04-30 Thread wmy7ymw
Congrats Zhiwei! On Tue, Apr 30, 2019 at 2:23 AM Zoltan Haindrich wrote: > Congratulations Zhiwei! > > > On 4/28/19 4:43 PM, Andrei Sereda wrote: > > Congrats Zhiwei! > > > > On Sat, Apr 27, 2019 at 11:06 PM Michael Mior wrote: > > > >> Welcome Zhiwei and thanks for your contributions! > >> --

Re: [ANNOUNCE] New committers: Chunwei Lei

2019-04-30 Thread wmy7ymw
Congrats Chunwei! On Tue, Apr 30, 2019 at 2:23 AM Zoltan Haindrich wrote: > Congratulations Chunwei! > > On 4/28/19 4:43 PM, Andrei Sereda wrote: > > Congrats Chunwei! > > > > On Sat, Apr 27, 2019 at 11:06 PM Michael Mior wrote: > > > >> Congratulations and welcome Chunwei! > >> -- > >>

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Yuzhao Chen
Thx Michael for listing these changes. [CALCITE-3026] has been canceled, see the discussion in [1]. [CALCITE-3037]’s renaming work has already been done in CALCITE-2969, I’m not that sure if we should merge the EnumerableCorrelate and EnumerableNestedLoopJoin yet, but I think it should not be a

[jira] [Created] (CALCITE-3041) Query runs endless when setImportance to 0

2019-04-30 Thread Haisheng Yuan (JIRA)
Haisheng Yuan created CALCITE-3041: -- Summary: Query runs endless when setImportance to 0 Key: CALCITE-3041 URL: https://issues.apache.org/jira/browse/CALCITE-3041 Project: Calcite Issue

Re: [DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Kai Jiang
+1 release 1.14.1 or 1.15.0 for unblocking CALCITE-3040 On Tue, Apr 30, 2019 at 3:59 PM Julian Hyde wrote: > I think that CALCITE-3040 means that Avatica 1.14.0 is not a useful > release. (I do take Vladimir’s point that clients should be smarter. But > they are not. We changed, and we broke

[jira] [Created] (CALCITE-3042) Fix minor bugs in Avatica-Go docker release script

2019-04-30 Thread Francis Chuang (JIRA)
Francis Chuang created CALCITE-3042: --- Summary: Fix minor bugs in Avatica-Go docker release script Key: CALCITE-3042 URL: https://issues.apache.org/jira/browse/CALCITE-3042 Project: Calcite

[jira] [Created] (CALCITE-3043) Add additional functionality to docker release script

2019-04-30 Thread Francis Chuang (JIRA)
Francis Chuang created CALCITE-3043: --- Summary: Add additional functionality to docker release script Key: CALCITE-3043 URL: https://issues.apache.org/jira/browse/CALCITE-3043 Project: Calcite

[DISCUSS] Towards Calcite 1.20.0

2019-04-30 Thread Michael Mior
Calcite 1.19.0 was released approximately one month ago. This was later than we originally planned (although I think with good reason and I'm happy with what made it into this release). I don't think there's an imminent need for a new release, but I wanted to start the discussion now that Avatica

Re: [ANNOUNCE] Stamatis Zampetakis joins Calcite PMC

2019-04-30 Thread Stamatis Zampetakis
Thank you all for your kind words and for entrusting me this new role! It's a great honor to be part of the PMC but even more being part of a project with such a lively community. I really appreciate the fact that we have many people so eager to help and from whom I also learn new things every

Re: [ANNOUNCE] Stamatis Zampetakis joins Calcite PMC

2019-04-30 Thread Zoltan Haindrich
Congratulations Stamatis! On 4/28/19 4:40 PM, Andrei Sereda wrote: Congrats, Stamatis. On Sat, Apr 27, 2019 at 11:08 PM Michael Mior wrote: Congratulations Stamatis and thanks for all you've done! -- Michael Mior mm...@apache.org Le ven. 26 avr. 2019 à 22:44, Francis Chuang a écrit :

[VOTE] Release apache-calcite-avatica-go-4.0.0-rc0 (release candidate 0)

2019-04-30 Thread Francis Chuang
Hi all, I have created a release for Apache Calcite Avatica Go 4.0.0-rc0, release candidate 0. Thanks to everyone who has contributed to this release. The release notes are available here:

Re: [ANNOUNCE] New committers: Zhiwei Peng

2019-04-30 Thread Zoltan Haindrich
Congratulations Zhiwei! On 4/28/19 4:43 PM, Andrei Sereda wrote: Congrats Zhiwei! On Sat, Apr 27, 2019 at 11:06 PM Michael Mior wrote: Welcome Zhiwei and thanks for your contributions! -- Michael Mior mm...@apache.org Le ven. 26 avr. 2019 à 22:37, Francis Chuang a écrit : Apache

Re: [ANNOUNCE] New committers: Chunwei Lei

2019-04-30 Thread Zoltan Haindrich
Congratulations Chunwei! On 4/28/19 4:43 PM, Andrei Sereda wrote: Congrats Chunwei! On Sat, Apr 27, 2019 at 11:06 PM Michael Mior wrote: Congratulations and welcome Chunwei! -- Michael Mior mm...@apache.org Le ven. 26 avr. 2019 à 22:34, Francis Chuang a écrit : Apache Calcite's Project