[jira] [Created] (CALCITE-3363) JoinUnionTransposeRule.RIGHT_UNION should not match SEMI/ANTI Join

2019-09-18 Thread jin xing (Jira)
jin xing created CALCITE-3363:
-

 Summary: JoinUnionTransposeRule.RIGHT_UNION should not match 
SEMI/ANTI Join
 Key: CALCITE-3363
 URL: https://issues.apache.org/jira/browse/CALCITE-3363
 Project: Calcite
  Issue Type: Bug
  Components: core
Reporter: jin xing


JoinUnionTransposeRule works by pull up union from below to top of join. Thus 
it should not match semi/anti join by semantics.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CALCITE-3362) Implementation for some empty tests of Lattice

2019-09-18 Thread Wang Yanlin (Jira)
Wang Yanlin created CALCITE-3362:


 Summary: Implementation for some empty tests of Lattice
 Key: CALCITE-3362
 URL: https://issues.apache.org/jira/browse/CALCITE-3362
 Project: Calcite
  Issue Type: Test
Reporter: Wang Yanlin


When read the code of lattice framework, came across some empty unit tests in 
[LatticeTest|https://github.com/apache/calcite/blob/67fd318ed755ef975cf31262c96c982f0922a975/core/src/test/java/org/apache/calcite/test/LatticeTest.java#L720].
Trying to implement these empty test cases.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: Query Compilation happening more often then expected

2019-09-18 Thread Julian Hyde
See my comments in https://issues.apache.org/jira/browse/CALCITE-963 
.

> On Sep 18, 2019, at 1:58 PM, Scott Reynolds  wrote:
> 
> Hi all,
> 
> I have submitted my pull request in github and wrote up a design document
> as a comment on CALCITE-963
> 
> 
> My implementation deviates considerably from what is being discussed in
> this thread so I rushed it up so you all can let me know what I am missing.
> Here is a excerpt from the design document:
> 
> Goal
> 
> When a query is issued to Calcite it is parsed, optimized and then
> generates a String of Java Class that implements Bindable.
> EnumerableInterpretable creates this string and checks to see if that
> string exists in com.google.common.cache and if it doesn't it will call
> into a Java compiler. Compilation process can take a considerable amount of
> time, Apache Kylin reported 50 to 150ms of additional computation time.
> Today, Apache Calcite will generate unique Java Class strings whenever any
> part of the query changes. This document details out the design and
> implementation of a hoisting technique within Apache Calcite. This design
> and implementation greatly increases the cache hit rate of
> EnumerableInterpretable's BINDABLE_CACHE.
> Non Goals
> 
> This implementation is not designed to change the planning process. It does
> not transform RexLiteral into RexDynamicParam, and doesn't change the cost
> calculation of the query.
> 
> Please take a moment to read the design document let me know what you think.
> 
> On Tue, Sep 17, 2019 at 12:27 PM Vladimir Sitnikov <
> sitnikov.vladi...@gmail.com> wrote:
> 
>> Stamatis>Out of curiosity does anybody know if popular DBMS (Postgres)
>> support "hoisting"?
>> 
>> PostgreSQL does support it, and here's a reproducible case when that
>> feature makes the query 300 times slower:
>> https://gist.github.com/vlsi/df08cbef370b2e86a5c1
>> 
>> Vladimir
>> 



Re: Re: [ANNOUNCE] New committer: Julian Feinauer

2019-09-18 Thread Muhammad Gelbana
Welcome aboard !

Thanks,
Gelbana


On Wed, Sep 18, 2019 at 5:10 PM Andrei Sereda  wrote:

> Congratulations, Julian !
>
> On Tue, Sep 17, 2019 at 11:26 PM Amit Chavan  wrote:
>
> > Congrats, Julian !!
> >
> > On Tue, Sep 17, 2019 at 8:12 PM XING JIN 
> wrote:
> >
> > > Congrats, Julian !
> > > You are well deserved ~
> > >
> > > Haisheng Yuan  于2019年9月18日周三 上午10:38写道:
> > >
> > > > Congrats, Julian!
> > > >
> > > > - Haisheng
> > > >
> > > > --
> > > > 发件人:Chunwei Lei
> > > > 日 期:2019年09月18日 10:30:31
> > > > 收件人:
> > > > 主 题:Re: [ANNOUNCE] New committer: Julian Feinauer
> > > >
> > > > Congratulations, Julian!
> > > >
> > > >
> > > >
> > > > Best,
> > > > Chunwei
> > > >
> > > >
> > > > On Wed, Sep 18, 2019 at 9:24 AM Danny Chan 
> > wrote:
> > > >
> > > > > Congratulations, Muhammad ! Welcome to join us ! Thanks for your
> huge
> > > > > contribution for the Match Recognize.
> > > > >
> > > > > Best,
> > > > > Danny Chan
> > > > > 在 2019年9月18日 +0800 AM5:55,Francis Chuang  > > >,写道:
> > > > > > Apache Calcite's Project Management Committee (PMC) has invited
> > > Julian
> > > > > > Feinauer to become a committer, and we are pleased to announce
> that
> > > he
> > > > > > has accepted.
> > > > > >
> > > > > > Julian is an active contributor to the Calcite code base and has
> > been
> > > > > > active on the mailing list answering questions, participating in
> > > > > > discussions and voting for releases.
> > > > > >
> > > > > > Julian, welcome, thank you for your contributions, and we look
> > > forward
> > > > > > your further interactions with the community! If you wish, please
> > > feel
> > > > > > free to tell us more about yourself and what you are working on.
> > > > > >
> > > > > > Francis (on behalf of the Apache Calcite PMC)
> > > > >
> > > >
> > > >
> > >
> >
>


Re: Query Compilation happening more often then expected

2019-09-18 Thread Scott Reynolds
Hi all,

I have submitted my pull request in github and wrote up a design document
as a comment on CALCITE-963


My implementation deviates considerably from what is being discussed in
this thread so I rushed it up so you all can let me know what I am missing.
Here is a excerpt from the design document:

Goal

When a query is issued to Calcite it is parsed, optimized and then
generates a String of Java Class that implements Bindable.
EnumerableInterpretable creates this string and checks to see if that
string exists in com.google.common.cache and if it doesn't it will call
into a Java compiler. Compilation process can take a considerable amount of
time, Apache Kylin reported 50 to 150ms of additional computation time.
Today, Apache Calcite will generate unique Java Class strings whenever any
part of the query changes. This document details out the design and
implementation of a hoisting technique within Apache Calcite. This design
and implementation greatly increases the cache hit rate of
EnumerableInterpretable's BINDABLE_CACHE.
Non Goals

This implementation is not designed to change the planning process. It does
not transform RexLiteral into RexDynamicParam, and doesn't change the cost
calculation of the query.

Please take a moment to read the design document let me know what you think.

On Tue, Sep 17, 2019 at 12:27 PM Vladimir Sitnikov <
sitnikov.vladi...@gmail.com> wrote:

> Stamatis>Out of curiosity does anybody know if popular DBMS (Postgres)
> support "hoisting"?
>
> PostgreSQL does support it, and here's a reproducible case when that
> feature makes the query 300 times slower:
> https://gist.github.com/vlsi/df08cbef370b2e86a5c1
>
> Vladimir
>


[jira] [Created] (CALCITE-3361) Add a test that parses and validates a SQL statement with every built-in Redshift function

2019-09-18 Thread Julian Hyde (Jira)
Julian Hyde created CALCITE-3361:


 Summary: Add a test that parses and validates a SQL statement with 
every built-in Redshift function
 Key: CALCITE-3361
 URL: https://issues.apache.org/jira/browse/CALCITE-3361
 Project: Calcite
  Issue Type: Bug
Reporter: Julian Hyde


Add a test that parses and validates a SQL statement with every built-in 
Redshift function.

It would be part of the babel component, but would go beyond parsing, and also 
validate.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Re: auto-format or fix checkstyle by maven command

2019-09-18 Thread Rui Wang
Thanks Danny.


To update spotless a bit: I played with the configuration of spotless on
import order to make it match with checkstyle. I found a few diff between
my customized spotless config and checkstyle (even though my config is
copied from checkstyle without minor modification).  One diff, for example,
is that spotless imports static first but checkstyle prefers static last,
which I haven't found a way to config.


-Rui

On Mon, Sep 16, 2019 at 8:53 PM Danny Chan  wrote:

> If you use IntelliJ IDEA for developing, you can generate a check style
> conf xml file for Calcite, then use this conf file in your code style
> config for Java. You should first download a check style plugin.
>
> Best,
> Danny Chan
> 在 2019年9月17日 +0800 AM3:09,Rui Wang ,写道:
> > Hi community,
> >
> > Is there a maven command or auto-formatter to fix checkstyle error when
> > developing in Calcite repo? I am less familiar with maven and did some
> > searches in both [1] and Google but found no luck.
> >
> >
> > [1]: https://calcite.apache.org/develop/
> >
> > -Rui
>


Re: [ANNOUNCE] New committer: Muhammad Gelbana

2019-09-18 Thread Muhammad Gelbana
Thank you all for the very warm welcome.

Calcite really changed a lot of things for my current employer. I got to
know Calcite when I was exposed to Drill and now we're planning to
integrating Calcite within our product. Being an analytics company, Calcite
provides great deal of help to us.

Thanks,
Gelbana


On Wed, Sep 18, 2019 at 5:10 PM Andrei Sereda  wrote:

> Congrats, Muhammad!
>
> On Tue, Sep 17, 2019 at 11:26 PM Amit Chavan  wrote:
>
> > Congratulations, Muhammad !!
> >
> > On Tue, Sep 17, 2019 at 8:10 PM XING JIN 
> wrote:
> >
> > > Congrats, Muhammad !
> > >
> > > 王炎林 <1989yanlinw...@163.com> 于2019年9月18日周三 上午10:38写道:
> > >
> > > > Congratulations, Muhammad!
> > > >
> > > >
> > > > Best,
> > > > Yanlin
> > > >
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > At 2019-09-18 05:58:53, "Francis Chuang" 
> > > wrote:
> > > > >Apache Calcite's Project Management Committee (PMC) has invited
> > Muhammad
> > > > >Gelbana to become a committer, and we are pleased to announce that
> he
> > > > >has accepted.
> > > > >
> > > > >Muhammad is an active contributor and has contributed numerous
> patches
> > > > >to Calcite. He has also been extremely active on the mailing list,
> > > > >helping out new users and participating in design discussions.
> > > > >
> > > > >Muhammad, welcome, thank you for your contributions, and we look
> > forward
> > > > >your further interactions with the community! If you wish, please
> feel
> > > > >free to tell us more about yourself and what you are working on.
> > > > >
> > > > >Francis (on behalf of the Apache Calcite PMC)
> > > >
> > >
> >
>


Re: Re: [ANNOUNCE] New committer: Julian Feinauer

2019-09-18 Thread Andrei Sereda
Congratulations, Julian !

On Tue, Sep 17, 2019 at 11:26 PM Amit Chavan  wrote:

> Congrats, Julian !!
>
> On Tue, Sep 17, 2019 at 8:12 PM XING JIN  wrote:
>
> > Congrats, Julian !
> > You are well deserved ~
> >
> > Haisheng Yuan  于2019年9月18日周三 上午10:38写道:
> >
> > > Congrats, Julian!
> > >
> > > - Haisheng
> > >
> > > --
> > > 发件人:Chunwei Lei
> > > 日 期:2019年09月18日 10:30:31
> > > 收件人:
> > > 主 题:Re: [ANNOUNCE] New committer: Julian Feinauer
> > >
> > > Congratulations, Julian!
> > >
> > >
> > >
> > > Best,
> > > Chunwei
> > >
> > >
> > > On Wed, Sep 18, 2019 at 9:24 AM Danny Chan 
> wrote:
> > >
> > > > Congratulations, Muhammad ! Welcome to join us ! Thanks for your huge
> > > > contribution for the Match Recognize.
> > > >
> > > > Best,
> > > > Danny Chan
> > > > 在 2019年9月18日 +0800 AM5:55,Francis Chuang  > >,写道:
> > > > > Apache Calcite's Project Management Committee (PMC) has invited
> > Julian
> > > > > Feinauer to become a committer, and we are pleased to announce that
> > he
> > > > > has accepted.
> > > > >
> > > > > Julian is an active contributor to the Calcite code base and has
> been
> > > > > active on the mailing list answering questions, participating in
> > > > > discussions and voting for releases.
> > > > >
> > > > > Julian, welcome, thank you for your contributions, and we look
> > forward
> > > > > your further interactions with the community! If you wish, please
> > feel
> > > > > free to tell us more about yourself and what you are working on.
> > > > >
> > > > > Francis (on behalf of the Apache Calcite PMC)
> > > >
> > >
> > >
> >
>


Re: [ANNOUNCE] New committer: Muhammad Gelbana

2019-09-18 Thread Andrei Sereda
Congrats, Muhammad!

On Tue, Sep 17, 2019 at 11:26 PM Amit Chavan  wrote:

> Congratulations, Muhammad !!
>
> On Tue, Sep 17, 2019 at 8:10 PM XING JIN  wrote:
>
> > Congrats, Muhammad !
> >
> > 王炎林 <1989yanlinw...@163.com> 于2019年9月18日周三 上午10:38写道:
> >
> > > Congratulations, Muhammad!
> > >
> > >
> > > Best,
> > > Yanlin
> > >
> > >
> > >
> > >
> > >
> > >
> > > At 2019-09-18 05:58:53, "Francis Chuang" 
> > wrote:
> > > >Apache Calcite's Project Management Committee (PMC) has invited
> Muhammad
> > > >Gelbana to become a committer, and we are pleased to announce that he
> > > >has accepted.
> > > >
> > > >Muhammad is an active contributor and has contributed numerous patches
> > > >to Calcite. He has also been extremely active on the mailing list,
> > > >helping out new users and participating in design discussions.
> > > >
> > > >Muhammad, welcome, thank you for your contributions, and we look
> forward
> > > >your further interactions with the community! If you wish, please feel
> > > >free to tell us more about yourself and what you are working on.
> > > >
> > > >Francis (on behalf of the Apache Calcite PMC)
> > >
> >
>


[jira] [Created] (CALCITE-3360) SqlValidator throws NEP for unregistered function without implicit type coercion

2019-09-18 Thread Danny Chan (Jira)
Danny Chan created CALCITE-3360:
---

 Summary: SqlValidator throws NEP for unregistered function without 
implicit type coercion 
 Key: CALCITE-3360
 URL: https://issues.apache.org/jira/browse/CALCITE-3360
 Project: Calcite
  Issue Type: Bug
  Components: core
Affects Versions: 1.21.0
Reporter: Danny Chan
Assignee: Danny Chan
 Fix For: 1.22.0






--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (CALCITE-3359) Update dependencies

2019-09-18 Thread Francis Chuang (Jira)
Francis Chuang created CALCITE-3359:
---

 Summary: Update dependencies
 Key: CALCITE-3359
 URL: https://issues.apache.org/jira/browse/CALCITE-3359
 Project: Calcite
  Issue Type: Improvement
  Components: avatica-go
Reporter: Francis Chuang
Assignee: Francis Chuang
 Fix For: avatica-go-5.0.0


Update dependencies before releasing 5.0.0



--
This message was sent by Atlassian Jira
(v8.3.4#803005)