Re: [DISCUSS] Apache Calcite Online Meetup January 2021

2020-11-19 Thread Vineet Garg
I think this is a great idea. +1 for the online meetup. If there are slots left I can also talk about how Hive leverages Calcite to do query optimization. -Vineet On Fri, Nov 6, 2020 at 7:21 AM Stamatis Zampetakis wrote: > Let's try to fix the date/time and tentative agenda so that we can add

[jira] [Created] (CALCITE-3952) Improve SortRemoveRule to remove Sort based on rowcount

2020-04-22 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3952: Summary: Improve SortRemoveRule to remove Sort based on rowcount Key: CALCITE-3952 URL: https://issues.apache.org/jira/browse/CALCITE-3952 Project: Calcite

[jira] [Created] (CALCITE-3914) Improve SubsitutionVisitor to consider RexCall of type PLUS and TIMES for canonicalization

2020-04-10 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3914: Summary: Improve SubsitutionVisitor to consider RexCall of type PLUS and TIMES for canonicalization Key: CALCITE-3914 URL: https://issues.apache.org/jira/browse/CALCITE-3914

[jira] [Created] (CALCITE-3862) Rewriting for materialized view consisting of group by on join keys with aggregate fails

2020-03-15 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3862: Summary: Rewriting for materialized view consisting of group by on join keys with aggregate fails Key: CALCITE-3862 URL: https://issues.apache.org/jira/browse/CALCITE-3862

[jira] [Created] (CALCITE-3848) Materialized view rewriting fails for mv consisting of group by on join keys

2020-03-09 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3848: Summary: Materialized view rewriting fails for mv consisting of group by on join keys Key: CALCITE-3848 URL: https://issues.apache.org/jira/browse/CALCITE-3848

[jira] [Created] (CALCITE-3824) JoinProjectTransposeRule should skip Projects containing windowing expression

2020-02-25 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3824: Summary: JoinProjectTransposeRule should skip Projects containing windowing expression Key: CALCITE-3824 URL: https://issues.apache.org/jira/browse/CALCITE-3824

[jira] [Created] (CALCITE-3734) MySQL JDBC rewrite is producing queries with CHAR with range beyond 255

2020-01-14 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3734: Summary: MySQL JDBC rewrite is producing queries with CHAR with range beyond 255 Key: CALCITE-3734 URL: https://issues.apache.org/jira/browse/CALCITE-3734 Project

[jira] [Created] (CALCITE-3733) MySQL JDBC rewrite should rewrite CAST as TIMESTAMP to CAST as DATETIME

2020-01-14 Thread Vineet Garg (Jira)
Vineet Garg created CALCITE-3733: Summary: MySQL JDBC rewrite should rewrite CAST as TIMESTAMP to CAST as DATETIME Key: CALCITE-3733 URL: https://issues.apache.org/jira/browse/CALCITE-3733 Project

[jira] [Created] (CALCITE-3222) Fix code style issues introduced by CALCITE-3031

2019-07-31 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-3222: Summary: Fix code style issues introduced by CALCITE-3031 Key: CALCITE-3222 URL: https://issues.apache.org/jira/browse/CALCITE-3222 Project: Calcite Issue

Re: Modify Calcite Planner in Hive to remove GROUP BY

2019-06-26 Thread Vineet Garg
qldb: > > > select count(*) from "foodmart"."days" where false group by true; > +-+ > | C1| > +-+ > +-+ > No rows selected (0.001 seconds) > > > Julian > > > > On Jun 26, 201

Re: Modify Calcite Planner in Hive to remove GROUP BY

2019-06-26 Thread Vineet Garg
urther fixed by HIVE-21539 <https://issues.apache.org/jira/browse/HIVE-21539>. Regards, Vineet Garg On Wed, Jun 26, 2019 at 7:08 AM Haisheng Yuan wrote: > Calcite has the rule that does the work. But you can't remove the group by > clause if the constant is the only group key. The sem

[jira] [Created] (CALCITE-3132) Simply expressions in LogicalFilter generated for subqueries with quantified predicate

2019-06-17 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-3132: Summary: Simply expressions in LogicalFilter generated for subqueries with quantified predicate Key: CALCITE-3132 URL: https://issues.apache.org/jira/browse/CALCITE-3132

Re: Re: Re: Virtual key signing party

2019-05-02 Thread Vineet Garg
I also converted to wrong time and ended up missing the call. I'll try to join the next one. On Thu, May 2, 2019 at 10:29 AM Haisheng Yuan wrote: > Sorry, I missed the call. Converted to wrong time. Will join next party. > > Thanks ~ > Haisheng Yuan >

Re: Re: Virtual key signing party

2019-05-01 Thread Vineet Garg
Hi, I am only contributor but I would like to join the party. *pub* 4096R/600252AE <http://keys.gnupg.net/pks/lookup?op=get=0x99B92500600252AE> 2018-05-18 Fingerprint=65DA 42EC 10B7 95CB 0888 E545 99B9 2500 6002 52AE *uid* Vinee

[jira] [Created] (CALCITE-3028) Support FULL OUTER JOIN with AggregateJoinTransposeRule

2019-04-27 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-3028: Summary: Support FULL OUTER JOIN with AggregateJoinTransposeRule Key: CALCITE-3028 URL: https://issues.apache.org/jira/browse/CALCITE-3028 Project: Calcite

Re: [ANNOUNCE] New committers: Chunwei Lei

2019-04-27 Thread Vineet Garg
Congratulations Chunwei! On Sat, Apr 27, 2019 at 11:20 AM Kevin Risden wrote: > Congrats and welcome! > > Kevin Risden > > > On Sat, Apr 27, 2019 at 11:36 AM Stamatis Zampetakis > wrote: > > > It's great to have you onboard Chunwei! > > > > I would love to see some those of optimizations land

Re: [ANNOUNCE] New committers: Ruben Quesada Lopez

2019-04-27 Thread Vineet Garg
Congratulations Ruben. On Sat, Apr 27, 2019 at 11:19 AM Kevin Risden wrote: > Congrats and welcome! > > Kevin Risden > > > On Sat, Apr 27, 2019 at 1:48 PM Ruben Q L wrote: > > > Thank you everyone for your kind messages. > > > > Currently I am working with Stamatis in the Core Engine team at

Re: [ANNOUNCE] Stamatis Zampetakis joins Calcite PMC

2019-04-27 Thread Vineet Garg
Congratulations Stamatis! On Fri, Apr 26, 2019 at 7:44 PM Francis Chuang wrote: > I'm pleased to announce that Stamatis has accepted an invitation to > join the Calcite PMC. Stamatis has been a consistent and helpful > figure in the Calcite community for which we are very grateful. We > look

[jira] [Created] (CALCITE-3012) areColumnsUnique for FULL OUTER JOIN could return wrong answer when ignoreNulls is false

2019-04-19 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-3012: Summary: areColumnsUnique for FULL OUTER JOIN could return wrong answer when ignoreNulls is false Key: CALCITE-3012 URL: https://issues.apache.org/jira/browse/CALCITE-3012

[jira] [Created] (CALCITE-3011) Support for outer joins with AggregateJoinTransposeRule

2019-04-17 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-3011: Summary: Support for outer joins with AggregateJoinTransposeRule Key: CALCITE-3011 URL: https://issues.apache.org/jira/browse/CALCITE-3011 Project: Calcite

How to rewrite <>ANY subqueries

2019-04-15 Thread Vineet Garg
OIN, SEMI JOIN or Nested loop join but I don't believe any of them will produce correct semantics. Does anyone know what is the correct rewrite for <>ANY? P.S. Can someone review pull request to fix =ANY rewrite? - #1161 <https://github.com/apache/calcite/pull/1161> Thanks, Vineet Garg

[jira] [Created] (CALCITE-2991) getMaxRowCount should return rowcount 1 for an aggregate with constant keys

2019-04-11 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-2991: Summary: getMaxRowCount should return rowcount 1 for an aggregate with constant keys Key: CALCITE-2991 URL: https://issues.apache.org/jira/browse/CALCITE-2991

[jira] [Created] (CALCITE-2971) Correlated subquery in JOIN is failing

2019-04-01 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-2971: Summary: Correlated subquery in JOIN is failing Key: CALCITE-2971 URL: https://issues.apache.org/jira/browse/CALCITE-2971 Project: Calcite Issue Type: Bug

[jira] [Created] (CALCITE-2954) SubQueryJoinRemoveRule and SubQueryProjectRemoveRule passing on empty set instead of set of correlation id

2019-03-25 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-2954: Summary: SubQueryJoinRemoveRule and SubQueryProjectRemoveRule passing on empty set instead of set of correlation id Key: CALCITE-2954 URL: https://issues.apache.org/jira/browse

[jira] [Created] (CALCITE-2874) NOT IN correlated subquery has un-necessary join

2019-02-25 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-2874: Summary: NOT IN correlated subquery has un-necessary join Key: CALCITE-2874 URL: https://issues.apache.org/jira/browse/CALCITE-2874 Project: Calcite Issue

Re: [GitHub] vineetgarg02 opened a new pull request #1035: [CALCITE-1726] Subquery in FILTER is left untransformed

2019-02-12 Thread Vineet Garg
Hello devs, I’ll really appreciate if someone can take a look at this pull request (https://github.com/apache/calcite/pull/1035) Thanks, Vineet Garg On Feb 7, 2019, at 9:00 PM, GitBox mailto:g...@apache.org>> wrote: vineetgarg02 opened a new pull request #1035: [CALCITE-1726] Su

Re: How to run Quidem test

2019-01-31 Thread Vineet Garg
e > core/target/test-classes/sql/surefire/sql/agg.iq with which you can overwrite > (if you choose) the original script file core/src/test/resources/sql/agg.iq. > > Julian > > >> On Jan 30, 2019, at 5:42 PM, Vineet Garg wrote: >> >> Hello all, >&

How to run Quidem test

2019-01-30 Thread Vineet Garg
Hello all, How do I run a particular (e.g. sql/dummy.iq) test (with debug mode on)? I have run these tests in the past but I can’t seem to recall how did I manage to run it. Thanks, Vineet G

Re: joins and low selectivity optimization

2018-08-30 Thread Vineet Garg
Hive actually does this optimization (it is called semi-join reduction) by generating bloom-filters on one side and passing it on to the other side. This is not a rewrite but instead a physical implementation. Vineet On Aug 29, 2018, at 10:34 AM, Vladimir Sitnikov

Re: [CANCEL] Apache Hive 3.1.0 Release Candidate 0

2018-07-18 Thread Vineet Garg
My bad. Please ignore this. Sorry about that! Vineet > On Jul 18, 2018, at 5:30 PM, Julian Hyde wrote: > > Vineet, I think you meant to send this to dev@hive, not dev@calcite. > > (Can you send a [CANCEL], please!) > > >> On Jul 18, 2018, at 5:25 PM, Vineet Garg

[VOTE] Apache Hive 3.1.0 Release Candidate 0

2018-07-18 Thread Vineet Garg
Apache Hive 3.1.0 Release Candidate 0 is available here: http://people.apache.org/~vgarg/apache-hive-3.1.0-rc-0 Maven artifacts are available here: https://repository.apache.org/content/repositories/orgapachehive-1089/ Source tag: https://github.com/apache/hive/tree/release-3.1.0-rc0 Voting

[jira] [Created] (CALCITE-1726) Subquery in FILTER is left untransformed

2017-03-28 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1726: Summary: Subquery in FILTER is left untransformed Key: CALCITE-1726 URL: https://issues.apache.org/jira/browse/CALCITE-1726 Project: Calcite Issue Type

Re: QuidemTest

2017-02-23 Thread Vineet Garg
> https://calcite.apache.org/testapidocs/org/apache/calcite/test/QuidemTest.html > > [2] > https://calcite.apache.org/testapidocs/org/apache/calcite/test/QuidemTest.html#main-java.lang.String:A- > > On Thu, Feb 23, 2017 at 6:00 PM, Vineet Garg <vg...@hortonworks.com> w

[jira] [Created] (CALCITE-1624) Inefficient plan for NOT IN correlated subqueries

2017-02-08 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1624: Summary: Inefficient plan for NOT IN correlated subqueries Key: CALCITE-1624 URL: https://issues.apache.org/jira/browse/CALCITE-1624 Project: Calcite Issue

[jira] [Created] (CALCITE-1605) Wrong result/plan for correlated subquery with windowing

2017-01-25 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1605: Summary: Wrong result/plan for correlated subquery with windowing Key: CALCITE-1605 URL: https://issues.apache.org/jira/browse/CALCITE-1605 Project: Calcite

[jira] [Created] (CALCITE-1583) Wrong results for query with correlated subqueries with aggregate subquery expression

2017-01-17 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1583: Summary: Wrong results for query with correlated subqueries with aggregate subquery expression Key: CALCITE-1583 URL: https://issues.apache.org/jira/browse/CALCITE-1583

[jira] [Created] (CALCITE-1546) Wrong result/plan for NOT IN subqueries with disjunction

2016-12-19 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1546: Summary: Wrong result/plan for NOT IN subqueries with disjunction Key: CALCITE-1546 URL: https://issues.apache.org/jira/browse/CALCITE-1546 Project: Calcite

[jira] [Created] (CALCITE-1542) Update RelShuttle interface to work on Filter, Join etc instead of Logical rel nodes

2016-12-15 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1542: Summary: Update RelShuttle interface to work on Filter, Join etc instead of Logical rel nodes Key: CALCITE-1542 URL: https://issues.apache.org/jira/browse/CALCITE-1542

[jira] [Created] (CALCITE-1541) Update RelDecorrelator to work on Filter, Join, Project etc

2016-12-15 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1541: Summary: Update RelDecorrelator to work on Filter, Join, Project etc Key: CALCITE-1541 URL: https://issues.apache.org/jira/browse/CALCITE-1541 Project: Calcite

Re: RelDecorrelator on Logical operators

2016-12-15 Thread Vineet Garg
so only running on >logical rels was never a hardship. Also, very few physical algebras even >support correlation, so RelDecorrelator would be a no-op on these. > >Please log a JIRA case. > >Julian > > > > >> On Dec 15, 2016, at 9:33 AM, Vineet Garg <vg...

RelDecorrelator on Logical operators

2016-12-15 Thread Vineet Garg
Hi Julian, Reldecorrelator’s logic including all rules implemented within it are written to take LogicalJoin, LogicalFilter, LogicalProject etc. Since Logical operators are final that makes extending RelDecorrelator very difficult. Is there any reason why RelDecorrelator is written in this

[jira] [Created] (CALCITE-1537) Un-necessary project expression in multi-subquery plan

2016-12-12 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1537: Summary: Un-necessary project expression in multi-subquery plan Key: CALCITE-1537 URL: https://issues.apache.org/jira/browse/CALCITE-1537 Project: Calcite

Re: Calcite daily snapshots

2016-12-07 Thread Vineet Garg
l.com> wrote: > >> Also for Storm. I also would like to see the chance to have 1.11.0. Does >> Calcite have a milestone or TODO issues for 1.11.0? >> >> Thanks in advance, >> Jungtaek Lim (HeartSaVioR) >> >> 2016년 12월 7일 (수) 오전 10:35, Vineet Garg <vg

Calcite daily snapshots

2016-12-06 Thread Vineet Garg
Hello Julian/Jesus, We would like to test Calcite’s latest snapshot (nightly builds) against HIVE. I tried searching on apache repository but I only see releases until 1.10. Does Calcite build and publish daily snapshots ? If not is it possible to do so ? Thanks, Vineet Garg

[jira] [Created] (CALCITE-1511) RelDecorrelator's allLessThan failing for NOT EXISTS subquery

2016-11-28 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1511: Summary: RelDecorrelator's allLessThan failing for NOT EXISTS subquery Key: CALCITE-1511 URL: https://issues.apache.org/jira/browse/CALCITE-1511 Project: Calcite

[jira] [Created] (CALCITE-1495) Add a rule to convert INNER JOIN preceded by GROUP BY to appropriate SEMI-JOIN

2016-11-15 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1495: Summary: Add a rule to convert INNER JOIN preceded by GROUP BY to appropriate SEMI-JOIN Key: CALCITE-1495 URL: https://issues.apache.org/jira/browse/CALCITE-1495

[jira] [Created] (CALCITE-1494) Inefficient plan for co-related subqueries

2016-11-15 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1494: Summary: Inefficient plan for co-related subqueries Key: CALCITE-1494 URL: https://issues.apache.org/jira/browse/CALCITE-1494 Project: Calcite Issue Type

[jira] [Created] (CALCITE-1493) Wrong plan for NOT IN correlated queries

2016-11-15 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1493: Summary: Wrong plan for NOT IN correlated queries Key: CALCITE-1493 URL: https://issues.apache.org/jira/browse/CALCITE-1493 Project: Calcite Issue Type: Bug

Re: Problems with abstract syntax tree

2016-11-07 Thread Vineet Garg
I logged in jira CALCITE-1483 for the query in question. I’ll try to find more examples. On 11/7/16, 9:17 PM, "Vineet Garg" <vg...@hortonworks.com> wrote: >Hi Julian, > >Apologies for not responding earlier. > >I understand that planner rules sometime prod

[jira] [Created] (CALCITE-1483) Suboptimal plan for NOT IN query

2016-11-07 Thread Vineet Garg (JIRA)
Vineet Garg created CALCITE-1483: Summary: Suboptimal plan for NOT IN query Key: CALCITE-1483 URL: https://issues.apache.org/jira/browse/CALCITE-1483 Project: Calcite Issue Type: Bug

Re: Problems with abstract syntax tree

2016-10-31 Thread Vineet Garg
Hi Julian, During my work on subquery support in Hive I am running into similar issue with almost same query where the CASE statement [NOT(CASE(=($1, 0), false, IS NOT NULL($5), true, IS NULL($3), null, <($2, $1), null, false))] is generated with a null constant expression but with NULL type.

Re: Subquery de-correlation

2016-09-28 Thread Vineet Garg
Never mind I figured it out by looking at Calcite tests :) On 9/22/16, 9:26 PM, "Vineet Garg" <vg...@hortonworks.com> wrote: >Hi Julian, > >Thank you for your response. I have few follow-up questions: > >Yes. Remember it should return only the correlating

Subquery de-correlation

2016-09-21 Thread Vineet Garg
Hello Julian/Calcite community, I am working on adding subquery support in HIVE using calcite. From what I have read/understood so far Calcite requires HIVE to create RexSubqueryNode corresponding to a subquery and then call SubQueryRemoveRule to get rid of RexSubqueryNode and change it to