Using Spark and Calcite to find the column lineage and rewrite spark queries

2020-10-15 Thread Bar David, Shachar
Hello, I'm using Calcite to: 1. Extract the column lineage of a Spark SQL query 2. Rewrite SQL queries, specifically select statements to one or more merge statements I was able to accomplish 1 and some of 2 however, currently I'm using the file adapter and some CSV files given that I was

[jira] [Created] (CALCITE-4342) More aggregate functions should be marked as splittable and duplicate-insensitive

2020-10-15 Thread Liya Fan (Jira)
Liya Fan created CALCITE-4342: - Summary: More aggregate functions should be marked as splittable and duplicate-insensitive Key: CALCITE-4342 URL: https://issues.apache.org/jira/browse/CALCITE-4342 Project

Re: [DISCUSS] Apache Calcite Online Meetup January 2021

2020-10-15 Thread Chunwei Lei
It would be great! I am glad to attend such a meetup. Best, Chunwei On Fri, Oct 16, 2020 at 12:50 PM Julian Hyde wrote: > Nice idea, Stamatis. I'm happy to give a talk if people want to hear > it - possible topics include geospatial in Calcite, quick intro to > RelBuilder, and lattices/materi

Re: [DISCUSS] Apache Calcite Online Meetup January 2021

2020-10-15 Thread Julian Hyde
Nice idea, Stamatis. I'm happy to give a talk if people want to hear it - possible topics include geospatial in Calcite, quick intro to RelBuilder, and lattices/materialized views. On Thu, Oct 15, 2020 at 10:35 AM Rui Wang wrote: > > I can give a small talk (10 to 20 mins) about changes of Calcit

Re: why DECIMAL is in SqlTypeName#EXACT_TYPES but DOUBLE is in SqlTypeName#APPROX_TYPES

2020-10-15 Thread JiaTao Tao
Thanks, Alessandro Solimando Got it, very clear explanation. My main question here becomes that calcite doesn't support double mod. Regards! Aron Tao Alessandro Solimando 于2020年10月15日周四 下午10:32写道: > Hi Aron Tao, > Calcite adheres to SQL standard in that respect (citing): > > The data types NU

[jira] [Created] (CALCITE-4341) Calcite support double/float mode

2020-10-15 Thread Jiatao Tao (Jira)
Jiatao Tao created CALCITE-4341: --- Summary: Calcite support double/float mode Key: CALCITE-4341 URL: https://issues.apache.org/jira/browse/CALCITE-4341 Project: Calcite Issue Type: Improvement

[jira] [Created] (CALCITE-4340) Correlated Queries in ON clause do not work when referring to left side

2020-10-15 Thread James Starr (Jira)
James Starr created CALCITE-4340: Summary: Correlated Queries in ON clause do not work when referring to left side Key: CALCITE-4340 URL: https://issues.apache.org/jira/browse/CALCITE-4340 Project: Ca

Re: [DISCUSS] Apache Calcite Online Meetup January 2021

2020-10-15 Thread Rui Wang
I can give a small talk (10 to 20 mins) about changes of Calcite to support streaming. -Rui On Thu, Oct 15, 2020 at 7:19 AM Alessandro Solimando < alessandro.solima...@gmail.com> wrote: > Hi Stamatis, > that's a very nice idea, I am definitely interested in attending a meetup > and hearing pres

Re: why DECIMAL is in SqlTypeName#EXACT_TYPES but DOUBLE is in SqlTypeName#APPROX_TYPES

2020-10-15 Thread Alessandro Solimando
Hi Aron Tao, Calcite adheres to SQL standard in that respect (citing): The data types NUMERIC, DECIMAL, INTEGER and SMALLINT are collectively > referred to > as exact numeric types. The data types FLOAT, REAL, and DOUBLE PRECISION are collectively referred > to as approx- > imate numeric types.

Re: [DISCUSS] Apache Calcite Online Meetup January 2021

2020-10-15 Thread Alessandro Solimando
Hi Stamatis, that's a very nice idea, I am definitely interested in attending a meetup and hearing presentations around Calcite. Best regards, Alessandro On Thu, 15 Oct 2020 at 15:09, Stamatis Zampetakis wrote: > Hi guys, > > How do you feel about participating in an online meetup for Calcite i

Re: why DECIMAL is in SqlTypeName#EXACT_TYPES but DOUBLE is in SqlTypeName#APPROX_TYPES

2020-10-15 Thread JiaTao Tao
In calcite, you can not mod doubles. In Java, you can, in C you can't use "%" to mod doubles, but you can use fmod. Regards! Aron Tao JiaTao Tao 于2020年10月15日周四 下午10:00写道: > org.apache.calcite.sql.type.SqlTypeName#APPROX_TYPES > org.apache.calcite.sql.type.SqlTypeName#NUMERIC_TYPES > > Regards

why DECIMAL is in SqlTypeName#EXACT_TYPES but DOUBLE is in SqlTypeName#APPROX_TYPES

2020-10-15 Thread JiaTao Tao
org.apache.calcite.sql.type.SqlTypeName#APPROX_TYPES org.apache.calcite.sql.type.SqlTypeName#NUMERIC_TYPES Regards! Aron Tao

[DISCUSS] Apache Calcite Online Meetup January 2021

2020-10-15 Thread Stamatis Zampetakis
Hi guys, How do you feel about participating in an online meetup for Calcite in January 2021? It's been forever since we organised a Calcite meetup and with the current situation (pandemic) it will be almost impossible to hold one in person in the near future. Nevertheless, people now more than

[jira] [Created] (CALCITE-4339) Update Gradle: 6.6 -> 6.7

2020-10-15 Thread Vladimir Sitnikov (Jira)
Vladimir Sitnikov created CALCITE-4339: -- Summary: Update Gradle: 6.6 -> 6.7 Key: CALCITE-4339 URL: https://issues.apache.org/jira/browse/CALCITE-4339 Project: Calcite Issue Type: Improve