Re: Hive SQL extension

2020-11-02 Thread Peter Vary
Hi Jesus, Stamatis Thanks for taking the time and answering my questions! Here is some info I have started from: Iceberg partitioning is defined here: https://iceberg.apache.org/spec/#partitioning Other examples for SQL extension proposal from

Re: Hive SQL extension

2020-10-27 Thread Jesus Camacho Rodriguez
Hi Peter, Thanks for bringing this up. Why are targeting the 'partition by spec' syntax? Is it for convenience? Was it already introduced by Iceberg? I did not understand the reasoning for not introducing the new syntax in Hive. As it was already mentioned by Stamatis, there is some advantage

Re: Hive SQL extension

2020-10-26 Thread Stamatis Zampetakis
I do like extensions and things that simplify our life when writing queries. Regarding the partitioning syntax for Iceberg, there may be better alternatives. I was also leaning towards a syntax like the one proposed by Jesus (in another thread) based on virtual columns, which is also part of SQL

Re: Hive SQL extension

2020-10-23 Thread Pau Tallada
Hi all, I do not know if that may be of interest to you, but there are other projects that could benefit from this. For instance, ADQL (Astronomical Data Query Language) is a SQL-like language that defines some higher-level

Re: Hive SQL extension

2020-10-22 Thread Peter Vary
Let's assume that this feature would be useful for Iceberg tables, but useless and even problematic/forbidden for other tables. :) My thinking is, that it could make Hive much more user friendly, if we would allow for extensions in language. With Iceberg integration we plan to do several

Re: Hive SQL extension

2020-10-22 Thread Stamatis Zampetakis
Hi Peter, I am nowhere near being an expert but just wanted to share my thoughts. If I understand correctly you would like some syntactic sugar in Hive to support partitioning as per Iceberg. I cannot tell if that's really useful or not but from my point of view it doesn't seem a very good idea

Hive SQL extension

2020-10-22 Thread Peter Vary
Hi Hive experts, I would like to extend Hive SQL language to provide a way to create Iceberg partitioned tables like this: create table iceberg_test( level string, event_time timestamp, message string, register_time date, telephone array )