Re: Spark SQL parser and DDL

2018-10-07 Thread Felix Cheung
Sounds like a good idea? Would this be a step in the direction of supporting variation of the SQL dialect, too? From: Ryan Blue Sent: Thursday, October 4, 2018 8:56 AM To: Spark Dev List Subject: Spark SQL parser and DDL Hi everyone, I’ve been working on

Spark SQL parser and DDL

2018-10-04 Thread Ryan Blue
Hi everyone, I’ve been working on SQL DDL statements for v2 tables lately, including the proposed additions to drop, rename, and alter columns. The most recent update I’ve added is to allow transformation functions in the PARTITION BY clause to pass to v2 data sources. This allows sources like Ice