Hello all, Spark 2.4.0 was released last month. I noticed that Spark sql in Spark 2.4 adds a lot of higher-order functions, to deal with complex data types easier[1]. For example, SQL statement like "SELECT TRANSFORM(values, element -> element + 1) FROM iteblog;"[2] returns an array that is the result of applying function to each element of array. I wonder if it is possible for Calcite to enhance it's parser to support higher-order functions. Thus, projects powered by Calcite such as Flink can benefit from it.
Look forward to your feedback. Best, Wen-hui Tang [1] https://issues.apache.org/jira/browse/SPARK-23899 [2] https://issues.apache.org/jira/browse/SPARK-23908 [email protected]
