Sophie created CALCITE-5376:
-------------------------------
Summary: Support Spark’s FIRST and LAST functions
Key: CALCITE-5376
URL: https://issues.apache.org/jira/browse/CALCITE-5376
Project: Calcite
Issue Type: Task
Reporter: Sophie
Following on from the mailing list thread -
[https://lists.apache.org/thread/3rk8zo5r38c6gpj7j0oy0453cxwlmnm7]
Spark has the following function definition for FIRST and LAST
[https://spark.apache.org/docs/3.0.1/api/sql/index.html#first]
[https://spark.apache.org/docs/3.0.1/api/sql/index.html#last]
At the moment trying to use these functions with a query like
{code:java}
select first(age) from customers{code}
gives an error along the lines of
{code:java}
Function 'FIRST(`customers`.`age`, 0)' can only be used in MATCH_RECOGNIZE{code}
In terms of testing, I can reproduce the error using BabelQuidemTest and
setting up a case for spark.
Given that Spark’s first function is very similar to the FIRST_VALUE function,
I think SqlFirstLastValueAggFunction is probably a useful starting point, but
some pointers about where to look would be helpful. Particularly around
potential parser changes.
Thanks in advance
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
