Irakli Machabeli created SPARK-12095:
----------------------------------------
Summary: Window function rowsBetween throws exception
Key: SPARK-12095
URL: https://issues.apache.org/jira/browse/SPARK-12095
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 1.5.1
Reporter: Irakli Machabeli
>From pyspark :
windowSpec=Window.partitionBy('A', 'B').orderBy('A','B',
'C').rowsBetween('UNBOUNDED PRECEDING','CURRENT')
Py4JError: An error occurred while calling o1107.rowsBetween. Trace:
py4j.Py4JException: Method rowsBetween([class java.lang.String, class
java.lang.Long]) does not exist
from SQL query parser fails immediately:
Py4JJavaError: An error occurred while calling o18.sql.
: java.lang.RuntimeException: [1.20] failure: ``union'' expected but `(' found
select rank() OVER (PARTITION BY c1 ORDER BY c2 ) as rank from tbl
^
at scala.sys.package$.error(package.scala:27)
at
org.apache.spark.sql.catalyst.AbstractSparkSQLParser.parse(AbstractSparkSQLParser.scala:36)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]