[
https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-8159:
-------------------------------
Description:
This is an umbrella ticket to track new expressions we are adding to
SQL/DataFrame.
For each new expression, we should:
1. Add a new Expression implementation in
org.apache.spark.sql.catalyst.expressions
2. If applicable, implement the code generated version (by implementing
genCode).
3. Add comprehensive unit tests (for all the data types the expressions
support).
4. If applicable, add a new function for DataFrame in
org.apache.spark.sql.functions, and python/pyspark/sql/functions.py for Python.
For date/time functions, put them in expressions/datetime.scala, and create a
DateTimeFunctionSuite.scala for testing.
was:
This is an umbrella ticket to track new expressions we are adding to
SQL/DataFrame. For each new expression, we should implement the code generated
version as well as comprehensive unit tests (for all the data types the
expressions support).
For date/time functions, put them in expressions/datetime.scala, and create a
DateTimeFunctionSuite.scala for testing.
> Improve expression coverage
> ---------------------------
>
> Key: SPARK-8159
> URL: https://issues.apache.org/jira/browse/SPARK-8159
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Reynold Xin
>
> This is an umbrella ticket to track new expressions we are adding to
> SQL/DataFrame.
> For each new expression, we should:
> 1. Add a new Expression implementation in
> org.apache.spark.sql.catalyst.expressions
> 2. If applicable, implement the code generated version (by implementing
> genCode).
> 3. Add comprehensive unit tests (for all the data types the expressions
> support).
> 4. If applicable, add a new function for DataFrame in
> org.apache.spark.sql.functions, and python/pyspark/sql/functions.py for
> Python.
> For date/time functions, put them in expressions/datetime.scala, and create a
> DateTimeFunctionSuite.scala for testing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
