[
https://issues.apache.org/jira/browse/SPARK-8159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14612725#comment-14612725
]
Yu Ishikawa commented on SPARK-8159:
------------------------------------
[~rxin] How should we deal with the {{pyspark}} and {{SparkR}} versions?
- Make another umblella issues for {{pyspark}} and {{SparkR}}
- Make sub issues in each these issues
- Reopen each issues for {{pyspark}} and {{SparkR}}
And which ones should we support in {{pyspark}} and {{SparkR}}? All?
> Improve SQL/DataFrame expression coverage
> -----------------------------------------
>
> Key: SPARK-8159
> URL: https://issues.apache.org/jira/browse/SPARK-8159
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Reynold Xin
>
> This is an umbrella ticket to track new expressions we are adding to
> SQL/DataFrame.
> For each new expression, we should:
> 1. Add a new Expression implementation in
> org.apache.spark.sql.catalyst.expressions
> 2. If applicable, implement the code generated version (by implementing
> genCode).
> 3. Add comprehensive unit tests (for all the data types the expressions
> support).
> 4. If applicable, add a new function for DataFrame in
> org.apache.spark.sql.functions, and python/pyspark/sql/functions.py for
> Python.
> For date/time functions, put them in expressions/datetime.scala, and create a
> DateTimeFunctionSuite.scala for testing.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
