[
https://issues.apache.org/jira/browse/SPARK-3947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15013886#comment-15013886
]
Milad Bourhani commented on SPARK-3947:
---------------------------------------
I managed to run your code against both 1.5.2 and 1.5.0:
- works fine on 1.5.2
- differs on 1.5.0, where using a cluster the following result is computed:
{noformat}
+-------------+------------+----+--------------------+--------------------+
|store_country|store_region| _c2| _c3| _c4|
+-------------+------------+----+--------------------+--------------------+
| italy| emilia|87.5|175.0000000000000...|6.18028512604618E...|
| italy| toscana|50.5|50.50000000000000...| 50.5|
| italy| puglia| 70|70.00000000000000...| 70.0|
+-------------+------------+----+--------------------+--------------------+
{noformat}
> Support Scala/Java UDAF
> -----------------------
>
> Key: SPARK-3947
> URL: https://issues.apache.org/jira/browse/SPARK-3947
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Pei-Lun Lee
> Assignee: Yin Huai
> Fix For: 1.5.0
>
> Attachments: spark-udaf.zip
>
>
> Right now only Hive UDAFs are supported. It would be nice to have UDAF
> similar to UDF through SQLContext.registerFunction.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
