Tobi Bosede commented on SPARK-10915:

It is complicated to implement a UDAF in python? If you read the email thread 
at the link, you will see people are interested in using a UDAF in sql 
statements as well as spark sql methods. In my case I wanted to do a pivot and 
have a UDAF for inter-quartile (IQR) range applied. Do you think 
df.rdd.reduceByKey would make sense here?

> Add support for UDAFs in Python
> -------------------------------
>                 Key: SPARK-10915
>                 URL: https://issues.apache.org/jira/browse/SPARK-10915
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark, SQL
>            Reporter: Justin Uang
> This should support python defined lambdas.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to