Yin Huai created SPARK-8572:
-------------------------------
Summary: Type coercion for ScalaUDFs
Key: SPARK-8572
URL: https://issues.apache.org/jira/browse/SPARK-8572
Project: Spark
Issue Type: Bug
Components: SQL
Reporter: Yin Huai
Priority: Critical
Seems we do not do type coercion for ScalaUDFs. The following code will hit a
runtime exception.
{code}
import org.apache.spark.sql.functions._
val myUDF = udf((x: Int) => x + 1)
val df = sqlContext.range(1, 10).toDF("i").select(myUDF($"i"))
df.explain(true)
df.show
{code}
It is also good to check if we do type coercion for PythonUDFs.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
