Github user srowen commented on a diff in the pull request:
https://github.com/apache/spark/pull/22063#discussion_r209127367
--- Diff:
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/ScalaUDF.scala
---
@@ -39,6 +39,7 @@ import org.apache.spark.sql.types.DataType
* @param nullable True if the UDF can return null value.
* @param udfDeterministic True if the UDF is deterministic.
Deterministic UDF returns same result
* each time it is invoked with a particular
input.
+ * @param nullableTypes which of the inputTypes are nullable (i.e. not
primitive)
--- End diff --
The approach here is to capture at registration time whether the arg types
are primitive, or nullable. Not a great way to record this, but might be the
least hack for now
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
