[
https://issues.apache.org/jira/browse/SPARK-25044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25044:
------------------------------
Description:
A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891 Fix
HandleNullInputsForUDF rule". (Details in a sec when I can copy-paste them.)
It seems that the closure that is fed in as a UDF changes behavior, in a way
that primitive-type arguments are handled differently. For example an Int
argument, when fed 'null', acts like 0.
I'm sure it's a difference in the LMF closure and how its types are understood,
but not exactly sure of the cause yet.
> Address translation of LMF closure primitive args to Object in Scala 2.12
> -------------------------------------------------------------------------
>
> Key: SPARK-25044
> URL: https://issues.apache.org/jira/browse/SPARK-25044
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core, SQL
> Affects Versions: 2.4.0
> Reporter: Sean Owen
> Priority: Major
>
> A few SQL-related tests fail in Scala 2.12, such as UDFSuite's "SPARK-24891
> Fix HandleNullInputsForUDF rule". (Details in a sec when I can copy-paste
> them.)
> It seems that the closure that is fed in as a UDF changes behavior, in a way
> that primitive-type arguments are handled differently. For example an Int
> argument, when fed 'null', acts like 0.
> I'm sure it's a difference in the LMF closure and how its types are
> understood, but not exactly sure of the cause yet.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
