[
https://issues.apache.org/jira/browse/SPARK-41219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17637587#comment-17637587
]
Raza Jafri commented on SPARK-41219:
------------------------------------
Thank you for looking into this issue. I have also noticed that the
`IntegralDivide` has the output dataType = LongType, so why is it also
overriding the `resultDecimalType`??
It will never be called AFAIK, it's only called from `dataType` in
`BinaryArithmetic`
> Regression in IntegralDivide returning null instead of 0
> --------------------------------------------------------
>
> Key: SPARK-41219
> URL: https://issues.apache.org/jira/browse/SPARK-41219
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Raza Jafri
> Priority: Major
>
> There seems to be a regression in Spark 3.4 Integral Divide
>
> {code:java}
> scala> val df = Seq("0.5944910","0.3314242").toDF("a")
> df: org.apache.spark.sql.DataFrame = [a: string]
> scala> df.selectExpr("cast(a as decimal(7,7)) div 100").show
> +---------------------------------+
> |(CAST(a AS DECIMAL(7,7)) div 100)|
> +---------------------------------+
> | null|
> | null|
> +---------------------------------+
> {code}
>
> While in Spark 3.3.0
> {code:java}
> scala> val df = Seq("0.5944910","0.3314242").toDF("a")
> df: org.apache.spark.sql.DataFrame = [a: string]
> scala> df.selectExpr("cast(a as decimal(7,7)) div 100").show
> +---------------------------------+
> |(CAST(a AS DECIMAL(7,7)) div 100)|
> +---------------------------------+
> | 0|
> | 0|
> +---------------------------------+
> {code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
