[
https://issues.apache.org/jira/browse/SPARK-19072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kay Ousterhout updated SPARK-19072:
-----------------------------------
Description:
This bug was caused by the fix for SPARK-18999
(https://github.com/apache/spark/pull/16402)
This can be reproduced by adding the following test to PredicateSuite.scala
(which will consistently fail):
val value = NonFoldableLiteral(Double.PositiveInfinity, DoubleType)
checkEvaluation(In(value, List(value)), true)
This bug is causing org.apache.spark.sql.catalyst.expressions.PredicateSuite.IN
to fail approximately 10% of the time (it fails anytime the value is Infinity
or -Infinity and the correct answer is True -- e.g.,
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70826/testReport/org.apache.spark.sql.catalyst.expressions/PredicateSuite/IN/,
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70830/console).
was:
This can be reproduced by adding the following test to PredicateSuite.scala
(which will consistently fail):
val value = NonFoldableLiteral(Double.PositiveInfinity, DoubleType)
checkEvaluation(In(value, List(value)), true)
This bug is causing org.apache.spark.sql.catalyst.expressions.PredicateSuite.IN
to fail approximately 10% of the time (it fails anytime the value is Infinity
or -Infinity and the correct answer is True -- e.g.,
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70826/testReport/org.apache.spark.sql.catalyst.expressions/PredicateSuite/IN/,
https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70830/console).
> Catalyst's IN always returns false for infinity
> -----------------------------------------------
>
> Key: SPARK-19072
> URL: https://issues.apache.org/jira/browse/SPARK-19072
> Project: Spark
> Issue Type: Bug
> Components: SQL, Tests
> Reporter: Kay Ousterhout
>
> This bug was caused by the fix for SPARK-18999
> (https://github.com/apache/spark/pull/16402)
> This can be reproduced by adding the following test to PredicateSuite.scala
> (which will consistently fail):
> val value = NonFoldableLiteral(Double.PositiveInfinity, DoubleType)
> checkEvaluation(In(value, List(value)), true)
> This bug is causing
> org.apache.spark.sql.catalyst.expressions.PredicateSuite.IN to fail
> approximately 10% of the time (it fails anytime the value is Infinity or
> -Infinity and the correct answer is True -- e.g.,
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70826/testReport/org.apache.spark.sql.catalyst.expressions/PredicateSuite/IN/,
>
> https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/70830/console).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
