[ https://issues.apache.org/jira/browse/SPARK-24653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16523916#comment-16523916 ]
Apache Spark commented on SPARK-24653: -------------------------------------- User 'vanzin' has created a pull request for this issue: https://github.com/apache/spark/pull/21639 > Flaky test "JoinSuite.test SortMergeJoin (with spill)" > ------------------------------------------------------ > > Key: SPARK-24653 > URL: https://issues.apache.org/jira/browse/SPARK-24653 > Project: Spark > Issue Type: Bug > Components: Tests > Affects Versions: 2.4.0 > Reporter: Marcelo Vanzin > Priority: Minor > > We've run into failures in this test in our internal jobs a few times. They > look like this: > {noformat} > java.lang.AssertionError: assertion failed: expected full outer join to not > spill, but did > at scala.Predef$.assert(Predef.scala:170) > at org.apache.spark.TestUtils$.assertNotSpilled(TestUtils.scala:189) > at > org.apache.spark.sql.JoinSuite$$anonfun$23$$anonfun$apply$mcV$sp$16.apply$mcV$sp(JoinSuite.scala:734) > at > org.apache.spark.sql.test.SQLTestUtils$class.withSQLConf(SQLTestUtils.scala:108) > {noformat} > I looked on the riselab jenkins and couldn't find a failure, so filing with a > low priority. > I did notice a possible race in the code that could explain the failure. Will > send a PR. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org