Hyukjin Kwon created SPARK-39524:
------------------------------------

             Summary: GeneratorFunctionSuite fails with Scala 2.13
                 Key: SPARK-39524
                 URL: https://issues.apache.org/jira/browse/SPARK-39524
             Project: Spark
          Issue Type: Sub-task
          Components: SQL
    Affects Versions: 3.4.0
            Reporter: Hyukjin Kwon


https://github.com/apache/spark/runs/6912247429?check_suite_focus=true

{code}
2022-06-16T05:24:22.6921792Z [info] - SPARK-39061: 
inline should handle null struct *** FAILED *** (13 milliseconds)
2022-06-16T05:24:22.6927134Z [info]   
java.lang.RuntimeException: Once strategy's idempotence is broken for batch 
Infer Filters
2022-06-16T05:24:22.6928785Z [info]  Generate 
inline(b#88491), [0], false, [c1#88494, c2#88495]     Generate inline(b#88491), 
[0], false, [c1#88494, c2#88495]
2022-06-16T05:24:22.6929841Z [info] !+- Filter 
((size(b#88491, true) > 0) AND isnotnull(b#88491))   +- Filter 
isnotnull(b#88491)
2022-06-16T05:24:22.6930910Z [info] !   +- Project 
[b#88491]                                           +- Filter ((size(b#88491, 
true) > 0) AND isnotnull(b#88491))
2022-06-16T05:24:22.6931886Z [info] !      +- 
LocalRelation [a#88490, b#88491]                            +- Project 
[b#88491]
2022-06-16T05:24:22.6932893Z [info] !              
                                                          +- LocalRelation 
[a#88490, b#88491]
2022-06-16T05:24:22.6934261Z [info]   at 
org.apache.spark.sql.errors.QueryExecutionErrors$.onceStrategyIdempotenceIsBrokenForBatchError(QueryExecutionErrors.scala:1307)
2022-06-16T05:24:22.6935812Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.checkBatchIdempotence(RuleExecutor.scala:168)
2022-06-16T05:24:22.6937200Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1(RuleExecutor.scala:254)
2022-06-16T05:24:22.6938589Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$execute$1$adapted(RuleExecutor.scala:200)
2022-06-16T05:24:22.6939783Z [info]   at 
scala.collection.immutable.List.foreach(List.scala:333)
2022-06-16T05:24:22.6941076Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.execute(RuleExecutor.scala:200)
2022-06-16T05:24:22.6942350Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.$anonfun$executeAndTrack$1(RuleExecutor.scala:179)
2022-06-16T05:24:22.6943591Z [info]   at 
org.apache.spark.sql.catalyst.QueryPlanningTracker$.withTracker(QueryPlanningTracker.scala:88)
2022-06-16T05:24:22.6944894Z [info]   at 
org.apache.spark.sql.catalyst.rules.RuleExecutor.executeAndTrack(RuleExecutor.scala:179)
2022-06-16T05:24:22.6946076Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.$anonfun$optimizedPlan$1(QueryExecution.scala:126)
2022-06-16T05:24:22.6947361Z [info]   at 
org.apache.spark.sql.catalyst.QueryPlanningTracker.measurePhase(QueryPlanningTracker.scala:111)
2022-06-16T05:24:22.6948629Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$2(QueryExecution.scala:185)
2022-06-16T05:24:22.6950591Z [info]   at 
org.apache.spark.sql.execution.QueryExecution$.withInternalError(QueryExecution.scala:512)
2022-06-16T05:24:22.6951638Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.$anonfun$executePhase$1(QueryExecution.scala:185)
2022-06-16T05:24:22.6952587Z [info]   at 
org.apache.spark.sql.SparkSession.withActive(SparkSession.scala:779)
2022-06-16T05:24:22.6953562Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.executePhase(QueryExecution.scala:184)
2022-06-16T05:24:22.6954950Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.optimizedPlan$lzycompute(QueryExecution.scala:122)
2022-06-16T05:24:22.6956189Z [info]   at 
org.apache.spark.sql.execution.QueryExecution.optimizedPlan(QueryExecution.scala:118)
2022-06-16T05:24:22.6957362Z [info]   at 
org.apache.spark.sql.QueryTest.assertEmptyMissingInput(QueryTest.scala:226)
2022-06-16T05:24:22.6958973Z [info]   at 
org.apache.spark.sql.QueryTest.checkAnswer(QueryTest.scala:148)
{code}



--
This message was sent by Atlassian Jira
(v8.20.7#820007)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to