[
https://issues.apache.org/jira/browse/SPARK-39525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17556429#comment-17556429
]
Bruce Robbins commented on SPARK-39525:
---------------------------------------
Just like the GeneratorFunctionSuites issue, when I apply the propose fix for
SPARK-39520 ([this PR|https://github.com/apache/spark/pull/36925]), the issue
resolves on my laptop.
> AdaptiveQueryExecSuite fails with Scala 2.13
> --------------------------------------------
>
> Key: SPARK-39525
> URL: https://issues.apache.org/jira/browse/SPARK-39525
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 3.4.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> https://github.com/apache/spark/runs/6912247429?check_suite_focus=true
> {code}
> 2022-06-16T05:29:18.0189547Z [0m[[0m[0minfo[0m] [0m[0m[31m-
> SPARK-36020: Check logical link in remove redundant projects *** FAILED ***
> (33 milliseconds)[0m[0m
> 2022-06-16T05:29:18.0663300Z [0m[[0m[0minfo[0m] [0m[0m[31m
> java.lang.RuntimeException: Once strategy's idempotence is broken for batch
> Infer Filters[0m[0m
> 2022-06-16T05:29:18.0665308Z [0m[[0m[0minfo[0m] [0m[0m[31m Project
> [key#126270L, c#126279L, key#126280L, c#126291L]
> Project [key#126270L, c#126279L,
> key#126280L, c#126291L][0m[0m
> 2022-06-16T05:29:18.0666871Z [0m[[0m[0minfo[0m] [0m[0m[31m +- Join
> Inner, (key#126270L = key#126280L)
> +- Join Inner, (key#126270L =
> key#126280L)[0m[0m
> 2022-06-16T05:29:18.0668143Z [0m[[0m[0minfo[0m] [0m[0m[31m :-
> Filter isnotnull(key#126270L)
> :- Filter
> isnotnull(key#126270L)[0m[0m
> 2022-06-16T05:29:18.0669257Z [0m[[0m[0minfo[0m] [0m[0m[31m : +-
> Project [c#126279L, key#126270L]
> : +- Project [c#126279L,
> key#126270L][0m[0m
> 2022-06-16T05:29:18.0670509Z [0m[[0m[0minfo[0m] [0m[0m[31m : +-
> Generate explode(c#126273), [1], false, [c#126279L]
> : +- Generate
> explode(c#126273), [1], false, [c#126279L][0m[0m
> 2022-06-16T05:29:18.0671748Z [0m[[0m[0minfo[0m] [0m[0m[31m! :
> +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))
> : +- Filter
> isnotnull(c#126273)[0m[0m
> 2022-06-16T05:29:18.0673102Z [0m[[0m[0minfo[0m] [0m[0m[31m! :
> +- Project [(id#126268L % 10) AS key#126270L, array(id#126268L,
> (id#126268L + 1), (id#126268L + 3)) AS c#126273] : +- Filter
> ((size(c#126273, true) > 0) AND isnotnull(c#126273))[0m[0m
> 2022-06-16T05:29:18.0674808Z [0m[[0m[0minfo[0m] [0m[0m[31m! :
> +- Filter (cast((id#126268L * 2) as int) > 1)
> : +- Project
> [(id#126268L % 10) AS key#126270L, array(id#126268L, (id#126268L + 1),
> (id#126268L + 3)) AS c#126273][0m[0m
> 2022-06-16T05:29:18.0676143Z [0m[[0m[0minfo[0m] [0m[0m[31m! :
> +- Range (0, 10, step=1, splits=Some(2))
> : +- Filter
> (cast((id#126268L * 2) as int) > 1)[0m[0m
> 2022-06-16T05:29:18.0677658Z [0m[[0m[0minfo[0m] [0m[0m[31m! +-
> Filter isnotnull(key#126280L)
> : +-
> Range (0, 10, step=1, splits=Some(2))[0m[0m
> 2022-06-16T05:29:18.0678838Z [0m[[0m[0minfo[0m] [0m[0m[31m! +-
> Project [c#126291L, key#126270L AS key#126280L]
> +- Filter
> isnotnull(key#126280L)[0m[0m
> 2022-06-16T05:29:18.0680092Z [0m[[0m[0minfo[0m] [0m[0m[31m! +-
> Generate explode(c#126273), [1], false, [c#126291L]
> +- Project [c#126291L,
> key#126270L AS key#126280L][0m[0m
> 2022-06-16T05:29:18.0681365Z [0m[[0m[0minfo[0m] [0m[0m[31m!
> +- Filter ((size(c#126273, true) > 0) AND isnotnull(c#126273))
> +- Generate
> explode(c#126273), [1], false, [c#126291L][0m[0m
> 2022-06-16T05:29:18.0687264Z [0m[[0m[0minfo[0m] [0m[0m[31m!
> +- Project [(id#126290L % 10) AS key#126270L, array(id#126290L,
> (id#126290L + 1), (id#126290L + 3)) AS c#126273] +- Filter
> isnotnull(c#126273)[0m[0m
> 2022-06-16T05:29:18.0688660Z [0m[[0m[0minfo[0m] [0m[0m[31m!
> +- Range (0, 10, step=1, splits=Some(2))
> +- Filter
> ((size(c#126273, true) > 0) AND isnotnull(c#126273))[0m[0m
> 2022-06-16T05:29:18.0690609Z [0m[[0m[0minfo[0m] [0m[0m[31m!
>
> +- Project
> [(id#126290L % 10) AS key#126270L, array(id#126290L, (id#126290L + 1),
> (id#126290L + 3)) AS c#126273][0m[0m
> 2022-06-16T05:29:18.0704834Z [0m[[0m[0minfo[0m] [0m[0m[31m!
>
> +- Range (0, 10,
> step=1, splits=Some(2))[0m[0m
> {code}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
