dongjoon-hyun commented on PR #45144: URL: https://github.com/apache/spark/pull/45144#issuecomment-1949475905
FYI, all GitHub Action works fine without any compilation failure like that. The is the result from my environment. ``` $ java -version openjdk version "17.0.10" 2024-01-16 LTS OpenJDK Runtime Environment AppleJDK-17.0.10.7.1 (build 17.0.10+7-LTS) OpenJDK 64-Bit Server VM AppleJDK-17.0.10.7.1 (build 17.0.10+7-LTS, mixed mode, sharing) $ build/sbt sbt:spark-parent> clean ;compile;catalyst/testOnly org.apache.spark.sql.catalyst.optimizer.FilterPushdownSuite ... [info] FilterPushdownSuite: [info] - eliminate subqueries (21 milliseconds) [info] - simple push down (12 milliseconds) [info] - combine redundant filters (12 milliseconds) [info] - do not combine non-deterministic filters even if they are identical (10 milliseconds) [info] - SPARK-16164: Filter pushdown should keep the ordering in the logical plan (7 milliseconds) [info] - SPARK-16994: filter should not be pushed through limit (3 milliseconds) [info] - can't push without rewrite (11 milliseconds) [info] - nondeterministic: can always push down filter through project with deterministic field (11 milliseconds) [info] - nondeterministic: can't push down filter through project with nondeterministic field (4 milliseconds) [info] - nondeterministic: can't push down filter through aggregate with nondeterministic field (6 milliseconds) [info] - nondeterministic: push down part of filter through aggregate with deterministic field (9 milliseconds) [info] - filters: combines filters (5 milliseconds) [info] - joins: push to either side (8 milliseconds) [info] - joins: push to one side (6 milliseconds) [info] - joins: do not push down non-deterministic filters into join condition (2 milliseconds) [info] - joins: push to one side after transformCondition (6 milliseconds) [info] - joins: rewrite filter to push to either side (4 milliseconds) [info] - joins: push down left semi join (6 milliseconds) [info] - joins: push down left outer join #1 (6 milliseconds) [info] - joins: push down right outer join #1 (6 milliseconds) [info] - joins: push down left outer join #2 (5 milliseconds) [info] - joins: push down right outer join #2 (6 milliseconds) [info] - joins: push down left outer join #3 (6 milliseconds) [info] - joins: push down right outer join #3 (13 milliseconds) [info] - joins: push down left outer join #4 (6 milliseconds) [info] - joins: push down right outer join #4 (10 milliseconds) [info] - joins: push down left outer join #5 (6 milliseconds) [info] - joins: push down right outer join #5 (9 milliseconds) [info] - joins: can't push down (4 milliseconds) [info] - joins: conjunctive predicates (8 milliseconds) [info] - joins: conjunctive predicates #2 (3 milliseconds) [info] - joins: conjunctive predicates #3 (7 milliseconds) [info] - joins: push down where clause into left anti join (5 milliseconds) [info] - joins: only push down join conditions to the right of a left anti join (4 milliseconds) [info] - joins: only push down join conditions to the right of an existence join (4 milliseconds) [info] - generate: predicate referenced no generated column (9 milliseconds) [info] - generate: non-deterministic predicate referenced no generated column (7 milliseconds) [info] - generate: part of conjuncts referenced generated column (6 milliseconds) [info] - generate: all conjuncts referenced generated column (2 milliseconds) [info] - aggregate: push down filter when filter on group by expression (7 milliseconds) [info] - aggregate: don't push down filter when filter not on group by expression (5 milliseconds) [info] - aggregate: push down filters partially which are subset of group by expressions (8 milliseconds) [info] - aggregate: push down filters with alias (5 milliseconds) [info] - aggregate: push down filters with literal (9 milliseconds) [info] - aggregate: don't push down filters that are nondeterministic (7 milliseconds) [info] - SPARK-17712: aggregate: don't push down filters that are data-independent (6 milliseconds) [info] - aggregate: don't push filters if the aggregate has no grouping expressions (3 milliseconds) [info] - SPARK-32940: aggregate: push filters through first, last and collect (17 milliseconds) [info] - union (11 milliseconds) [info] - expand (19 milliseconds) [info] - predicate subquery: push down simple (15 milliseconds) [info] - predicate subquery: push down complex (8 milliseconds) [info] - SPARK-20094: don't push predicate with IN subquery into join condition (11 milliseconds) [info] - Window: predicate push down -- basic (24 milliseconds) [info] - Window: predicate push down -- predicates with compound predicate using only one column (5 milliseconds) [info] - Window: predicate push down -- multi window expressions with the same window spec (5 milliseconds) [info] - Window: predicate push down -- multi window specification - 1 (9 milliseconds) [info] - Window: predicate push down -- multi window specification - 2 (7 milliseconds) [info] - Window: predicate push down -- predicates with multiple partitioning columns (5 milliseconds) [info] - Window: predicate push down -- complex predicate with the same expressions !!! IGNORED !!! [info] - Window: no predicate push down -- predicates are not from partitioning keys (5 milliseconds) [info] - Window: no predicate push down -- partial compound partition key (4 milliseconds) [info] - Window: no predicate push down -- complex predicates containing non partitioning columns (4 milliseconds) [info] - Window: no predicate push down -- complex predicate with different expressions (5 milliseconds) [info] - watermark pushdown: no pushdown on watermark attribute #1 (121 milliseconds) [info] - watermark pushdown: no pushdown for nondeterministic filter (5 milliseconds) [info] - watermark pushdown: full pushdown (2 milliseconds) [info] - watermark pushdown: no pushdown on watermark attribute #2 (2 milliseconds) [info] - push down predicate through expand (2 milliseconds) [info] - SPARK-28345: PythonUDF predicate should be able to pushdown to join (2 milliseconds) [info] - push down filter predicates through inner join (10 milliseconds) [info] - push down join predicates through inner join (2 milliseconds) [info] - push down complex predicates through inner join (5 milliseconds) [info] - push down predicates(with NOT predicate) through inner join (3 milliseconds) [info] - push down predicates through left join (2 milliseconds) [info] - push down predicates through right join (4 milliseconds) [info] - SPARK-32302: avoid generating too many predicates (3 milliseconds) [info] - push down predicate through multiple joins (4 milliseconds) [info] - SPARK-37828: Push down filters through RebalancePartitions (3 milliseconds) [info] - SPARK-46707: push down predicate with sequence (without step) through joins (4 milliseconds) [info] - SPARK-46707: push down predicate with sequence (without step) through aggregates (5 milliseconds) [info] - SPARK-46707: combine predicate with sequence (without step) with other filters (3 milliseconds) [info] Run completed in 1 second, 946 milliseconds. [info] Total number of tests run: 81 [info] Suites: completed 1, aborted 0 [info] Tests: succeeded 81, failed 0, canceled 0, ignored 1, pending 0 [info] All tests passed. [success] Total time: 52 s, completed Feb 16, 2024, 3:21:56 PM ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
