This is an automated email from the ASF dual-hosted git repository.
yamamuro pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 7a8a600 [SPARK-34776][SQL] Nested column pruning should not prune
Window produced attributes
add 620cae0 [SPARK-33122][SQL] Remove redundant aggregates in the
Optimzier
No new revisions were added by this update.
Summary of changes:
.../spark/sql/catalyst/analysis/Analyzer.scala | 50 -------
.../analysis/PullOutNondeterministic.scala | 74 ++++++++++
.../spark/sql/catalyst/optimizer/Optimizer.scala | 45 ++++++
.../plans/logical/basicLogicalOperators.scala | 2 +-
.../optimizer/RemoveRedundantAggregatesSuite.scala | 163 +++++++++++++++++++++
.../execution/RemoveRedundantProjectsSuite.scala | 2 +-
6 files changed, 284 insertions(+), 52 deletions(-)
create mode 100644
sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/PullOutNondeterministic.scala
create mode 100644
sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/RemoveRedundantAggregatesSuite.scala
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
