Wan Kun created SPARK-40159:
-------------------------------
Summary: Aggregate should be group only after collapse project to
aggregate
Key: SPARK-40159
URL: https://issues.apache.org/jira/browse/SPARK-40159
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.3.0
Reporter: Wan Kun
CollapseProject rule will merge project expressions into AggregateExpressions
in aggregate, which will make the *aggregate.groupOnly* to false.
{code}
val df = testData.distinct().select('key + 1, ('key + 1).cast("long"))
df.queryExecution.optimizedPlan.collect {
case a: Aggregate => a
}.foreach(agg => assert(agg.groupOnly === true))
{code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
