Cheng Su created SPARK-32750:
--------------------------------
Summary: Add code-gen for SortAggregateExec
Key: SPARK-32750
URL: https://issues.apache.org/jira/browse/SPARK-32750
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.0
Reporter: Cheng Su
We have codegen for hash aggregate (`HashAggregateExec`) for a long time, but
missing codegen for sort aggregate (`SortAggregate`). Sort aggregate is still
useful in terms of performance if (1). the data after aggregate still too big
to fit in memory (both hash aggregate and object hash aggregate needs to
spill), (2).user can disable hash aggregate and object hash aggregate by config
to prefer sort aggregate if the aggregate is after e.g. sort merge join and do
not need sort at all.
Create this Jira to add codegen support for sort aggregate.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
