Cheng Lian created SPARK-18186:
----------------------------------
Summary: Migrate HiveUDAFFunction to TypedImperativeAggregate for
partial aggregation support
Key: SPARK-18186
URL: https://issues.apache.org/jira/browse/SPARK-18186
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 2.0.1, 1.6.2
Reporter: Cheng Lian
Assignee: Cheng Lian
Currently, Hive UDAFs in Spark SQL don't support partial aggregation. Any query
involving any Hive UDAFs has to fall back to {{SortAggregateExec}} without
partial aggregation.
This issue can be fixed by migrating {{HiveUDAFFunction}} to
{{TypedImperativeAggregate}}, which already provides partial aggregation
support for aggregate functions that may use arbitrary Java objects as
aggregation states.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
