Yin Huai created SPARK-9240:
-------------------------------
Summary: Hybrid aggregate operator
Key: SPARK-9240
URL: https://issues.apache.org/jira/browse/SPARK-9240
Project: Spark
Issue Type: Sub-task
Components: SQL
Reporter: Yin Huai
Priority: Blocker
We need a hybrid aggregate operator, which first tries hash-based aggregations
and gracefully switch to sort-based aggregations if the hash map's memory
footprint exceeds a given threshold (how to track memory footprint and how to
set the threshold?).
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
