Navis created SPARK-7936:
----------------------------
Summary: Add configuration for initial size of hash for
aggregation and limit
Key: SPARK-7936
URL: https://issues.apache.org/jira/browse/SPARK-7936
Project: Spark
Issue Type: Improvement
Components: SQL
Reporter: Navis
Priority: Minor
Partial aggregation takes a lot of memory and mostly cannot be completed if
it's not sliced into very small partitions (large in count). This patch is for
limiting entry size for partial aggregation. Initial size for hash is just a
bonus.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
