Navis created SPARK-7936: ---------------------------- Summary: Add configuration for initial size of hash for aggregation and limit Key: SPARK-7936 URL: https://issues.apache.org/jira/browse/SPARK-7936 Project: Spark Issue Type: Improvement Components: SQL Reporter: Navis Priority: Minor
Partial aggregation takes a lot of memory and mostly cannot be completed if it's not sliced into very small partitions (large in count). This patch is for limiting entry size for partial aggregation. Initial size for hash is just a bonus. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org