Dmitriy V. Ryaboy created PIG-3044:
--------------------------------------
Summary: Trigger POPartialAgg compaction under GC pressure
Key: PIG-3044
URL: https://issues.apache.org/jira/browse/PIG-3044
Project: Pig
Issue Type: Improvement
Affects Versions: 0.10.0, 0.11, 0.10.1
Reporter: Dmitriy V. Ryaboy
Assignee: Dmitriy V. Ryaboy
Fix For: 0.12
If partial aggregation is turned on in pig 10 and 11, 20% (by default) of the
available heap can be consumed by the POPartialAgg operator. This can cause
memory issues for jobs that use all, or nearly all, of the heap already.
If we make POPartialAgg "spillable" (trigger compaction when memory reduction
is required), we would be much nicer to high-memory jobs.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
