[
https://issues.apache.org/jira/browse/PIG-4847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15208890#comment-15208890
]
Rohini Palaniswamy commented on PIG-4847:
-----------------------------------------
This patch reduced runtime of the problem job which used 4G heap with
mapPartAgg from 2 hr 40 mins to 43 min. Keeping fingers crossed for any corner
case OOMs with pig scripts having big bag spills.
bq. Also let's turn on mapPartAgg by default in 0.16.
Definitely. Will do that in a separate patch before the release.
> POPartialAgg processing and spill improvements
> ----------------------------------------------
>
> Key: PIG-4847
> URL: https://issues.apache.org/jira/browse/PIG-4847
> Project: Pig
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.16.0
>
> Attachments: PIG-4847-1.patch, PIG-4847-2.patch
>
>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
