Rohini Palaniswamy created PIG-4844:
---------------------------------------
Summary: Tez AM runs out of memory when vertex has high number of
outputs
Key: PIG-4844
URL: https://issues.apache.org/jira/browse/PIG-4844
Project: Pig
Issue Type: Improvement
Reporter: Rohini Palaniswamy
Fix For: 0.16.0
AM runs out of memory when trying to respond to getTask() calls from
container for a vertex with large number of outputs (usually the case with
multi-query when you group by on multiple dimensions). Problem is with the
size of payload config associated with PigProcessor, Input and Output. When
there is >10 outputs size of the payload considerably increases causing memory
pressure.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)