[ 
https://issues.apache.org/jira/browse/TEZ-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14337295#comment-14337295
 ] 

Rohini Palaniswamy commented on TEZ-2144:
-----------------------------------------

[~sseth],
    When you go with the option of writing input splits on HDFS it does not 
cause memory pressure for AM like the other two options right?

> Compressing user payload
> ------------------------
>
>                 Key: TEZ-2144
>                 URL: https://issues.apache.org/jira/browse/TEZ-2144
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Rohini Palaniswamy
>
> Pig sets the input split information in user payload and when running against 
> a table with 10s of 1000s of partitions, DAG submission fails with 
> java.io.IOException: Requested data length 305844060 is longer than maximum
> configured RPC length 67108864



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to