[
https://issues.apache.org/jira/browse/TEZ-2144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14338062#comment-14338062
]
Siddharth Seth commented on TEZ-2144:
-------------------------------------
bq. That will be a bigger change to Pig code and also not worth identifying
what should be in session mode and non-session mode and switching between both.
Is there a reason to not run everything in non-session mode ?
Even in this case though, the split size within the AM may be a consideration.
> Compressing user payload
> ------------------------
>
> Key: TEZ-2144
> URL: https://issues.apache.org/jira/browse/TEZ-2144
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Rohini Palaniswamy
>
> Pig sets the input split information in user payload and when running against
> a table with 10s of 1000s of partitions, DAG submission fails with
> java.io.IOException: Requested data length 305844060 is longer than maximum
> configured RPC length 67108864
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
