[
https://issues.apache.org/jira/browse/TEZ-3155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15185795#comment-15185795
]
Zhiyuan Yang commented on TEZ-3155:
-----------------------------------
I've uploaded another patch which address your comment.
Now all FileSystem objects are initialized in constructor or initialization
code so it can fail fast if there is anything wrong.
The 5MB buffer size become a TezConfiguration property.
Also, I've enhanced both client and server side tests: client side tests cover
more cases including those you mentioned; server side test verifies the content
of UserPayload after deserialization.
> Support a way to submit DAGs to a session where the DAG plan exceeds hadoop
> ipc limits
> ---------------------------------------------------------------------------------------
>
> Key: TEZ-3155
> URL: https://issues.apache.org/jira/browse/TEZ-3155
> Project: Apache Tez
> Issue Type: Bug
> Reporter: Hitesh Shah
> Assignee: Zhiyuan Yang
> Attachments: TEZ-3155.1.patch, TEZ-3155.2.patch, TEZ-3155.3.patch,
> TEZ-3155.4.patch, TEZ-3155.5.patch
>
>
> Currently, dag submissions fail if the dag plan exceeds the hadoop ipc
> limits. One option would be to fall back to local resources if the dag plan
> is too large.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
