[
https://issues.apache.org/jira/browse/TEZ-4141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17086157#comment-17086157
]
Gopal Vijayaraghavan commented on TEZ-4141:
-------------------------------------------
This is not safe from client configs drifting (i.e tez-site.xml might not be
present on every host). We do ship some xml files with LLAP in the tarball, but
the only safe configuration to reuse would be the one sent as a .pb for the
session (i.e session -> dag -> vertex -> task are minor modifications of mostly
the same config).
> Let Input/Output Processors load local xml configs
> --------------------------------------------------
>
> Key: TEZ-4141
> URL: https://issues.apache.org/jira/browse/TEZ-4141
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Mustafa Iman
> Assignee: Mustafa Iman
> Priority: Major
> Attachments: TEZ-4141.1.patch
>
>
> We would like to reduce the amount of configuration going over the wire from
> a client to application master. If Input/Output processors load local config
> files, we can reduce the configuration overhead when client and the
> processors have the exact same config on both sides. It is on user of client
> to keep the configs same on both sides. Currently, clients have to send all
> config in payload. Even if we preload config with local xml files, these
> should be overridden by the full config object coming in payload. Therefore,
> old clients that send all the config anyway would not be affected in terms of
> correctness from this change.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
