[
https://issues.apache.org/jira/browse/TEZ-1193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14026148#comment-14026148
]
Bikas Saha commented on TEZ-1193:
---------------------------------
Is the new log4jproperties inadvertently added from your dev setup or its
intended to be in the patch?
I can see that specifying tez lib uris has been made optional. But what happens
when its not specified? There is no other logic and the job is doomed to fail
unless something else has taken care of it. While I can see that some scenarios
(like debugging) may take advantage of this, in the common case, as we have
seen from the mailing lists, absence of tez.lib.uris is a mistake that new
users typically make. Its easy to catch because the config is not set or points
to an invalid location.
IMO, we should continue to require that tez.lib.uris be set for the
straightline case. Instead, we could add a new boolean config like
tez.lib.uris.dev-override for example that specifies we are overriding it
explicitly in our application. When set to true then we will ignore the
tez-lib-uris. IMO this will be less error prone.
> Make 'tez.lib.uris' dependency optional
> ---------------------------------------
>
> Key: TEZ-1193
> URL: https://issues.apache.org/jira/browse/TEZ-1193
> Project: Apache Tez
> Issue Type: Improvement
> Affects Versions: 0.4.0
> Reporter: Oleg Zhurakousky
> Assignee: Oleg Zhurakousky
> Priority: Minor
> Attachments: TEZ-1193.patch
>
>
> Hadoop/YARN provides a mechanism to setup a runtime classpath of Tez/YARN job
> through LocalResources. Tez exposes setting of LocalResources through
> AMConfiguration and Vertex thuis allowing AM and ACs have its independent
> classpath which can include Tez (depending on how Tez job is written). This
> means that setting _tez.lib.uris_ and installing Tez all together should be
> optional since its libraries could be easily propagated during job submission.
> It also ensures that the Tez libraries that were used during build are the
> same that are used during the runtime.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
