[ 
https://issues.apache.org/jira/browse/TEZ-1160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hitesh Shah resolved TEZ-1160.
------------------------------
    Resolution: Duplicate

> Allow users to set non-tez configs on client side
> -------------------------------------------------
>
>                 Key: TEZ-1160
>                 URL: https://issues.apache.org/jira/browse/TEZ-1160
>             Project: Apache Tez
>          Issue Type: Improvement
>            Reporter: Ramya Sunil
>
> We ran into an issue while testing ATS with tez. We wanted to validate if tez 
> AM can write to ATS but we could not do this without updating configs on the 
> entire cluster.
> Here is the exact scenario:
> 1. 10node cluster running with ats=disabled in yarn-site.xml
> 2. Set ATS=enabled on one host in the cluster and start ATS daemon before 
> test execution
> 3. Submit a tez job with ats=enabled on cli/tez-site.xml to verify that tezAM 
> writes to ATS.
> 4. Shutdown ATS.
> Step #3 will fail because tezAM reads configs deployed on the cluster i.e 
> RM/NMs and in the configs deployed on the cluster ats=disabled, meaning tezAM 
> does not write to ATS though the client side/tez-site.xml has set ats=enabled.
> As a workaround, we need to update the entire cluster with ats=enabled and 
> restart services so that tezAM can write to ATS. It will be nice to have a 
> feature in tez where users can set a non-tez config in tez-site.xml and that 
> config is honored cluster wide for tez AM/tasks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to