Naganarasimha G R commented on YARN-2859:

Hi [~vinodkv] & [~sjlee0],
Though the addendum patch fixes the TestDistributedShell issue in 2.7.2, it had 
impacts in ATSv2 branch. On further checking realized that in trunk and 2.7.2 , 
{{yarn.resourcemanager.system-metrics-publisher.enabled}} was not set to true 
in TestDistributedShell.setupInternal in but was required to be set in ATSv2 
Further to rectify i faced following issues, 
# In MiniYARNCluster RM servicewrapper is first added and then AHSwrapper, and 
also actual AHS service is started in a thread, so RM's will be using the wrong 
timelineclient address(port is zero) as AHS service is not yet initialized.
# In Timeline client Impl's *serviceInit* URI for timeline REST service is set. 
So even though we create the correct service order (as per previous step), RM's 
SMP will fail to publish, as timelineweb address is got only after the AHS 
service is started. 
Even after this (though got the right port) was still facing some issues.

So if *MINI YARN cluster is required to be used with system-metrics-publisher 
enabled*, either we need to start correcting series of issues or use other 
simpler option  {{ServerSocketUtil.getPort(9188, 10)}}, which i feel is safer 
and used in many other places.But would req different patches for 2.6.2 !

> ApplicationHistoryServer binds to default port 8188 in MiniYARNCluster
> ----------------------------------------------------------------------
>                 Key: YARN-2859
>                 URL: https://issues.apache.org/jira/browse/YARN-2859
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: timelineserver
>            Reporter: Hitesh Shah
>            Assignee: Vinod Kumar Vavilapalli
>            Priority: Critical
>             Fix For: 2.8.0, 2.7.2, 2.6.3
>         Attachments: YARN-2859-addendum.txt, YARN-2859.txt
> In mini cluster, a random port should be used. 
> Also, the config is not updated to the host that the process got bound to.
> {code}
> 2014-11-13 13:07:01,905 INFO  [main] server.MiniYARNCluster 
> (MiniYARNCluster.java:serviceStart(722)) - MiniYARN ApplicationHistoryServer 
> address: localhost:10200
> 2014-11-13 13:07:01,905 INFO  [main] server.MiniYARNCluster 
> (MiniYARNCluster.java:serviceStart(724)) - MiniYARN ApplicationHistoryServer 
> web address:
> {code}

This message was sent by Atlassian JIRA

Reply via email to