Jason Lowe commented on YARN-2363:

Most application submits result in a proxy tracking URL, but occasionally the 
client sees a transient "N/A" URL.  Here's a snippet of Pig client output where 
a MapReduce job was submitted with no tracking URL received:

2014-07-23 19:19:16,658 [JobControl] INFO 
org.apache.hadoop.mapred.ResourceMgrDelegate - Submitted application 
application_1403199204249_357708 to ResourceManager at
2014-07-23 19:19:16,660 [JobControl] INFO  org.apache.hadoop.mapreduce.Job - 
The url to track the job: N/A

I believe this can occur if the client tries to get an application report just 
as the app is submitted.  YarnClientImpl.submitApplication won't return until 
the app is past the NEW_SAVING state, but if the client slips in while the app 
is in the SUBMITTED state then I think we could end up with no tracking URL due 
to the lack of a current attempt.  From RMAppImpl.createAndGetApplicationReport:

      String trackingUrl = UNAVAILABLE;
      String host = UNAVAILABLE;
      String origTrackingUrl = UNAVAILABLE;
      if (allowAccess) {
        if (this.currentAttempt != null) {
          currentApplicationAttemptId = this.currentAttempt.getAppAttemptId();
          trackingUrl = this.currentAttempt.getTrackingUrl();
          origTrackingUrl = this.currentAttempt.getOriginalTrackingUrl();

So if we don't have a current attempt we'll return "N/A" as the tracking URL.  
Arguably we should return the proxied URL which will redirect to the RM app 
page if there is no tracking URL set yet so at least the client/user has a URL 
that can be used to track the application.

> Submitted applications occasionally lack a tracking URL
> -------------------------------------------------------
>                 Key: YARN-2363
>                 URL: https://issues.apache.org/jira/browse/YARN-2363
>             Project: Hadoop YARN
>          Issue Type: Bug
>          Components: resourcemanager
>    Affects Versions: 2.4.0
>            Reporter: Jason Lowe
> Sometimes when an application is submitted the client receives no tracking 
> URL.  More details in the first comment.

This message was sent by Atlassian JIRA

Reply via email to