[
https://issues.apache.org/jira/browse/YARN-10481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
gabrywu updated YARN-10481:
---------------------------
Description:
Hello team,
Submitting jobs through 'yarn jar mainClass args' is a general task, however,
we have to parse the current application id or tracking URL of the submitted
job from the INFO logs, such as
20/11/03 00:39:13 INFO client.ConfiguredRMFailoverProxyProvider: Failing over
to rm2
20/11/03 00:39:13 INFO input.FileInputFormat: Total input paths to process : 16
20/11/03 00:39:13 INFO mapreduce.JobSubmitter: number of splits:16
20/11/03 00:39:13 INFO mapreduce.JobSubmitter:{color:#ff0000} Submitting
tokens for job: job_1601247375834_530832{color}
20/11/03 00:39:14 INFO impl.YarnClientImpl: Submitted application
application_1601247375834_530832
20/11/03 00:39:14 INFO mapreduce.Job: {color:#ff0000}The url to track the job:
[https://xxxxxxxx:50030/proxy/application_1601247375834_530832/]{color}
20/11/03 00:39:14 INFO mapreduce.Job: {color:#ff0000}Running job:
job_1601247375834_530832{color}
20/11/03 00:39:26 INFO mapreduce.Job: Job job_1601247375834_530832 running in
uber mode : false
20/11/03 00:39:26 INFO mapreduce.Job: map 0% reduce 0%
20/11/03 00:39:34 INFO mapreduce.Job: map 13% reduce 0%
20/11/03 00:39:35 INFO mapreduce.Job: map 50% reduce 0%
20/11/03 00:39:36 INFO mapreduce.Job: map 63% reduce 0%
20/11/03 00:39:37 INFO mapreduce.Job: map 88% reduce 0%
20/11/03 00:39:38 INFO mapreduce.Job: map 100% reduce 0%
20/11/03 00:39:47 INFO mapreduce.Job: map 100% reduce 100%
So my question is that, is there a convenient way to retrieve the application
for the submitted job?
was:
Hello team,
Submitting jobs through yarn jar is a general task, however, we have to parse
the current application id or tracking URL of the submitted job from the INFO
logs, such as
20/11/03 00:39:13 INFO client.ConfiguredRMFailoverProxyProvider: Failing over
to rm2
20/11/03 00:39:13 INFO input.FileInputFormat: Total input paths to process : 16
20/11/03 00:39:13 INFO mapreduce.JobSubmitter: number of splits:16
20/11/03 00:39:13 INFO mapreduce.JobSubmitter:{color:#FF0000} Submitting tokens
for job: job_1601247375834_530832{color}
20/11/03 00:39:14 INFO impl.YarnClientImpl: Submitted application
application_1601247375834_530832
20/11/03 00:39:14 INFO mapreduce.Job: {color:#FF0000}The url to track the job:
https://xxxxxxxx:50030/proxy/application_1601247375834_530832/{color}
20/11/03 00:39:14 INFO mapreduce.Job: {color:#FF0000}Running job:
job_1601247375834_530832{color}
20/11/03 00:39:26 INFO mapreduce.Job: Job job_1601247375834_530832 running in
uber mode : false
20/11/03 00:39:26 INFO mapreduce.Job: map 0% reduce 0%
20/11/03 00:39:34 INFO mapreduce.Job: map 13% reduce 0%
20/11/03 00:39:35 INFO mapreduce.Job: map 50% reduce 0%
20/11/03 00:39:36 INFO mapreduce.Job: map 63% reduce 0%
20/11/03 00:39:37 INFO mapreduce.Job: map 88% reduce 0%
20/11/03 00:39:38 INFO mapreduce.Job: map 100% reduce 0%
20/11/03 00:39:47 INFO mapreduce.Job: map 100% reduce 100%
So my question is that, is there a convenient way to retrieve the application
for the submitted job?
> return application id when submitting job
> -----------------------------------------
>
> Key: YARN-10481
> URL: https://issues.apache.org/jira/browse/YARN-10481
> Project: Hadoop YARN
> Issue Type: Wish
> Components: yarn
> Affects Versions: 3.2.1
> Reporter: gabrywu
> Priority: Minor
> Labels: easy-fix, features
>
> Hello team,
> Submitting jobs through 'yarn jar mainClass args' is a general task, however,
> we have to parse the current application id or tracking URL of the submitted
> job from the INFO logs, such as
> 20/11/03 00:39:13 INFO client.ConfiguredRMFailoverProxyProvider: Failing over
> to rm2
> 20/11/03 00:39:13 INFO input.FileInputFormat: Total input paths to process :
> 16
> 20/11/03 00:39:13 INFO mapreduce.JobSubmitter: number of splits:16
> 20/11/03 00:39:13 INFO mapreduce.JobSubmitter:{color:#ff0000} Submitting
> tokens for job: job_1601247375834_530832{color}
> 20/11/03 00:39:14 INFO impl.YarnClientImpl: Submitted application
> application_1601247375834_530832
> 20/11/03 00:39:14 INFO mapreduce.Job: {color:#ff0000}The url to track the
> job: [https://xxxxxxxx:50030/proxy/application_1601247375834_530832/]{color}
> 20/11/03 00:39:14 INFO mapreduce.Job: {color:#ff0000}Running job:
> job_1601247375834_530832{color}
> 20/11/03 00:39:26 INFO mapreduce.Job: Job job_1601247375834_530832 running
> in uber mode : false
> 20/11/03 00:39:26 INFO mapreduce.Job: map 0% reduce 0%
> 20/11/03 00:39:34 INFO mapreduce.Job: map 13% reduce 0%
> 20/11/03 00:39:35 INFO mapreduce.Job: map 50% reduce 0%
> 20/11/03 00:39:36 INFO mapreduce.Job: map 63% reduce 0%
> 20/11/03 00:39:37 INFO mapreduce.Job: map 88% reduce 0%
> 20/11/03 00:39:38 INFO mapreduce.Job: map 100% reduce 0%
> 20/11/03 00:39:47 INFO mapreduce.Job: map 100% reduce 100%
>
> So my question is that, is there a convenient way to retrieve the application
> for the submitted job?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
