[
https://issues.apache.org/jira/browse/KYLIN-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15270327#comment-15270327
]
kojo13 edited comment on KYLIN-1319 at 5/4/16 8:43 AM:
-------------------------------------------------------
1 yarn-site.xml is setted ,the logging is
2016-05-04 13:38:25,971 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:2a78ad4d-455a-470b-ada9-fb501e36ac10-01 from READY to RUNNING
2016-05-04 13:38:26,051 INFO [pool-5-thread-1]
execution.AbstractExecutable:107 : mr_job_id:null
2016-05-04 13:38:26,054 INFO [pool-5-thread-1]
execution.AbstractExecutable:218 : kylin.job.yarn.app.rest.check.status.url is
not set, read from job configuration
2016-05-04 13:38:26,169 INFO [pool-5-thread-1]
execution.AbstractExecutable:234 :
yarn.resourcemanager.webapp.address:http://0.0.0.0:8088
2016-05-04 13:38:26,510 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:2a78ad4d-455a-470b-ada9-fb501e36ac10-01 from RUNNING to ERROR
2016-05-04 13:38:26,565 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:2a78ad4d-455a-470b-ada9-fb501e36ac10 from RUNNING to ERROR
2
"kylin.job.yarn.app.rest.check.status.url" is set in conf/kylin.properties
http://hostname:8088/cluster/apps/${job_id}?anonymous=true
2016-05-04 16:14:48,586 INFO [pool-5-thread-1]
execution.AbstractExecutable:107 : mr_job_id:null
2016-05-04 16:14:49,264 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:f6e4b5dc-fcb4-4df3-bfab-471353a3cfba-01 from RUNNING to ERROR
2016-05-04 16:14:49,311 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:f6e4b5dc-fcb4-4df3-bfab-471353a3cfba from RUNNING to ERROR
was (Author: kojo):
"kylin.job.yarn.app.rest.check.status.url" is set in conf/kylin.properties
http://hostname:8088/cluster/apps/${job_id}?anonymous=true
hostname is the active resourcemanager,why mr_job_id is nulll and rmWebHost is
not my RM host
yarn.resourcemanager.webapp.address:http://0.0.0.0:8088
but when i build sample_cube ,l
2016-05-04 16:14:48,586 INFO [pool-5-thread-1]
execution.AbstractExecutable:107 : mr_job_id:null
2016-05-04 16:14:49,264 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:f6e4b5dc-fcb4-4df3-bfab-471353a3cfba-01 from RUNNING to ERROR
2016-05-04 16:14:49,311 INFO [pool-5-thread-1] manager.ExecutableManager:274 :
job id:f6e4b5dc-fcb4-4df3-bfab-471353a3cfba from RUNNING to ERROR
> Find a better way to check hadoop job status
> --------------------------------------------
>
> Key: KYLIN-1319
> URL: https://issues.apache.org/jira/browse/KYLIN-1319
> Project: Kylin
> Issue Type: Improvement
> Reporter: liyang
> Assignee: Zhong Yanghong
> Labels: newbie
> Attachments:
> Find_better_way_of_checking_hadoop_job_status_via_job_API_master.patch
>
>
> Currently Kylin retrieves jobs status via a resource manager web service like
> {code}https://<your_rm_server>:<port>/ws/v1/cluster/apps/${job_id}?anonymous=true{code}
> It is not most robust. Some user does not have
> "yarn.resourcemanager.webapp.address" set in yarm-site.xml, then get status
> will fail out-of-box. They have to set a Kylin property
> "kylin.job.yarn.app.rest.check.status.url" to overcome, which is not user
> friendly.
> Kerberos authentication might cause problem too if security is enabled.
> Is there a more robust way to check job status? Via Job API?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
