[
https://issues.apache.org/jira/browse/KYLIN-1319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15268445#comment-15268445
]
Zhong Yanghong edited comment on KYLIN-1319 at 5/3/16 10:02 AM:
----------------------------------------------------------------
Hi Richard,
Thanks for your information.
As you mentioned, if "kylin.job.yarn.app.rest.check.status.url" is set in
conf/kylin.properties file, kylin will not check the HA to get the right URL.
The reason this JIRA proposed is kylin hopes to hidden the HA details for users.
For HA settings, am example is shown as follows:
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>$rm_host_name1</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>$rm_host_name2</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>$rm_host_name1:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>$rm_host_name2:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.https.address.rm1</name>
<value>$rm_host_name1:8090</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.https.address.rm2</name>
<value>$rm_host_name2:8090</value>
</property>
was (Author: yaho):
Hi Richard,
Thanks for your information.
As you mentioned, if "kylin.job.yarn.app.rest.check.status.url" is set in
conf/kylin.properties file, kylin will not check the HA to get the right URL.
The reason this JIRA proposed is kylin hopes to hidden the HA details for users.
For HA settings, am example is shown as follows:
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>$rm_host_name1</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>$rm_host_name2</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>$rm_host_name1:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>$rm_host_name2:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>$rm_host_name1:8090</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>$rm_host_name2:8090</value>
</property>
> Find a better way to check hadoop job status
> --------------------------------------------
>
> Key: KYLIN-1319
> URL: https://issues.apache.org/jira/browse/KYLIN-1319
> Project: Kylin
> Issue Type: Improvement
> Reporter: liyang
> Assignee: Zhong Yanghong
> Labels: newbie
>
> Currently Kylin retrieves jobs status via a resource manager web service like
> {code}https://<your_rm_server>:<port>/ws/v1/cluster/apps/${job_id}?anonymous=true{code}
> It is not most robust. Some user does not have
> "yarn.resourcemanager.webapp.address" set in yarm-site.xml, then get status
> will fail out-of-box. They have to set a Kylin property
> "kylin.job.yarn.app.rest.check.status.url" to overcome, which is not user
> friendly.
> Kerberos authentication might cause problem too if security is enabled.
> Is there a more robust way to check job status? Via Job API?
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
