[
https://issues.apache.org/jira/browse/KYLIN-4163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16935707#comment-16935707
]
ASF GitHub Bot commented on KYLIN-4163:
---------------------------------------
zhangayqian commented on pull request #856: KYLIN-4163 have yarn app url when
creating flat hive table job running
URL: https://github.com/apache/kylin/pull/856
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> CreateFlatHiveTableStep has not yarn app url when hive job running
> ------------------------------------------------------------------
>
> Key: KYLIN-4163
> URL: https://issues.apache.org/jira/browse/KYLIN-4163
> Project: Kylin
> Issue Type: Improvement
> Components: Job Engine, Web
> Affects Versions: v3.0.0-alpha
> Reporter: chuxiao
> Priority: Minor
> Attachments: KYLIN-4163.master.001.patch, flathivetablerunning图.jpg
>
>
> CreateFlatHiveTableStep has yarn app url on the monitor web page only when
> job finished, but SparkExecutable has yarn app url when job running.
> this is because of SparkExecutable`s logger has logger listener:
> {code:java}
> final PatternedLogger patternedLogger = new PatternedLogger(logger, new
> PatternedLogger.ILogListener() {
> @Override
> public void onLogEvent(String infoKey, Map<String, String> info) {
> // only care three properties here
> if (ExecutableConstants.SPARK_JOB_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_ID.equals(infoKey)
> || ExecutableConstants.YARN_APP_URL.equals(infoKey)) {
> getManager().addJobInfo(getId(), info);
> }
> }
> });{code}
> sometimes creating flat hive table hangs, so user wants to have yarn app url
> when hive job running like attachment.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
