vanzin commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-447993002 I agree with Imran that it would be best to think about how to properly support this regardless of resource manager; including allowing applications and SHS to have different URL templates. Otherwise you end up just hardcoding a different URL; if the log server URL needs to change, all your previous applications will have broken links. e.g. the application could save the parameters somehow in the event log, and the SHS could use those when replacing things in its own value for the log URL. The parameters don't need to be pre-defined, each RM can have its own set, and it's up to the admin to set things up so that the URLs in the SHS make sense for their deployment.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
