HeartSaVioR edited a comment on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-447197369 @squito > I also wonder if this feature should not be so yarn-specific then -- in fact, it almost seems more important on kubernetes, as there is no long-lived NM there. 100% agreed, and I imagine Hadoop is taking same way as containerized, being configured in cloud and support elasticity which brings the needs on YARN side. > But maybe the params you need end up being specific to deployment mode, (eg. {{ContainerId}}) so there is no general solution. Agreed. Path parameters should be specific to deployment mode, given that concepts can be different as well as terms/components can be different for deployment modes. > maybe even to work with yarn even while the app is running; I guess I got same question from @vanzin and I answered it. Could you elaborate this if my answer doesn't address what you're considering?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
