HeartSaVioR commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-449665436 I'm OK to think about having general solution / different URLs between UI in driver / SHS, except parameters. I have been thinking about parameters being general / flexible but still don't get it. 1. Generalization between resource managers don't look like possible, due to differences of term, concept, provided information, etc. 2. Even same resource manager, I'm not sure how much we want to be flexible. (That's the main reason I ask for elaborating.) More flexibility requires storing possibly unnecessary things (which might even contain credential one) in event log for every app. Without seeing definition of the specification and its possibility, I'm a bit worried that it can just play as a high bar/wall.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
