[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2019-01-18 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-455616927 >> The one thing I am wondering about is if we should change it so that when the SHS is looking at an inprogress file,

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2018-12-14 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-447369387 well, I thought you said above that this does *not* integrate that well with JHS / ATS currently, because we're not

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2018-12-13 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-447116226 yes, I see your point about the chicken and egg. I also wonder if this feature should not be so yarn-specific then --

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2018-12-12 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-446751406 OK, so while this *might* be useful with the JHS / ATS, @HeartSaVioR 's real use case is with some external log

[GitHub] squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr

2018-12-12 Thread GitBox
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log URL for stdout/stderr URL: https://github.com/apache/spark/pull/23260#issuecomment-446668589 I'm sorry, I still don't totally follow, partially from my ignorance of some details in yarn here which I'd like to