squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log
URL for stdout/stderr
URL: https://github.com/apache/spark/pull/23260#issuecomment-455616927
>> The one thing I am wondering about is if we should change it so that when
the SHS is looking at an inprogress file,
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log
URL for stdout/stderr
URL: https://github.com/apache/spark/pull/23260#issuecomment-447369387
well, I thought you said above that this does *not* integrate that well with
JHS / ATS currently, because we're not
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log
URL for stdout/stderr
URL: https://github.com/apache/spark/pull/23260#issuecomment-447116226
yes, I see your point about the chicken and egg. I also wonder if this
feature should not be so yarn-specific then --
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log
URL for stdout/stderr
URL: https://github.com/apache/spark/pull/23260#issuecomment-446751406
OK, so while this *might* be useful with the JHS / ATS, @HeartSaVioR 's real
use case is with some external log
squito commented on issue #23260: [SPARK-26311][YARN] New feature: custom log
URL for stdout/stderr
URL: https://github.com/apache/spark/pull/23260#issuecomment-446668589
I'm sorry, I still don't totally follow, partially from my ignorance of some
details in yarn here which I'd like to