Github user jerryshao commented on the pull request:
https://github.com/apache/spark/pull/11692#issuecomment-197154066
I see your point, so the real issue should only be the log issue.
But marking the state as `FINISHED` with `SUCCEED` should be open to
question, since here we don't know the real state of application, if it is
finished with failure, say job is aborted due to continuous stage failure,
should we still mark this as `SUCCEED`? So here I'm conservative to this
change, because:
1. This issue is happened rarely and does no harm to the result of
application.
2. We cannot get the real exit state of application, so marking as
`SUCCEED` should be open to question.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
