Github user mccheah commented on the pull request:
https://github.com/apache/spark/pull/4066#issuecomment-73025478
I may be missing something, but how are the tests passing given your latest
observations and test...?
That being said, with the infinite commit denied problem - each job that
attempts to commit and fails will increment the task-failed count by 1 anyways,
and eventually the task should give up and no longer be launched. So even
though a bunch of tasks aren't attempting to commit at all - and these tasks
not increasing the failure count - the tasks that do attempt to commit and fail
should eventually give up.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]