Github user JoshRosen commented on the pull request:
https://github.com/apache/spark/pull/8544#issuecomment-140257646
@squito, I took a look at the OutputCommitCoordinator itself and, as far as
I can conclude, it seems to be using stageIds properly. The one area where
there might be some confusion is in TaskCommitDeinedException, but in that case
I think our use of job ids in log messages might actually be accurate.
In either case, I think the basics fix in this patch is correct and would
like to merge this version for inclusion in 1.5.1.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
