Github user kayousterhout commented on the pull request:
https://github.com/apache/spark/pull/5636#issuecomment-98036839
@squito based on our other conversation in the comments, I wonder if it
would be better to track the number of failures in ShuffleMapStage (so this
would mean we'd track the failures of the map stage rather than the stage that
reads the shuffle), and then explicitly call it "numFetchFailures" or similar?
I just think that might be more clear to someone reading the code, since these
failures only happen for fetches.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
