[GitHub] spark issue #20930: [SPARK-23811][Core] FetchFailed comes before Success of ...

Fri, 30 Mar 2018 03:59:37 -0700 

Github user xuanyuanking commented on the issue:

    https://github.com/apache/spark/pull/20930
  
    Yeah, the stage resubmitted, but there's no missing task for this stage and 
actually no task will be resubmitted. This mainly because the `ShuffleMapTask 
1.0` triggered `shuffleStage.addOutputLoc`.
    The screenshot I attached in Jira maybe help to explain this scenario.
    
![image](https://user-images.githubusercontent.com/4833765/38135625-c54309f2-344b-11e8-850e-9f99dc2b28a0.png)
    
![image](https://user-images.githubusercontent.com/4833765/38135635-d17360aa-344b-11e8-8328-a386c22f966a.png)
    You can see the empty ShuffleMapStage 2 retry 4 times, finally its child 
stage 3 failed with FetchFailed.



---

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to