[
https://issues.apache.org/jira/browse/SPARK-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Or updated SPARK-10192:
------------------------------
Component/s: Tests
> Test for fetch failure in a shared dependency for "skipped" stages
> ------------------------------------------------------------------
>
> Key: SPARK-10192
> URL: https://issues.apache.org/jira/browse/SPARK-10192
> Project: Spark
> Issue Type: Sub-task
> Components: Spark Core, Tests
> Reporter: Imran Rashid
> Assignee: Imran Rashid
>
> One confusing corner case of the DAGScheduler is when there is a shared
> shuffle dependency, a job might "skip" the stage associated with that shuffle
> dependency, since its already been created as part of a different stage.
> This means if there is a fetch failure, the retry will technically happen as
> part of a different {{Stage}} instance.
> This already works, but is lacking tests, so I just plan on adding a simple
> test case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
