Reynold Xin created SPARK-3353:
----------------------------------
Summary: Stage id monotonicity (parent stage should have lower
stage id)
Key: SPARK-3353
URL: https://issues.apache.org/jira/browse/SPARK-3353
Project: Spark
Issue Type: Improvement
Components: Spark Core
Affects Versions: 1.1.0
Reporter: Reynold Xin
The way stage IDs are generated is that parent stages actually have higher
stage id. This is very confusing because parent stages get scheduled & executed
first.
We should reverse that order so the scheduling timeline of stages (absent of
failures) is monotonic, i.e. stages that are executed first have lower stage
ids.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
