Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21698
Ah I see, then we need to change DAGScheduler a lot to fix it, which may
not worth.
I still insist that `repartition` should be treated as a bug, but it's not
easy to hit(when the input order is random) and very hard to fix. Maybe
documenting it is the best we can do for now.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
