Github user mridulm commented on the issue:
https://github.com/apache/spark/pull/20393
@jiangxb1987 Other than hash partitioning, I dont see how this can be
handled reliably ...
You are right, this is a basic correctness issue - unfortunately I never
used this family of methods (coalasce, repartition, etc) and never saw the
issue.
@shivaram Any thoughts ? You might have better insights.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
