Github user jiangxb1987 commented on the issue:
https://github.com/apache/spark/pull/20414
@mridulm I also agree we should follow @sameeragarwal 's suggestion to let
shuffle fetch produce deterministic output, and only do this for a few
operations (e.g. repartition/zipWithIndex, do we have more?) IIUC spill should
NOT affect the result, but if you find any suspects, please kindly share them
with us. :)
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
