Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/21606
just an fyi, I was looking at backporting to 2.2, looks like at least some
write calls don't have the issue:
https://github.com/apache/spark/blob/branch-2.2/core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala#L1128
Looks like that was lost when things we refactored.
In fact a test that rolls it, not sure why that was added:
https://github.com/apache/spark/blob/master/core/src/test/scala/org/apache/spark/scheduler/OutputCommitCoordinatorSuite.scala#L325
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
