Github user squito commented on the issue:
https://github.com/apache/spark/pull/21346
Last failures are known flakies.
A few updates here from my last set of comments. I've posted an overall
design doc, and shared the tests I'm running on a cluster. I think the tests
cover all the cases care about, but would appreciate review on that tests too.
I can change this to use the existing pull approach for large blocks, rather
than updating the push one if you want. If you're OK with this, there will be
one more PR on top of this to make use of the new uploadStream functionality.
There will be another PR as well to cover reading large remote blocks in
memory for SPARK-24307
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
