Github user squito commented on the issue:
https://github.com/apache/spark/pull/21474
oh no, good point Tom. it'll fail with
```
18/07/26 07:15:02 WARN scheduler.TaskSetManager: Lost task 1.0 in stage 1.3
(TID 15, irashid-large-2.gce.cloudera.com, executor 2):
FetchFailed(BlockManagerId(1
, irashid-large-3.gce.cloudera.com, 7337, None), shuffleId=0, mapId=1,
reduceId=1, message=
org.apache.spark.shuffle.FetchFailedException:
java.lang.UnsupportedOperationException
at
org.apache.spark.network.server.StreamManager.openStream(StreamManager.java:60)
at
org.apache.spark.network.server.TransportRequestHandler.processStreamRequest(TransportRequestHandler.java:136)
...
```
lemme open a jira to improve this.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
