Github user cloud-fan commented on the issue:
https://github.com/apache/spark/pull/21212
I think it's reasonable to filter out empty shuffle blocks, shall we also
optimize the space usage for `MapStatus`? then we can also reduce network
traffic.--- --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
