[
https://issues.apache.org/jira/browse/SPARK-27651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051630#comment-17051630
]
Thomas Graves commented on SPARK-27651:
---------------------------------------
It looks like this only works when using the external shuffle service, is that
correct? The way I read the description implies it works from both "from an
executor (or the external shuffle service)" so perhaps we should clarify. In
both this Jira and the config descriptions.
Also was there any technical reasons we didn't support it for executor to
executor shuffle?
> Avoid the network when block manager fetches shuffle blocks from the same host
> ------------------------------------------------------------------------------
>
> Key: SPARK-27651
> URL: https://issues.apache.org/jira/browse/SPARK-27651
> Project: Spark
> Issue Type: Improvement
> Components: Block Manager
> Affects Versions: 3.0.0
> Reporter: Attila Zsolt Piros
> Assignee: Attila Zsolt Piros
> Priority: Major
> Fix For: 3.0.0
>
>
> When a shuffle block (content) is fetched the network is always used even
> when it is fetched from an executor (or the external shuffle service) running
> on the same host.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
