[
https://issues.apache.org/jira/browse/SPARK-16817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16569904#comment-16569904
]
Apache Spark commented on SPARK-16817:
--------------------------------------
User 'Chopinxb' has created a pull request for this issue:
https://github.com/apache/spark/pull/22005
> Enable storing of shuffle data in Alluxio
> -----------------------------------------
>
> Key: SPARK-16817
> URL: https://issues.apache.org/jira/browse/SPARK-16817
> Project: Spark
> Issue Type: New Feature
> Reporter: Tim Bisson
> Priority: Major
>
> If one is using Alluxio for storage, it would also be useful if Spark can
> store shuffle spill data in Alluxio. For example:
> spark.local.dir="alluxio://host:port/path"
> Several users on the Alluxio mailing list have asked for this feature:
> https://groups.google.com/forum/?fromgroups#!searchin/alluxio-users/shuffle$20spark|sort:relevance/alluxio-users/90pRZWRVi0s/mgLWLS5aAgAJ
> https://groups.google.com/forum/?fromgroups#!searchin/alluxio-users/shuffle$20spark|sort:relevance/alluxio-users/s9H93PnDebw/v_1_FMjR7vEJ
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
