[
https://issues.apache.org/jira/browse/SPARK-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia resolved SPARK-1198.
----------------------------------
Resolution: Fixed
Fix Version/s: 1.0.0
> Allow pipes tasks to run in different sub-directories
> -----------------------------------------------------
>
> Key: SPARK-1198
> URL: https://issues.apache.org/jira/browse/SPARK-1198
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 0.9.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Fix For: 1.0.0
>
>
> Currently when a task runs, its working directory is the same as all the
> other tasks running on that Worker. If the tasks happen to output files to
> that working directory with the same name, collisions happen.
> We should add an option to allow the tasks to run in separate sub-directories
> to avoid those conflicts.
> I should clarify that the specific concern is when running the pipes command.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
