Alexander Pivovarov created SPARK-13532:
-------------------------------------------

             Summary: Spark yarn executor container fails if 
yarn.nodemanager.local-dirs starts with file://
                 Key: SPARK-13532
                 URL: https://issues.apache.org/jira/browse/SPARK-13532
             Project: Spark
          Issue Type: Bug
          Components: YARN
            Reporter: Alexander Pivovarov


Spark yarn executor container fails if yarn.nodemanager.local-dirs starts with 
file://
{code}
   <property>
     <name>yarn.nodemanager.local-dirs</name>
     <value>file:///data01/yarn/nm,file:///data02/yarn/nm</value>
   </property>
{code}

other application, e.g. Hadoop MR and Hive work normally

Spark works only if yarn.nodemanager.local-dirs does not have file:// prefix
e.g.
{code}
    <value>/data01/yarn/nm,/data02/yarn/nm</value>
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to