Rohini Palaniswamy created TEZ-3008:
---------------------------------------

             Summary: AM java.io.tmpdir should be set to $PWD/tmp
                 Key: TEZ-3008
                 URL: https://issues.apache.org/jira/browse/TEZ-3008
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Rohini Palaniswamy


For tasks it is already done by TezRuntimeChildJVM

{code}
Path childTmpDir = new Path(Environment.PWD.$(),
        YarnConfiguration.DEFAULT_CONTAINER_TEMP_DIR);
    vargs.add("-Djava.io.tmpdir=" + childTmpDir);
{code}

Need to do this in AM as well. Mapreduce has uber mode which usually causes 
more problem (MAPREDUCE-6576), when user code writes to  java.io.tmpdir as it 
defaults to /tmp in AM and fills up disk space on cluster nodes. Even though 
there is no uber mode with Tez AM that can cause problem, there is still the 
chance that the output committer code of users which run in AM can write 
something to java.io.tmpdir.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to