[
https://issues.apache.org/jira/browse/TEZ-3340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ming Ma updated TEZ-3340:
-------------------------
Description:
YARN provides shared cache in functionality YARN-1492. According to [~ctrezzo]
most of the YARN functionality is in hadoop 2.8 and frameworks can start to use
it. MR adds the support via MAPREDUCE-5951.
Can anyone confirm if Tez supports the upload of application DAG jar and
dependent lib jars from client machine to HDFS as part of Tez app submission?
From my test, that doesn't seem to happen. Instead Tez expects applications to
upload the jars to HDFS beforehand and then set the tez.aux.uris to the HDFS
locations.
was:
YARN provides shared cache in functionality YARN-1492. According to [~ctrezzo]
most of the YARN functionality is in hadoop 2.8 and frameworks can start to use
it. MR adds the support via MAPREDUCE-5951.
Can anyone confirm if Tez supports the upload of application DAG jar and
dependent lib jars from client machine to HDFS as part of Tez app submission?
From my test, that doesn't seem to happen. Tez expects applications to upload
the jars to HDFS beforehand and then set the tez.aux.uris to the HDFS locations.
> Add support for YARN Shared Cache
> ---------------------------------
>
> Key: TEZ-3340
> URL: https://issues.apache.org/jira/browse/TEZ-3340
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Ming Ma
>
> YARN provides shared cache in functionality YARN-1492. According to
> [~ctrezzo] most of the YARN functionality is in hadoop 2.8 and frameworks can
> start to use it. MR adds the support via MAPREDUCE-5951.
> Can anyone confirm if Tez supports the upload of application DAG jar and
> dependent lib jars from client machine to HDFS as part of Tez app submission?
> From my test, that doesn't seem to happen. Instead Tez expects applications
> to upload the jars to HDFS beforehand and then set the tez.aux.uris to the
> HDFS locations.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
