Wangda Tan created YARN-8079:
--------------------------------
Summary: YARN native service should respect source file of
ConfigFile inside Service/Component spec
Key: YARN-8079
URL: https://issues.apache.org/jira/browse/YARN-8079
Project: Hadoop YARN
Issue Type: Bug
Reporter: Wangda Tan
Assignee: Wangda Tan
Currently, {{srcFile}} is not respected. {{ProviderUtils}} doesn't properly
read srcFile, instead it always construct {{remoteFile}} by using componentDir
and fileName of {{destFile}}:
{code}
Path remoteFile = new Path(compInstanceDir, fileName);
{code}
To me it is a common use case which services have some files existed in HDFS
and need to be localized when components get launched. (For example, if we want
to serve a Tensorflow model, we need to localize Tensorflow model (typically
not huge, less than GB) to local disk. Otherwise launched docker container has
to access HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
