[
https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16424977#comment-16424977
]
Wangda Tan commented on YARN-1151:
----------------------------------
Thanks [~xgong],
One doubt:
{code}
218 } else {
219 if (!sub.getPath().getName().endsWith(DEL_SUFFIX)) {
220 Path delPath = new Path(sub.getPath().getParent(),
221 sub.getPath().getName() + DEL_SUFFIX);
222 localLFS.rename(sub.getPath(), delPath);
223 LOG.info("delete old aux service jar dir:"
224 + delPath.toString());
225 FileDeletionTask deletionTask = new FileDeletionTask(
226 this.delService, null, delPath, null);
227 this.delService.delete(deletionTask);
228 }
{code}
I'm not sure if I understand correct: assume we have multiple services, does
this logic remove all other service localized jars?
And a minor comment is, it's better to have a separate to handle jar download /
remove outdated local folder logic. (line 165 - 267)
> Ability to configure auxiliary services from HDFS-based JAR files
> -----------------------------------------------------------------
>
> Key: YARN-1151
> URL: https://issues.apache.org/jira/browse/YARN-1151
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.1.0-beta, 2.9.0
> Reporter: john lilley
> Assignee: Xuan Gong
> Priority: Major
> Labels: auxiliary-service, yarn
> Attachments: YARN-1151.1.patch, YARN-1151.2.patch, YARN-1151.3.patch,
> YARN-1151.4.patch, YARN-1151.5.patch, YARN-1151.branch-2.poc.2.patch,
> YARN-1151.branch-2.poc.3.patch, YARN-1151.branch-2.poc.patch, [YARN-1151]
> [Design] Configure auxiliary services from HDFS-based JAR files.pdf
>
>
> I would like to install an auxiliary service in Hadoop YARN without actually
> installing files/services on every node in the system. Discussions on the
> user@ list indicate that this is not easily done. The reason we want an
> auxiliary service is that our application has some persistent-data components
> that are not appropriate for HDFS. In fact, they are somewhat analogous to
> the mapper output of MapReduce's shuffle, which is what led me to
> auxiliary-services in the first place. It would be much easier if we could
> just place our service's JARs in HDFS.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
