[
https://issues.apache.org/jira/browse/YARN-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13759411#comment-13759411
]
Vinod Kumar Vavilapalli commented on YARN-1151:
-----------------------------------------------
The feature-request doesn't seem wild given we also want to move MR to be
driven by a HDFS dir. We'll need to implement a class-loader, a little tricky
but entirely possible.
But one big catch with auxiliary services, since the dawn of YARN, is that they
run inside inside the NM address space and have isolation issues. We really
want to encourage stuff to be moved out of NM into long-running services, the
support for which is still a WIP (YARN-896). Is that something that will work
for you? You can see HOYA as a service running under YARN for e.g at
http://hortonworks.com/blog/introducing-hoya-hbase-on-yarn/.
> Ability to configure auxiliary services from HDFS-based JAR files
> -----------------------------------------------------------------
>
> Key: YARN-1151
> URL: https://issues.apache.org/jira/browse/YARN-1151
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: nodemanager
> Affects Versions: 2.1.0-beta
> Reporter: john lilley
> Priority: Minor
> Labels: auxiliary-service, yarn
>
> I would like to install an auxiliary service in Hadoop YARN without actually
> installing files/services on every node in the system. Discussions on the
> user@ list indicate that this is not easily done. The reason we want an
> auxiliary service is that our application has some persistent-data components
> that are not appropriate for HDFS. In fact, they are somewhat analogous to
> the mapper output of MapReduce's shuffle, which is what led me to
> auxiliary-services in the first place. It would be much easier if we could
> just place our service's JARs in HDFS.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
