[
https://issues.apache.org/jira/browse/SLIDER-515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran reopened SLIDER-515:
-----------------------------------
re-opening; the libdir stuff needs to be done separate from the default JVM
options, so that anyone setting jvm opts doesn't unintentionally stop slider
from working
> Ensure Slider clients uploads all jars needed by AppMaster and construct own
> class path
> ----------------------------------------------------------------------------------------
>
> Key: SLIDER-515
> URL: https://issues.apache.org/jira/browse/SLIDER-515
> Project: Slider
> Issue Type: Bug
> Components: appmaster, client
> Affects Versions: Slider 0.50
> Reporter: Sumit Mohanty
> Assignee: Sumit Mohanty
> Priority: Critical
> Fix For: Slider 0.60
>
> Attachments: SLIDER-515.patch
>
>
> Slider needs to ensure that all dependencies (jars) are automatically
> uploaded and available to the AppMaster.
> Proposal:
> Slider client will automatically upload all the required jars for the AM. By
> default, it will pick the jars from <Slider Install Dir>/lib folder. _This is
> what is done today but it only uploads a subset of jars._
> The location to upload from, can be influenced by setting an environment
> variable (SLIDER_LIBS) to an alternate path to libraries. This is needed for
> code embedding slider client - e.g. Slider App View.
> Also, to support embedded client, pass in the path to the libraries as a
> system property to java.
> Slider AM startup will be associated with a classpath that will include:
> * path to Slider config (log4j), check if this is being uploaded as well
> * path to hadoop conf dir
> * path to the uploaded library files
> The downside is duplicate jars - one per application instance and longer
> startup. These two are not critical for Slider apps. In the next releases,
> Slider may switch to using libraries uploaded to HDFS in a version aware
> manner. In this case, slider can be configured with a HDFS path that points
> to the versioned libraries to be used.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
