Sounds like a fit for https://github.com/apache/apex-core/pull/410 ?

On Mon, Jan 16, 2017 at 3:27 AM, Bhupesh Chawda <bhup...@datatorrent.com>
wrote:

> Hi All,
>
> We have a use case where I need to launch a number of DAGs on the cluster
> one after the other in sequence programatically.
>
> We are using the StramAppLauncher and StramAppFactory classes to launch a
> DAG programatically on the cluster and adding any third party dependencies
> as part of the configuration.
>
> It is working fine except for the following issue:
> Every time a DAG is launched, it copies the dependencies to the application
> folder and hence spends a good amount of time before the app actually
> starts running. All of the apps I run belong to the same project and hence
> don't actually need separate set of jars.
>
> Is there any way I can make all the applications "share" the jars which are
> uploaded when the first application is run?
>
> Thanks.
>
> ~ Bhupesh
>

Reply via email to