GitHub user HeartSaVioR opened a pull request:
https://github.com/apache/storm/pull/1626
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission
PR for 1.x is here: #1608
storm-submit is copied version of 1.x, but I have to reimplement (port to
Java) some part of storm-core. So please have a look thoughtfully when
reviewing files on storm-core.
I also fixed a bug from outside of pull request regarding symbolic link.
@harshach @satishd
Please review this when you have some time. Thanks!
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HeartSaVioR/storm STORM-2016
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/1626.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1626
----
commit 97615a4b5e9c3567ffd5b0642b60fc8e55e713ef
Author: Jungtaek Lim <[email protected]>
Date: 2016-08-12T13:58:08Z
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission
*NOTE* This contains a bugfix at creating symbolic link
* bin/storm now supports "--jars" and "--artifacts" options
** it's only effective with "storm jar" and "storm sql"
* introduce new module: storm-submit to help resolving dependencies with
handling transitive dependencies
* StormSubmitter will upload dependencies to BlobStore when submitting
topology
** StormSubmitter will remove jars blobs when topology submission fails
*** remove jar blobs when only one of AlreadyAliveException,
InvalidTopologyException, AuthorizationException occurs
* Supervisor will download dependencies from BlobStore when such topology
is assigned
* Supervisor will launch workers with adding downloaded dependencies to
worker classpath
* Nimbus will remove jars from BlobStore when topology is killed
** don't remove artifacts from blobstore since it's shared across topologies
* add options to document (Command-line-client.md) and also storm.py
** it will be printed out when 'help jar' and 'help sql' is called
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
