GitHub user HeartSaVioR opened a pull request:
https://github.com/apache/storm/pull/1608
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission (1.x)
* JIRA issue: http://issues.apache.org/jira/browse/STORM-2016
* design doc:
https://cwiki.apache.org/confluence/display/STORM/A.+Design+doc%3A+adding+jars+and+maven+artifacts+at+submission
* discussion thread:
http://mail-archives.apache.org/mod_mbox/storm-dev/201608.mbox/%3ccaf5108i9+tjanz0lgrktmkvqel7f+53k9uyzxct6zhsu6oh...@mail.gmail.com%3E
----
* bin/storm now supports "--jars" and "--packages" options
* it's only effective with "storm jar" and "storm sql"
* introduce new module: storm-submit to help resolving dependencies with
handling transitive dependencies
* StormSubmitter will upload dependencies to BlobStore when submitting
topology
* Supervisor will download dependencies from BlobStore when such topology
is assigned
* Supervisor will launch workers with adding downloaded dependencies to
worker classpath
TODO
* documentation - [ ]
* craft pull request against master branch - [ ]
Btw, it might be better to place some modules out of external since
'external' has most of non storm-core modules and flux, sql, storm-submit,
storm-kafka-monitor are not kind of connectors.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HeartSaVioR/storm STORM-2016-1.x
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/1608.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1608
----
commit e027652eb30f3c3b3a549a24d4105f9dd1e8e45e
Author: Jungtaek Lim <[email protected]>
Date: 2016-08-04T00:52:45Z
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission
* bin/storm now supports "--jars" and "--packages" options
** it's only effective with "storm jar" and "storm sql"
* introduce new module: storm-submit to help resolving dependencies with
handling transitive dependencies
* StormSubmitter will upload dependencies to BlobStore when submitting
topology
* Supervisor will download dependencies from BlobStore when such topology
is assigned
* Supervisor will launch workers with adding downloaded dependencies to
worker classpath
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
