[
https://issues.apache.org/jira/browse/STORM-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15408850#comment-15408850
]
ASF GitHub Bot commented on STORM-2016:
---------------------------------------
GitHub user HeartSaVioR opened a pull request:
https://github.com/apache/storm/pull/1608
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission (1.x)
* JIRA issue: http://issues.apache.org/jira/browse/STORM-2016
* design doc:
https://cwiki.apache.org/confluence/display/STORM/A.+Design+doc%3A+adding+jars+and+maven+artifacts+at+submission
* discussion thread:
http://mail-archives.apache.org/mod_mbox/storm-dev/201608.mbox/%3ccaf5108i9+tjanz0lgrktmkvqel7f+53k9uyzxct6zhsu6oh...@mail.gmail.com%3E
----
* bin/storm now supports "--jars" and "--packages" options
* it's only effective with "storm jar" and "storm sql"
* introduce new module: storm-submit to help resolving dependencies with
handling transitive dependencies
* StormSubmitter will upload dependencies to BlobStore when submitting
topology
* Supervisor will download dependencies from BlobStore when such topology
is assigned
* Supervisor will launch workers with adding downloaded dependencies to
worker classpath
TODO
* documentation - [ ]
* craft pull request against master branch - [ ]
Btw, it might be better to place some modules out of external since
'external' has most of non storm-core modules and flux, sql, storm-submit,
storm-kafka-monitor are not kind of connectors.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/HeartSaVioR/storm STORM-2016-1.x
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/storm/pull/1608.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1608
----
commit e027652eb30f3c3b3a549a24d4105f9dd1e8e45e
Author: Jungtaek Lim <[email protected]>
Date: 2016-08-04T00:52:45Z
STORM-2016 Topology submission improvement: support adding local jars and
maven artifacts on submission
* bin/storm now supports "--jars" and "--packages" options
** it's only effective with "storm jar" and "storm sql"
* introduce new module: storm-submit to help resolving dependencies with
handling transitive dependencies
* StormSubmitter will upload dependencies to BlobStore when submitting
topology
* Supervisor will download dependencies from BlobStore when such topology
is assigned
* Supervisor will launch workers with adding downloaded dependencies to
worker classpath
----
> Topology submission improvement: support adding local jars and maven
> artifacts on submission
> --------------------------------------------------------------------------------------------
>
> Key: STORM-2016
> URL: https://issues.apache.org/jira/browse/STORM-2016
> Project: Apache Storm
> Issue Type: Improvement
> Components: storm-core
> Reporter: Jungtaek Lim
> Assignee: Jungtaek Lim
>
> This JIRA tracks actual work on below proposal / design document.
> https://cwiki.apache.org/confluence/display/STORM/A.+Design+doc%3A+adding+jars+and+maven+artifacts+at+submission
> Proposal discussion thread is here:
> http://mail-archives.apache.org/mod_mbox/storm-dev/201608.mbox/%3ccaf5108i9+tjanz0lgrktmkvqel7f+53k9uyzxct6zhsu6oh...@mail.gmail.com%3E
> Let's post on discussion thread if we have any opinions / ideas on this
> instead of leaving comments on this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
