Thanks Bobby. I have put a similar workaround in our code, wherein we download the jars from HDFS and put them in the worker directory.
On Thu, Aug 6, 2015 at 2:19 AM, Bobby Evans <[email protected]> wrote: > We are working on a distributed cache like system for storm that should > allow you to do this. Please watch > https://issues.apache.org/jira/browse/STORM-876 for more information > about when we merge the basics of it in. > - Bobby > > > On Saturday, August 1, 2015 8:00 AM, Abhishek Agarwal < > [email protected]> wrote: > > > For an end user submitting topologies manually, it is probably easier to > just upload one uber jar. However, we have a system in place where a client > can come and submit the code which will run alongside the system code. In > such case, this system would like to spawn a storm topology and run the > client jar and the system jar. That is not possible right now. > > Also there should not be any dependency conflicts across the topologies, be > it single jar or multiple jars. If the topology is moved to another node, > supervisor should download all the jars just like it downloads the uber > jar. > > On Fri, Jul 31, 2015 at 7:52 PM, Harsha <[email protected]> wrote: > > > Abhishek, > > Can you explain whats your use case and the need for uploading > > multiple jars without packaging together. As others have noted since > storm > > expected to have multiple topologies in ordered to prevent dependency > > conflicts across the topologies its better to submit one jar with all of > > its dependencies included in the jar. > > > > Thanks, > > Harsha > > > > > > On July 29, 2015 at 11:57:19 PM, Abhishek Agarwal ([email protected]) > > wrote: > > > > Currently, as far as I know one has to package all the dependencies into > > one jar and then submit it along with topology class. StormSubmitter > > interface also allows only one jar. Is there any particular reason for > > this > > limitation? > > > > We have a use case where we want to upload more than one jar without > > packaging them together. How could this be achieved? > > > > -- > > Regards, > > Abhishek Agarwal > > > > > > > -- > Regards, > Abhishek Agarwal > > > > -- Regards, Abhishek Agarwal
