Hi Carlos, Just a wild guess here, but when you compile your source into a new class you are defining a new class which will only be available in the JVM where you compiled it, since it's not part of the built-time classpath and not distributed with your app. Therefore you will need to send the class bytes along with the serialized instance to the other JVM. On the receiving JVM you will need to define your own classloader, call defineClass with the class bytes (similar to the NetworkClassLoader example at https://docs.oracle.com/javase/7/docs/api/java/lang/ClassLoader.html) and then de-serialize the instance. This should work.
Best regards, Alexander On Thu, Mar 10, 2016 at 2:15 PM, Carlos Chávez <[email protected]> wrote: > Hi John. > > But that should be done at build time, right? > > The thing is that I have already packed the fat jar and there is this > class that submit the topology, in this class I read from somewhere the > source code of the class and compile at runtime, but then when the bolt > try to deseralize the object it throw the class not found error. > > On 03/10/2016 12:52 AM, John Fang wrote: > > You can put the needed compiled classes in the directory: your > topology's src/main/resources, then you package your topology with > resources. If you submit the topology, storm will extract the needed the > compiled classes to a directory which is in the worker's scope. So the > spout/bolt can find the classes. > > > > Regards > > John Fang > > > > > > -----邮件原件----- > > 发件人: "Carlos Chávez" [mailto:[email protected]] > > 发送时间: 2016年3月10日 11:29 > > 收件人: [email protected] > > 主题: Dynamic compiled object/classes and topology > > > > Hi All. > > > > I have some bolt that compile some classes from a string, my classes are > in Scala and I use ToolBox to compile. The compile is done in the prepare > method and that work fine. Then in the execute method I'm able to call the > methods from this classes. > > > > The thing is that compile the classes take some time mostly because > there are many thread compiling the same set of classes. I was trying to > reduce the time compiling of classes before summit the topology, I was able > to pass the compiled objects to the bolt and when the bolt deserialize the > object it throw the class not found error. > > > > I suspect that when I submit the topology the compiled classes are not > in scope, not sure if the class loader when submit the topology is reset or > something. > > > > So, is there a way to add this dynamic compiled object/classes to the > topology at runtime? > > > > ---- > > Cheers. > > Carlos Chávez. > > > > > -- > Saludos. > Carlos Chávez. > AG Software, S.A. >
