I'm okay with a quick turnaround release for this fix. We've got two valid reports of it, and more will follow quickly as users continue to upgrade.
-Taylor > On May 11, 2016, at 11:00 PM, Jungtaek Lim <kabh...@gmail.com> wrote: > > KB, > > Submitted pull request: https://github.com/apache/storm/pull/1412 for 1.x > > Since Storm 1.0.1 was released at May 6, I feel we may want to gather more > bugfixes to prepare next version, and go on release process. > But if we think it's critical or even blocker, we could initiate discussion > for next release immediately. > > Hopefully we can release next version within a month. > > Thanks, > Jungtaek Lim (HeartSaVioR) > > 2016년 5월 11일 (수) 오후 11:34, KB <jam.develo...@gmail.com>님이 작성: >> Hi Jungtaek, >> >> Thanks for providing the snapshot build with this fix. I have verified the >> fix and it is working fine. >> >> Please let me know when can I expect the release with the fix. >> >> Once again thanks a lot for looking into this. >> >>> On Wed, May 11, 2016 at 8:07 AM, Jungtaek Lim <kabh...@gmail.com> wrote: >>> Yes sure, here is storm-core jar 1.0.2 snapshot which just applies >>> STORM-1773 patch into Storm 1.0.1. >>> http://people.apache.org/~kabhwan/storm-core-1.0.2-SNAPSHOT.jar >>> It just changes the version of common-io from 2.4 to 2.5. >>> >>> Please let me know if this works so that I can submit pull request. >>> >>> Thanks in advance! >>> Jungtaek Lim (HeartSaVioR) >>> >>> 2016년 5월 11일 (수) 오전 12:54, KB <jam.develo...@gmail.com>님이 작성: >>>> Thanks for this update. Actually our topology is built on multiple >>>> wrappers on top of Storm. I'll try to create simple topology to reproduce >>>> the problem. Meanwhile would it be possible to create a snapshot release >>>> with the fix. I'll test and let you know. Please let me know. >>>> >>>> Regards, >>>> >>>>> On Tue, May 10, 2016 at 9:39 AM, Jungtaek Lim <kabh...@gmail.com> wrote: >>>>> Filed: https://issues.apache.org/jira/browse/STORM-1773 >>>>> >>>>> KB, >>>>> could you share sample topology which hits serialization issue? I would >>>>> like to check whether patch helps resolving it or not. >>>>> >>>>> 2016년 5월 10일 (화) 오후 12:14, Jungtaek Lim <kabh...@gmail.com>님이 작성: >>>>>> Samuel and KB, >>>>>> >>>>>> I think Storm 1.x hits the bug on commons-io (IO-368). I'll file an >>>>>> issue. >>>>>> >>>>>> Thanks for reporting. >>>>>> >>>>>> Best Regards, >>>>>> Jungtaek Lim (HeartSaVioR) >>>>>> >>>>>> 2016년 5월 10일 (화) 오전 1:33, KB <jam.develo...@gmail.com>님이 작성: >>>>>>> All, >>>>>>> >>>>>>> This problem persists in release 1.0.1 as well. I appreciate if someone >>>>>>> could help fixing this issue. >>>>>>> >>>>>>> Thanks a lot !!! >>>>>>> >>>>>>> >>>>>>> >>>>>>>> On Wed, May 4, 2016 at 7:41 PM, KB <jam.develo...@gmail.com> wrote: >>>>>>>> Thanks for your reply Samuel. >>>>>>>> >>>>>>>> I have setup a very simple topology and not using ObjectMapper or any >>>>>>>> other Jackson classes. Although we are using jackson libraries >>>>>>>> Jackson-core-2.6.2 >>>>>>>> Jackson-databind-2.4.5 >>>>>>>> >>>>>>>> and these versions not changed between Storm version 0.9 and 1.0.0. >>>>>>>> Please let me know if you make any progress on this issue. >>>>>>>> >>>>>>>> Meanwhile would it help if we raise a jira issue to track the problem. >>>>>>>> >>>>>>>> Please advice. >>>>>>>> >>>>>>>> Thanks, >>>>>>>> >>>>>>>> >>>>>>>>> On Tue, May 3, 2016 at 10:17 PM, <samuel.buch...@swisscom.com> wrote: >>>>>>>>> Hi, >>>>>>>>> >>>>>>>>> we had a similar issue (see >>>>>>>>> https://mail-archives.apache.org/mod_mbox/storm-user/201604.mbox/%3C645fd70cb0874be0ac1f1e41a0f9393b%40SG001741.corproot.net%3E >>>>>>>>> ). So far, we have not been able to solve it, but we currently have >>>>>>>>> a suspicion that it might be related to the Jackson ObjectMapper we >>>>>>>>> use. Can I check whether you also use that? >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> With kind regards >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Samuel >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> From: KB [mailto:jam.develo...@gmail.com] >>>>>>>>> Sent: Dienstag, 3. Mai 2016 18:43 >>>>>>>>> To: user@storm.apache.org >>>>>>>>> Subject: Storm 1.0.0 upgrade Serialization issue >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Hello, >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> We have recently upgraded to Storm 1.0.0. Our system was in >>>>>>>>> production for long with Storm 0.9. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Our topology is not getting loaded with this upgrade. It was working >>>>>>>>> fine with 0.9. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> I am getting following error: >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> --------------------------------------------------------------------------- >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> 119662 [Thread-11] ERROR o.a.s.d.worker - Error on initialization of >>>>>>>>> server mk-worker >>>>>>>>> >>>>>>>>> java.lang.RuntimeException: java.lang.ClassNotFoundException: boolean >>>>>>>>> >>>>>>>>> at org.apache.storm.utils.Utils.javaDeserialize(Utils.java:181) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.utils.Utils.getSetComponentObject(Utils.java:430) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.task$get_task_object.invoke(task.clj:74) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.task$mk_task_data$fn__7593.invoke(task.clj:177) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at org.apache.storm.util$assoc_apply_self.invoke(util.clj:930) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.task$mk_task_data.invoke(task.clj:170) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at org.apache.storm.daemon.task$mk_task.invoke(task.clj:181) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.executor$mk_executor$fn__7812.invoke(executor.clj:371) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.core$map$fn__4553.invoke(core.clj:2622) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.RT.seq(RT.java:507) ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core.protocols$seq_reduce.invoke(protocols.clj:30) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core.protocols$fn__6506.invoke(protocols.clj:101) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> clojure.core.protocols$fn__6452$G__6447__6465.invoke(protocols.clj:13) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$reduce.invoke(core.clj:6519) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$into.invoke(core.clj:6600) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.executor$mk_executor.invoke(executor.clj:372) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444$iter__8449__8453$fn__8454.invoke(worker.clj:634) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.Cons.next(Cons.java:39) ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.RT.next(RT.java:674) ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$next__4112.invoke(core.clj:64) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$dorun.invoke(core.clj:3010) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$doall.invoke(core.clj:3025) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto__$reify__8444.run(worker.clj:634) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at java.security.AccessController.doPrivileged(Native Method) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> at javax.security.auth.Subject.doAs(Subject.java:422) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.worker$fn__8442$exec_fn__2453__auto____8443.invoke(worker.clj:606) >>>>>>>>> ~[storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.AFn.applyToHelper(AFn.java:178) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.AFn.applyTo(AFn.java:144) ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$apply.invoke(core.clj:630) >>>>>>>>> ~[clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.worker$fn__8442$mk_worker__8537.doInvoke(worker.clj:580) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.RestFn.invoke(RestFn.java:512) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.supervisor$fn__9357.invoke(supervisor.clj:1200) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.MultiFn.invoke(MultiFn.java:251) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids$iter__8918__8922$fn__8923.invoke(supervisor.clj:380) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.sval(LazySeq.java:40) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.LazySeq.seq(LazySeq.java:49) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.lang.RT.seq(RT.java:507) [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$seq__4128.invoke(core.clj:137) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$dorun.invoke(core.clj:3009) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at clojure.core$doall.invoke(core.clj:3025) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.supervisor$get_valid_new_worker_ids.invoke(supervisor.clj:367) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.daemon.supervisor$sync_processes.invoke(supervisor.clj:428) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.core$partial$fn__4527.invoke(core.clj:2492) >>>>>>>>> [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at >>>>>>>>> org.apache.storm.event$event_manager$fn__8622.invoke(event.clj:40) >>>>>>>>> [storm-core-1.0.0.jar:1.0.0] >>>>>>>>> >>>>>>>>> at clojure.lang.AFn.run(AFn.java:22) [clojure-1.7.0.jar:?] >>>>>>>>> >>>>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51] >>>>>>>>> >>>>>>>>> Caused by: java.lang.ClassNotFoundException: boolean >>>>>>>>> >>>>>>>>> at java.net.URLClassLoader.findClass(URLClassLoader.java:381) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:424) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> at >>>>>>>>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> at java.lang.ClassLoader.loadClass(ClassLoader.java:357) >>>>>>>>> ~[?:1.8.0_51] >>>>>>>>> >>>>>>>>> ---------------------------------------------------------------------------------------------------------------------- >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> It seems some serialization issue with primitives.I appreciate any >>>>>>>>> help to resolve this issue. >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> Thanks a ton.
