My submit command is : /home/storm/apache-storm-1.0.2/bin/storm jar storm-dpi-0.0.1.jar MainTopology
Submit argument should be right. When I submit the topology just containing a kafkaspout, it works well. Then I added more bolt components, this submit issue occurs. After that even I reduce my topology to original structure(only kafkaspout), the submission is still failed. The complete error message is much similar to what I published before, that is: 4573 [main] INFO o.a.s.l.Localizer - Reconstruct localized resource: /tmp/ee2cf27b-f31a-4f85-8e57-60b8a0d5de2f/supervisor/usercache 4573 [main] WARN o.a.s.l.Localizer - No left over resources found for any user during reconstructing of local resources at: /tmp/ee2cf27b-f31a-4f85-8e57-60b8a0d5de2f/supervisor/usercache 4574 [main] WARN o.a.s.s.o.a.c.CuratorZookeeperClient - session timeout [3000] is less than connection timeout [15000] 4575 [main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting 4575 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:2000 sessionTimeout=3000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@7f97bc14 4578 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server localhost/127.0.0.1:2000. Will not attempt to authenticate using SASL (unknown error) 4578 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /127.0.0.1:51407 4578 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to localhost/127.0.0.1:2000, initiating session 4579 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /127.0.0.1:51407 4580 [SyncThread:0] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x1574fdf080e000b with negotiated timeout 4000 for client /127.0.0.1:51407 4580 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server localhost/127.0.0.1:2000, sessionid = 0x1574fdf080e000b, negotiated timeout = 4000 4581 [main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED 4581 [main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update: :connected:none 4583 [Curator-Framework-0] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - backgroundOperationsLoop exiting 4584 [ProcessThread(sid:0 cport:-1):] INFO o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for sessionid: 0x1574fdf080e000b 4586 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x1574fdf080e000b closed 4586 [main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down 4587 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client /127.0.0.1:51407 which had sessionid 0x1574fdf080e000b 4587 [main] WARN o.a.s.s.o.a.c.CuratorZookeeperClient - session timeout [3000] is less than connection timeout [15000] 4588 [main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting 4588 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection, connectString=localhost:2000/storm-v1 sessionTimeout=3000 watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@5e002356 4590 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening socket connection to server localhost/0:0:0:0:0:0:0:1:2000. Will not attempt to authenticate using SASL (unknown error) 4590 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket connection established to localhost/0:0:0:0:0:0:0:1:2000, initiating session 4590 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from /0:0:0:0:0:0:0:1:37877 4591 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at /0:0:0:0:0:0:0:1:37877 4592 [SyncThread:0] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session 0x1574fdf080e000c with negotiated timeout 4000 for client /0:0:0:0:0:0:0:1:37877 4592 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Session establishment complete on server localhost/0:0:0:0:0:0:0:1:2000, sessionid = 0x1574fdf080e000c, negotiated timeout = 4000 4592 [main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State change: CONNECTED 4639 [client-worker-1] INFO o.a.s.p.PacemakerClientHandler - Connection established from /132.228.28.138:51282 to storm02/132.228.28.137:6699 4652 [main] INFO o.a.s.d.supervisor - Starting supervisor with id 007b96b0-980b-48b1-91e9-004b71cf09af at host storm03 4706 [main] INFO o.a.s.l.ThriftAccessLogger - Request ID: 1 access from: principal: operation: submitTopology 4722 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology name='DPI') #error { :cause nil :via [{:type org.apache.storm.generated.InvalidTopologyException :message nil :at [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196 invoke nimbus.clj 1462]}] :trace [[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196 invoke nimbus.clj 1462] [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195 submitTopologyWithOpts nimbus.clj 1459] [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195 submitTopology nimbus.clj 1531] [sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java -2] [sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62] [sun.reflect.DelegatingMethodAccessorImpl invoke DelegatingMethodAccessorImpl.java 43] [java.lang.reflect.Method invoke Method.java 498] [clojure.lang.Reflector invokeMatchingMethod Reflector.java 93] [clojure.lang.Reflector invokeInstanceMethod Reflector.java 28] [org.apache.storm.testing$submit_local_topology invoke testing.clj 301] [org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49] [org.apache.storm.LocalCluster submitTopology nil -1] [MainTopology main MainTopology.java 182]]} 4722 [main] ERROR o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Thread Thread[main,5,main] died org.apache.storm.generated.InvalidTopologyException at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196.invoke(nimbus.clj:1462) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopologyWithOpts(nimbus.clj:1459) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopology(nimbus.clj:1531) ~[storm-core-1.0.2.jar:1.0.2] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_102] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102] at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.7.0.jar:?] at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.7.0.jar:?] at org.apache.storm.testing$submit_local_topology.invoke(testing.clj:301) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.LocalCluster$_submitTopology.invoke(LocalCluster.clj:49) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.LocalCluster.submitTopology(Unknown Source) ~[storm-core-1.0.2.jar:1.0.2] at MainTopology.main(MainTopology.java:182) ~[storm-dpi-0.0.1.jar:?] 4872 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673 4887 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar) 4895 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser) 4901 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser) 4902 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913 4911 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar) 4917 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser) 4924 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser) 4924 [timer] INFO o.a.s.d.nimbus - Cleaning up api-10-1473325273 4933 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormjar.jar) 4940 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormconf.ser) 4946 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormcode.ser) 4946 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-17-1474162982 4955 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormjar.jar) 4961 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormconf.ser) 4967 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormcode.ser) 14987 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673 14995 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar) 15001 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser) 15008 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser) 15008 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913 15016 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar) 15022 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser) 15028 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser) 15028 [timer] INFO o.a.s.d.nimbus - Cleaning up api-10-1473325273 15036 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormjar.jar) 15042 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormconf.ser) 15048 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-10-1473325273-stormcode.ser) 15048 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-17-1474162982 15057 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormjar.jar) 15063 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormconf.ser) 15069 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormcode.ser) 发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用 发件人: Jungtaek Lim<mailto:kabh...@gmail.com> 发送时间: 2016年9月22日 7:28 收件人: Chen Junfeng<mailto:darou...@live.com>; user@storm.apache.org<mailto:user@storm.apache.org> 主题: Re: Cannot submit topology in local mode on Storm 1.0.1 Unfortunately without the minimal code which can reproduce this I'm hard to dig more. I followed the path based on stack trace, and it would be IllegalArgumentException, but it should have message which describes why it is thrown. Do you find more stack trace informations on that? - Jungtaek Lim (HeartSaVioR) 2016? 9? 21? (?) ?? 3:07, Chen Junfeng <darou...@live.com<mailto:darou...@live.com>>?? ??: I have tried on Storm 1.0.2, the same error occurs again: 4774 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology name='DPI') #error { :cause nil :via [{:type org.apache.storm.generated.InvalidTopologyException :message nil :at [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196 invoke nimbus.clj 1462]}] :trace [[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196 invoke nimbus.clj 1462] [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195 submitTopologyWithOpts nimbus.clj 1459] [org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195 submitTopology nimbus.clj 1531] [sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java -2] [sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62] [sun.reflect.DelegatingMethodAccessorImpl invoke DelegatingMethodAccessorImpl.java 43] [java.lang.reflect.Method invoke Method.java 498] [clojure.lang.Reflector invokeMatchingMethod Reflector.java 93] [clojure.lang.Reflector invokeInstanceMethod Reflector.java 28] [org.apache.storm.testing$submit_local_topology invoke testing.clj 301] [org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49] [org.apache.storm.LocalCluster submitTopology nil -1] [MainTopology main MainTopology.java 182]]} 4774 [main] ERROR o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Thread Thread[main,5,main] died org.apache.storm.generated.InvalidTopologyException at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196.invoke(nimbus.clj:1462) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopologyWithOpts(nimbus.clj:1459) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopology(nimbus.clj:1531) ~[storm-core-1.0.2.jar:1.0.2] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_102] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_102] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_102] at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102] at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93) ~[clojure-1.7.0.jar:?] at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28) ~[clojure-1.7.0.jar:?] at org.apache.storm.testing$submit_local_topology.invoke(testing.clj:301) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.LocalCluster$_submitTopology.invoke(LocalCluster.clj:49) ~[storm-core-1.0.2.jar:1.0.2] at org.apache.storm.LocalCluster.submitTopology(Unknown Source) ~[storm-core-1.0.2.jar:1.0.2] at MainTopology.main(MainTopology.java:182) ~[storm-dpi-0.0.1.jar:?] 4899 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673 4916 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar) 4928 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser) 4935 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser) 4935 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913 4946 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar) 4952 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser) 4958 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser) 4959 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-13-1473749244 4968 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormjar.jar) 4975 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormconf.ser) 4981 [timer] INFO o.a.s.d.nimbus - ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormcode.ser) 发件人: Jungtaek Lim<mailto:kabh...@gmail.com> 发送时间: 2016年9月20日 16:38 收件人: user@storm.apache.org<mailto:user@storm.apache.org> 主题: Re: Cannot submit topology in local mode on Storm 1.0.1 Hi Chen, Could you try running your topology with Storm 1.0.2 in local mode? Since it's in local mode you can easily try it out. Thanks, Jungtaek Lim (HeartSaVioR) 2016? 9? 20? (?) ?? 5:26, Chen Junfeng <k-2f...@hotmail.com<mailto:k-2f...@hotmail.com>>?? ??: My topology runs well in cluster mode but throws exceptions when it is submitted in local mode. It makes the debug work so tough. The error is: 4842 [main] INFO o.a.s.l.ThriftAccessLogger - Request ID: 1 access from: principal: operation: submitTopology 4857 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology name='DPI') #error { :cause nil :via [{:type org.apache.storm.generated.InvalidTopologyException :message nil :at [org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093$fn__7094 invoke nimbus.clj 1475]}] :trace [[org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093$fn__7094 invoke nimbus.clj 1475] [org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093 submitTopologyWithOpts nimbus.clj 1472] [org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093 submitTopology nimbus.clj 1544] [sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java -2] [sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62] [sun.reflect.DelegatingMethodAccessorImpl invoke DelegatingMethodAccessorImpl.java 43] [java.lang.reflect.Method invoke Method.java 498] [clojure.lang.Reflector invokeMatchingMethod Reflector.java 93] [clojure.lang.Reflector invokeInstanceMethod Reflector.java 28] [org.apache.storm.testing$submit_local_topology invoke testing.clj 301] [org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49] [org.apache.storm.LocalCluster submitTopology nil -1] [MainTopology main MainTopology.java 178]]} No detailed error message can be found in error log. Thanks. Regards, Junfeng Chen