My submit command is : /home/storm/apache-storm-1.0.2/bin/storm jar
storm-dpi-0.0.1.jar MainTopology
Submit argument should be right. When I submit the topology just containing a
kafkaspout, it works well. Then I added more bolt components, this submit issue
occurs. After that even I reduce my topology to original structure(only
kafkaspout), the submission is still failed.
The complete error message is much similar to what I published before, that is:
4573 [main] INFO o.a.s.l.Localizer - Reconstruct localized resource:
/tmp/ee2cf27b-f31a-4f85-8e57-60b8a0d5de2f/supervisor/usercache
4573 [main] WARN o.a.s.l.Localizer - No left over resources found for any user
during reconstructing of local resources at:
/tmp/ee2cf27b-f31a-4f85-8e57-60b8a0d5de2f/supervisor/usercache
4574 [main] WARN o.a.s.s.o.a.c.CuratorZookeeperClient - session timeout [3000]
is less than connection timeout [15000]
4575 [main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
4575 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection,
connectString=localhost:2000 sessionTimeout=3000
watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@7f97bc14
4578 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening
socket connection to server localhost/127.0.0.1:2000. Will not attempt to
authenticate using SASL (unknown error)
4578 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from
/127.0.0.1:51407
4578 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket
connection established to localhost/127.0.0.1:2000, initiating session
4579 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at
/127.0.0.1:51407
4580 [SyncThread:0] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session
0x1574fdf080e000b with negotiated timeout 4000 for client /127.0.0.1:51407
4580 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Session
establishment complete on server localhost/127.0.0.1:2000, sessionid =
0x1574fdf080e000b, negotiated timeout = 4000
4581 [main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State
change: CONNECTED
4581 [main-EventThread] INFO o.a.s.zookeeper - Zookeeper state update:
:connected:none
4583 [Curator-Framework-0] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl -
backgroundOperationsLoop exiting
4584 [ProcessThread(sid:0 cport:-1):] INFO
o.a.s.s.o.a.z.s.PrepRequestProcessor - Processed session termination for
sessionid: 0x1574fdf080e000b
4586 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Session: 0x1574fdf080e000b closed
4586 [main-EventThread] INFO o.a.s.s.o.a.z.ClientCnxn - EventThread shut down
4587 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
o.a.s.s.o.a.z.s.NIOServerCnxn - Closed socket connection for client
/127.0.0.1:51407 which had sessionid 0x1574fdf080e000b
4587 [main] WARN o.a.s.s.o.a.c.CuratorZookeeperClient - session timeout [3000]
is less than connection timeout [15000]
4588 [main] INFO o.a.s.s.o.a.c.f.i.CuratorFrameworkImpl - Starting
4588 [main] INFO o.a.s.s.o.a.z.ZooKeeper - Initiating client connection,
connectString=localhost:2000/storm-v1 sessionTimeout=3000
watcher=org.apache.storm.shade.org.apache.curator.ConnectionState@5e002356
4590 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Opening
socket connection to server localhost/0:0:0:0:0:0:0:1:2000. Will not attempt to
authenticate using SASL (unknown error)
4590 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Socket
connection established to localhost/0:0:0:0:0:0:0:1:2000, initiating session
4590 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Accepted socket connection from
/0:0:0:0:0:0:0:1:37877
4591 [NIOServerCxn.Factory:0.0.0.0/0.0.0.0:2000] INFO
o.a.s.s.o.a.z.s.ZooKeeperServer - Client attempting to establish new session at
/0:0:0:0:0:0:0:1:37877
4592 [SyncThread:0] INFO o.a.s.s.o.a.z.s.ZooKeeperServer - Established session
0x1574fdf080e000c with negotiated timeout 4000 for client /0:0:0:0:0:0:0:1:37877
4592 [main-SendThread(localhost:2000)] INFO o.a.s.s.o.a.z.ClientCnxn - Session
establishment complete on server localhost/0:0:0:0:0:0:0:1:2000, sessionid =
0x1574fdf080e000c, negotiated timeout = 4000
4592 [main-EventThread] INFO o.a.s.s.o.a.c.f.s.ConnectionStateManager - State
change: CONNECTED
4639 [client-worker-1] INFO o.a.s.p.PacemakerClientHandler - Connection
established from /132.228.28.138:51282 to storm02/132.228.28.137:6699
4652 [main] INFO o.a.s.d.supervisor - Starting supervisor with id
007b96b0-980b-48b1-91e9-004b71cf09af at host storm03
4706 [main] INFO o.a.s.l.ThriftAccessLogger - Request ID: 1 access from:
principal: operation: submitTopology
4722 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology
name='DPI') #error {
:cause nil
:via
[{:type org.apache.storm.generated.InvalidTopologyException
:message nil
:at
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196
invoke nimbus.clj 1462]}]
:trace
[[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196
invoke nimbus.clj 1462]
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195
submitTopologyWithOpts nimbus.clj 1459]
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195
submitTopology nimbus.clj 1531]
[sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java
-2]
[sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62]
[sun.reflect.DelegatingMethodAccessorImpl invoke
DelegatingMethodAccessorImpl.java 43]
[java.lang.reflect.Method invoke Method.java 498]
[clojure.lang.Reflector invokeMatchingMethod Reflector.java 93]
[clojure.lang.Reflector invokeInstanceMethod Reflector.java 28]
[org.apache.storm.testing$submit_local_topology invoke testing.clj 301]
[org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49]
[org.apache.storm.LocalCluster submitTopology nil -1]
[MainTopology main MainTopology.java 182]]}
4722 [main] ERROR o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Thread
Thread[main,5,main] died
org.apache.storm.generated.InvalidTopologyException
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196.invoke(nimbus.clj:1462)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopologyWithOpts(nimbus.clj:1459)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopology(nimbus.clj:1531)
~[storm-core-1.0.2.jar:1.0.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_102]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_102]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_102]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
~[clojure-1.7.0.jar:?]
at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
~[clojure-1.7.0.jar:?]
at
org.apache.storm.testing$submit_local_topology.invoke(testing.clj:301)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.LocalCluster$_submitTopology.invoke(LocalCluster.clj:49)
~[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.LocalCluster.submitTopology(Unknown Source)
~[storm-core-1.0.2.jar:1.0.2]
at MainTopology.main(MainTopology.java:182) ~[storm-dpi-0.0.1.jar:?]
4872 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673
4887 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar)
4895 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser)
4901 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser)
4902 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913
4911 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar)
4917 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser)
4924 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser)
4924 [timer] INFO o.a.s.d.nimbus - Cleaning up api-10-1473325273
4933 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormjar.jar)
4940 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormconf.ser)
4946 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormcode.ser)
4946 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-17-1474162982
4955 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormjar.jar)
4961 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormconf.ser)
4967 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormcode.ser)
14987 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673
14995 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar)
15001 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser)
15008 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser)
15008 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913
15016 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar)
15022 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser)
15028 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser)
15028 [timer] INFO o.a.s.d.nimbus - Cleaning up api-10-1473325273
15036 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormjar.jar)
15042 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormconf.ser)
15048 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-10-1473325273-stormcode.ser)
15048 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-17-1474162982
15057 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormjar.jar)
15063 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormconf.ser)
15069 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-17-1474162982-stormcode.ser)
发送自 Windows 10 版邮件<https://go.microsoft.com/fwlink/?LinkId=550986>应用
发件人: Jungtaek Lim<mailto:[email protected]>
发送时间: 2016年9月22日 7:28
收件人: Chen Junfeng<mailto:[email protected]>;
[email protected]<mailto:[email protected]>
主题: Re: Cannot submit topology in local mode on Storm 1.0.1
Unfortunately without the minimal code which can reproduce this I'm hard to dig
more.
I followed the path based on stack trace, and it would be
IllegalArgumentException, but it should have message which describes why it is
thrown.
Do you find more stack trace informations on that?
- Jungtaek Lim (HeartSaVioR)
2016? 9? 21? (?) ?? 3:07, Chen Junfeng
<[email protected]<mailto:[email protected]>>?? ??:
I have tried on Storm 1.0.2, the same error occurs again:
4774 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology
name='DPI') #error {
:cause nil
:via
[{:type org.apache.storm.generated.InvalidTopologyException
:message nil
:at
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196
invoke nimbus.clj 1462]}]
:trace
[[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196
invoke nimbus.clj 1462]
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195
submitTopologyWithOpts nimbus.clj 1459]
[org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195
submitTopology nimbus.clj 1531]
[sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java
-2]
[sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62]
[sun.reflect.DelegatingMethodAccessorImpl invoke
DelegatingMethodAccessorImpl.java 43]
[java.lang.reflect.Method invoke Method.java 498]
[clojure.lang.Reflector invokeMatchingMethod Reflector.java 93]
[clojure.lang.Reflector invokeInstanceMethod Reflector.java 28]
[org.apache.storm.testing$submit_local_topology invoke testing.clj 301]
[org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49]
[org.apache.storm.LocalCluster submitTopology nil -1]
[MainTopology main MainTopology.java 182]]}
4774 [main] ERROR o.a.s.s.o.a.z.s.NIOServerCnxnFactory - Thread
Thread[main,5,main] died
org.apache.storm.generated.InvalidTopologyException
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195$fn__7196.invoke(nimbus.clj:1462)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopologyWithOpts(nimbus.clj:1459)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.daemon.nimbus$fn__7166$exec_fn__2466__auto__$reify__7195.submitTopology(nimbus.clj:1531)
~[storm-core-1.0.2.jar:1.0.2]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
~[?:1.8.0_102]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
~[?:1.8.0_102]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_102]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
~[clojure-1.7.0.jar:?]
at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
~[clojure-1.7.0.jar:?]
at
org.apache.storm.testing$submit_local_topology.invoke(testing.clj:301)
~[storm-core-1.0.2.jar:1.0.2]
at
org.apache.storm.LocalCluster$_submitTopology.invoke(LocalCluster.clj:49)
~[storm-core-1.0.2.jar:1.0.2]
at org.apache.storm.LocalCluster.submitTopology(Unknown Source)
~[storm-core-1.0.2.jar:1.0.2]
at MainTopology.main(MainTopology.java:182) ~[storm-dpi-0.0.1.jar:?]
4899 [timer] INFO o.a.s.d.nimbus - Cleaning up api-6-1473314673
4916 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormjar.jar)
4928 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormconf.ser)
4935 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:api-6-1473314673-stormcode.ser)
4935 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-15-1473765913
4946 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormjar.jar)
4952 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormconf.ser)
4958 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-15-1473765913-stormcode.ser)
4959 [timer] INFO o.a.s.d.nimbus - Cleaning up DPI-13-1473749244
4968 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormjar.jar)
4975 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormconf.ser)
4981 [timer] INFO o.a.s.d.nimbus -
ExceptionKeyNotFoundException(msg:DPI-13-1473749244-stormcode.ser)
发件人: Jungtaek Lim<mailto:[email protected]>
发送时间: 2016年9月20日 16:38
收件人: [email protected]<mailto:[email protected]>
主题: Re: Cannot submit topology in local mode on Storm 1.0.1
Hi Chen,
Could you try running your topology with Storm 1.0.2 in local mode? Since it's
in local mode you can easily try it out.
Thanks,
Jungtaek Lim (HeartSaVioR)
2016? 9? 20? (?) ?? 5:26, Chen Junfeng
<[email protected]<mailto:[email protected]>>?? ??:
My topology runs well in cluster mode but throws exceptions when it is
submitted in local mode. It makes the debug work so tough.
The error is:
4842 [main] INFO o.a.s.l.ThriftAccessLogger - Request ID: 1 access from:
principal: operation: submitTopology
4857 [main] WARN o.a.s.d.nimbus - Topology submission exception. (topology
name='DPI') #error {
:cause nil
:via
[{:type org.apache.storm.generated.InvalidTopologyException
:message nil
:at
[org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093$fn__7094
invoke nimbus.clj 1475]}]
:trace
[[org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093$fn__7094
invoke nimbus.clj 1475]
[org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093
submitTopologyWithOpts nimbus.clj 1472]
[org.apache.storm.daemon.nimbus$fn__7064$exec_fn__2461__auto__$reify__7093
submitTopology nimbus.clj 1544]
[sun.reflect.NativeMethodAccessorImpl invoke0 NativeMethodAccessorImpl.java
-2]
[sun.reflect.NativeMethodAccessorImpl invoke NativeMethodAccessorImpl.java 62]
[sun.reflect.DelegatingMethodAccessorImpl invoke
DelegatingMethodAccessorImpl.java 43]
[java.lang.reflect.Method invoke Method.java 498]
[clojure.lang.Reflector invokeMatchingMethod Reflector.java 93]
[clojure.lang.Reflector invokeInstanceMethod Reflector.java 28]
[org.apache.storm.testing$submit_local_topology invoke testing.clj 301]
[org.apache.storm.LocalCluster$_submitTopology invoke LocalCluster.clj 49]
[org.apache.storm.LocalCluster submitTopology nil -1]
[MainTopology main MainTopology.java 178]]}
No detailed error message can be found in error log.
Thanks.
Regards，
Junfeng Chen
