Hi Idan,
Zitat von Idan Fridman <[email protected]>:
Hi All,
I wonder if anyone could have any insights about this? should I add
additional logs/details? anything else to determine the source problem?
thank you.
2014-12-23 14:58 GMT+02:00 Idan Fridman <[email protected]>:
I have submitted simple storm topology on a local cluster mode
using LocalCluster on windows env for development/testing purposes.
I created kafka spout and tested my topology by sending(via separate
process) messages.
I am trying to send 10,000 messages with delay of one sec between each.
for ~7000 messages everything worked as expected(received and processed by
the topology) but after a few more the app is crushing unexpectedly and I
find that error on console:
14:40:28,925 INFO supervisor:0 - Downloading code for storm id
push-message-topology-1-1419336027 from
C:\Users\EXT_ID~1\AppData\Local\Temp\282695d8-eee9-4cb4-ae7a-7aae70eeec68\nimbus\stormdist\push-message-topology-1-1419336027
14:40:28,927 ERROR event:0 - Error when processing event
java.io.FileNotFoundException: Source
'C:\Users\EXT_ID~1\AppData\Local\Temp\282695d8-eee9-4cb4-ae7a-7aae70eeec68\nimbus\stormdist\push-message-topology-1-1419336027'
does not exist
this indicates that the supervisor tried to access the jar containing
your topology. It probably does no longer exist at that location
because of one of the timeouts concerning the jar
("nimbus.inbox.jar.expiration.secs"?)
at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1368)
at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1261)
at org.apache.commons.io.FileUtils.copyDirectory(FileUtils.java:1230)
at backtype.storm.daemon.supervisor$fn__5021.invoke(supervisor.clj:512)
at clojure.lang.MultiFn.invoke(MultiFn.java:236)
at
backtype.storm.daemon.supervisor$mk_synchronize_supervisor$this__4917.invoke(supervisor.clj:325)
at backtype.storm.event$event_manager$fn__2379.invoke(event.clj:39)
at clojure.lang.AFn.run(AFn.java:24)
at java.lang.Thread.run(Thread.java:745)
14:40:28,932 INFO util:0 - Halting process: ("Error when processing an
event")
Process finished with exit code 20
Any idea what's the cause?
That the supervisor tries to access the jar seems to indicate that a
new worker was started. Do you see any preceeding error from the
original worker instance?
Regards,
Jens
