Hi, all
Something seems to be wrong with my storm cluster, I got back and run
wordcount in storm-starter, here is the error
7031 [Thread-8-count] INFO backtype.storm.daemon.executor - Processing
received message source: split:6, stream: default, id: {}, ["ago"]
7031 [Thread-8-count] INFO backtype.storm.daemon.task - Emitting: count
default [ago, 7]
7031 [Thread-19] INFO backtype.storm.task.ShellBolt - ShellLog pid:6484,
name:split Traceback (most recent call last):
File
"/tmp/d883913c-2d6c-47a9-87c3-c5631bda06ba/supervisor/stormdist/word-count-1-1418147788/resources/storm.py",
line 172, in run
self.process(tup)
File "splitsentence.py", line 5, in process
words = tup.values[0].split(" ")
IndexError: list index out of range
7036 [Thread-19] ERROR backtype.storm.task.ShellBolt - Halting process:
ShellBolt died.
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException:
Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
at
backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:318)
~[storm-core-0.9.3.jar:0.9.3]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
7037 [Thread-19] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: backtype.storm.multilang.NoOutputException:
Pipe to subprocess seems to be broken! No output read.
Serializer Exception:
at
backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:318)
~[storm-core-0.9.3.jar:0.9.3]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
7044 [Thread-26-spout] INFO backtype.storm.daemon.task - Emitting: spout
default [the cow jumped over the moon]
7045 [Thread-16-split] INFO backtype.storm.daemon.executor - Processing
received message source: spout:9, stream: default, id: {}, [the cow jumped
over the moon]
7045 [Thread-16-split] ERROR backtype.storm.util - Async loop died!
java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.RuntimeException: pid:6484, name:split exitCode:0, errorString:
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:128)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$fn__3441$fn__3453$fn__3500.invoke(executor.clj:748)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463)
~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
pid:6484, name:split exitCode:0, errorString:
at backtype.storm.task.ShellBolt.execute(ShellBolt.java:136)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$fn__3441$tuple_action_fn__3443.invoke(executor.clj:633)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$mk_task_receiver$fn__3364.invoke(executor.clj:401)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.disruptor$clojure_handler$reify__1447.onEvent(disruptor.clj:58)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125)
~[storm-core-0.9.3.jar:0.9.3]
... 6 common frames omitted
Caused by: java.lang.RuntimeException: pid:6484, name:split exitCode:0,
errorString:
at backtype.storm.task.ShellBolt.die(ShellBolt.java:281)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.task.ShellBolt.access$400(ShellBolt.java:69)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:341)
~[storm-core-0.9.3.jar:0.9.3]
... 1 common frames omitted
Caused by: java.lang.RuntimeException:
backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be
broken! No output read.
Serializer Exception:
at
backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:318)
~[storm-core-0.9.3.jar:0.9.3]
... 1 common frames omitted
7046 [Thread-16-split] ERROR backtype.storm.daemon.executor -
java.lang.RuntimeException: java.lang.RuntimeException:
java.lang.RuntimeException: pid:6484, name:split exitCode:0, errorString:
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:128)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.utils.DisruptorQueue.consumeBatchWhenAvailable(DisruptorQueue.java:99)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.disruptor$consume_batch_when_available.invoke(disruptor.clj:80)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$fn__3441$fn__3453$fn__3500.invoke(executor.clj:748)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.util$async_loop$fn__464.invoke(util.clj:463)
~[storm-core-0.9.3.jar:0.9.3]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65]
Caused by: java.lang.RuntimeException: java.lang.RuntimeException:
pid:6484, name:split exitCode:0, errorString:
at backtype.storm.task.ShellBolt.execute(ShellBolt.java:136)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$fn__3441$tuple_action_fn__3443.invoke(executor.clj:633)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.daemon.executor$mk_task_receiver$fn__3364.invoke(executor.clj:401)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.disruptor$clojure_handler$reify__1447.onEvent(disruptor.clj:58)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.utils.DisruptorQueue.consumeBatchToCursor(DisruptorQueue.java:125)
~[storm-core-0.9.3.jar:0.9.3]
... 6 common frames omitted
Caused by: java.lang.RuntimeException: pid:6484, name:split exitCode:0,
errorString:
at backtype.storm.task.ShellBolt.die(ShellBolt.java:281)
~[storm-core-0.9.3.jar:0.9.3]
at backtype.storm.task.ShellBolt.access$400(ShellBolt.java:69)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:341)
~[storm-core-0.9.3.jar:0.9.3]
... 1 common frames omitted
Caused by: java.lang.RuntimeException:
backtype.storm.multilang.NoOutputException: Pipe to subprocess seems to be
broken! No output read.
Serializer Exception:
at
backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
~[storm-core-0.9.3.jar:0.9.3]
at
backtype.storm.task.ShellBolt$BoltReaderRunnable.run(ShellBolt.java:318)
~[storm-core-0.9.3.jar:0.9.3]
... 1 common frames omitted
7047 [Thread-30-spout] INFO backtype.storm.daemon.task - Emitting: spout
default [the cow jumped over the moon]
7067 [ProcessThread(sid:0 cport:-1):] INFO
org.apache.storm.zookeeper.server.PrepRequestProcessor - Got user-level
KeeperException when processing sessionid:0x14a3031ec62000b type:create
cxid:0x52 zxid:0x24 txntype:-1 reqpath:n/a Error
Path:/storm/errors/word-count-1-1418147788/split Error:KeeperErrorCode =
NodeExists for /storm/errors/word-count-1-1418147788/split
Is that because of zookeeper?
thanks
Alec
