[
https://issues.apache.org/jira/browse/STORM-531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232619#comment-14232619
]
Brandon Bradley commented on STORM-531:
---------------------------------------
[~sriharsha] Alright, I am more understanding of what is going on now. Thanks
for this last comment and all your input. I removed cluster.shutdown(), and the
topology continues to run until stopped manually. So, now the confusion lies
with output of errors in 0.9.3 vs output of 'BUILD SUCCESSFUL' in 0.9.2. This
is very confusing to new users of Storm. Maybe WordCountTopology could be
changed in a way that conforms more to the principle of least surprise.
> NoOutputException error when a topology is submitted:
> "java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read. Serializer Exception:"
> ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
>
> Key: STORM-531
> URL: https://issues.apache.org/jira/browse/STORM-531
> Project: Apache Storm
> Issue Type: Bug
> Affects Versions: 0.9.3
> Environment: Open suse
> Reporter: Enayat
> Fix For: 0.9.3
>
>
> When I want to submit the WordCountTopology, after running the storm jar
> ...., the following error comes and it does not the topology in the ui!
> 23543 [Thread-31] ERROR backtype.storm.task.ShellBolt - Halting process:
> ShellBolt died.
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> (Unable to capture error stream)
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23552 [Thread-31] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> (Unable to capture error stream)
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23554 [main] INFO backtype.storm.daemon.executor - Shut down executor
> split:[6 6]
> 23554 [main] INFO backtype.storm.daemon.executor - Shutting down executor
> split:[7 7]
> 23555 [Thread-18-split] INFO backtype.storm.util - Async loop interrupted!
> 23555 [Thread-22-spout] INFO backtype.storm.daemon.task - Emitting: spout
> default [an apple a day keeps the doctor away]
> 23557 [Thread-17-disruptor-executor[7 7]-send-queue] INFO
> backtype.storm.util - Async loop interrupted!
> 23559 [main] INFO backtype.storm.daemon.executor - Shut down executor
> split:[7 7]
> 23559 [main] INFO backtype.storm.daemon.executor - Shutting down executor
> spout:[8 8]
> 23560 [Thread-19-disruptor-executor[8 8]-send-queue] INFO
> backtype.storm.util - Async loop interrupted!
> 23560 [Thread-20-spout] INFO backtype.storm.util - Async loop interrupted!
> 23560 [main] INFO backtype.storm.daemon.executor - Shut down executor
> spout:[8 8]
> 23560 [main] INFO backtype.storm.daemon.executor - Shutting down executor
> spout:[9 9]
> 23561 [Thread-33] ERROR backtype.storm.task.ShellBolt - Halting process:
> ShellBolt died.
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23561 [Thread-33] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23562 [Thread-32] ERROR backtype.storm.task.ShellBolt - Halting process:
> ShellBolt died.
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23562 [Thread-32] ERROR backtype.storm.daemon.executor -
> java.lang.RuntimeException: backtype.storm.multilang.NoOutputException: Pipe
> to subprocess seems to be broken! No output read.
> Serializer Exception:
> at
> backtype.storm.utils.ShellProcess.readShellMsg(ShellProcess.java:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:116)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) [na:1.6.0_24]
> 23562 [Thread-21-disruptor-executor[9 9]-send-queue] INFO
> backtype.storm.util - Async loop interrupted!
> 23564 [Thread-32] ERROR
> org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread
> Thread[Thread-32,5,main] died
> java.lang.RuntimeException: java.lang.InterruptedException
> at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:102)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_.invoke(zookeeper.clj:98)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:114)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$fn__4321$fn$reify__4366.reportError(executor.clj:737)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.die(ShellBolt.java:303)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
> Caused by: java.lang.InterruptedException: null
> at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
> at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
> at
> org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:172)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:161)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:157)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:148)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:36)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> ... 12 common frames omitted
> 23565 [Thread-33] ERROR
> org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread
> Thread[Thread-33,5,main] died
> java.lang.RuntimeException: java.lang.InterruptedException
> at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:102)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_.invoke(zookeeper.clj:98)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:114)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$fn__4321$fn$reify__4366.reportError(executor.clj:737)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.die(ShellBolt.java:303)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
> Caused by: java.lang.InterruptedException: null
> at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
> at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
> at
> org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at org.apache.storm.zookeeper.ZooKeeper.exists(ZooKeeper.java:1040)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:172)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl$2.call(ExistsBuilderImpl.java:161)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.pathInForeground(ExistsBuilderImpl.java:157)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:148)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.ExistsBuilderImpl.forPath(ExistsBuilderImpl.java:36)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.zookeeper$exists_node_QMARK_$fn__1889.invoke(zookeeper.clj:101)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> ... 12 common frames omitted
> 23568 [Thread-22-spout] INFO backtype.storm.util - Async loop interrupted!
> 23570 [main] INFO backtype.storm.daemon.executor - Shut down executor
> spout:[9 9]
> 23570 [main] INFO backtype.storm.daemon.executor - Shutting down executor
> spout:[10 10]
> 23571 [Thread-23-disruptor-executor[10 10]-send-queue] INFO
> backtype.storm.util - Async loop interrupted!
> 23573 [Thread-31] ERROR
> org.apache.storm.zookeeper.server.NIOServerCnxnFactory - Thread
> Thread[Thread-31,5,main] died
> java.lang.RuntimeException: java.lang.InterruptedException
> at backtype.storm.util$wrap_in_runtime.invoke(util.clj:44)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$create_node.invoke(zookeeper.clj:91)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:117)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.zookeeper$mkdirs.invoke(zookeeper.clj:115)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_distributed_cluster_state$reify__2136.mkdirs(cluster.clj:119)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.cluster$mk_storm_cluster_state$reify__2593.report_error(cluster.clj:397)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$throttled_report_error_fn$fn__4101.invoke(executor.clj:179)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.daemon.executor$fn__4321$fn$reify__4366.reportError(executor.clj:737)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> backtype.storm.task.OutputCollector.reportError(OutputCollector.java:223)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.die(ShellBolt.java:303)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt.access$800(ShellBolt.java:68)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at backtype.storm.task.ShellBolt$1.run(ShellBolt.java:137)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at java.lang.Thread.run(Thread.java:679) ~[na:1.6.0_24]
> Caused by: java.lang.InterruptedException: null
> at java.lang.Object.wait(Native Method) ~[na:1.6.0_24]
> at java.lang.Object.wait(Object.java:502) ~[na:1.6.0_24]
> at
> org.apache.storm.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at org.apache.storm.zookeeper.ZooKeeper.create(ZooKeeper.java:781)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:676)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl$11.call(CreateBuilderImpl.java:660)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl.pathInForeground(CreateBuilderImpl.java:656)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl.protectedPathInForeground(CreateBuilderImpl.java:441)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl.forPath(CreateBuilderImpl.java:431)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl$3.forPath(CreateBuilderImpl.java:239)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at
> org.apache.storm.curator.framework.imps.CreateBuilderImpl$3.forPath(CreateBuilderImpl.java:193)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> ~[na:1.6.0_24]
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> ~[na:1.6.0_24]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[na:1.6.0_24]
> at java.lang.reflect.Method.invoke(Method.java:616) ~[na:1.6.0_24]
> at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
> ~[clojure-1.5.1.jar:na]
> at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
> ~[clojure-1.5.1.jar:na]
> at backtype.storm.zookeeper$create_node.invoke(zookeeper.clj:90)
> ~[storm-core-0.9.3-rc1.jar:0.9.3-rc1]
> ... 11 common frames omitted
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
