[
https://issues.apache.org/jira/browse/STORM-522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Peter Haggerty updated STORM-522:
---------------------------------
Description:
We've been seeing these about once a week. The nimbus will kill and reassign
the topology (on the same hardware) get caught up to "now" in kafka and happily
continue running until the next time it encounters an event like this.
{code}
2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers:
[10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
~[stormjar.jar:na]
at
storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
~[stormjar.jar:na]
at
backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at
storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205)
~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
~[stormjar.jar:na]
at
storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
~[stormjar.jar:na]
at
backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at
storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205)
~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
{code}
was:
{code}
2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers:
[10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
~[stormjar.jar:na]
at
storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
~[stormjar.jar:na]
at
backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at
storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205)
~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.d.executor [ERROR]
java.lang.RuntimeException: java.lang.NullPointerException
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
~[stormjar.jar:na]
at
storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
~[stormjar.jar:na]
at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
~[stormjar.jar:na]
at
backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
Caused by: java.lang.NullPointerException: null
at
storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
~[stormjar.jar:na]
at storm.kafka.PartitionManager.close(PartitionManager.java:205)
~[stormjar.jar:na]
at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
~[stormjar.jar:na]
... 6 common frames omitted
2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
{code}
> NullPointerException in storm.kafka.ZkCoordinator
> -------------------------------------------------
>
> Key: STORM-522
> URL: https://issues.apache.org/jira/browse/STORM-522
> Project: Apache Storm
> Issue Type: Bug
> Affects Versions: 0.9.2-incubating
> Reporter: Peter Haggerty
>
> We've been seeing these about once a week. The nimbus will kill and reassign
> the topology (on the same hardware) get caught up to "now" in kafka and
> happily continue running until the next time it encounters an event like this.
> {code}
> 2014-09-30 13:59:40 s.k.ZkCoordinator [INFO] Deleted partition managers:
> [10.1.2.1:9092:0, 10.1.2.2:9092:1, 10.1.2.3:9092:3]
> 2014-09-30 13:59:40 b.s.util [ERROR] Async loop died!
> java.lang.RuntimeException: java.lang.NullPointerException
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
> ~[stormjar.jar:na]
> at
> storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
> ~[stormjar.jar:na]
> at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
> ~[stormjar.jar:na]
> at
> backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
> Caused by: java.lang.NullPointerException: null
> at
> storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
> ~[stormjar.jar:na]
> at storm.kafka.PartitionManager.close(PartitionManager.java:205)
> ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
> ~[stormjar.jar:na]
> ... 6 common frames omitted
> 2014-09-30 13:59:40 b.s.d.executor [ERROR]
> java.lang.RuntimeException: java.lang.NullPointerException
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:148)
> ~[stormjar.jar:na]
> at
> storm.kafka.ZkCoordinator.getMyManagedPartitions(ZkCoordinator.java:77)
> ~[stormjar.jar:na]
> at storm.kafka.KafkaSpout.nextTuple(KafkaSpout.java:94)
> ~[stormjar.jar:na]
> at
> backtype.storm.daemon.executor$fn__5573$fn__5588$fn__5617.invoke(executor.clj:563)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at backtype.storm.util$async_loop$fn__457.invoke(util.clj:431)
> ~[storm-core-0.9.2-incubating.jar:0.9.2-incubating]
> at clojure.lang.AFn.run(AFn.java:24) [clojure-1.5.1.jar:na]
> at java.lang.Thread.run(Thread.java:745) [na:1.7.0_55]
> Caused by: java.lang.NullPointerException: null
> at
> storm.kafka.DynamicPartitionConnections.unregister(DynamicPartitionConnections.java:39)
> ~[stormjar.jar:na]
> at storm.kafka.PartitionManager.close(PartitionManager.java:205)
> ~[stormjar.jar:na]
> at storm.kafka.ZkCoordinator.refresh(ZkCoordinator.java:135)
> ~[stormjar.jar:na]
> ... 6 common frames omitted
> 2014-09-30 13:59:40 b.s.util [INFO] Halting process: ("Worker died")
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
