[
https://issues.apache.org/jira/browse/STORM-2873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim resolved STORM-2873.
---------------------------------
Resolution: Fixed
Fix Version/s: 1.2.0
Thanks [~kishorvpatil], I merged into 1.x-branch.
> Backpressure implentation delete ephemeral too frequently
> ---------------------------------------------------------
>
> Key: STORM-2873
> URL: https://issues.apache.org/jira/browse/STORM-2873
> Project: Apache Storm
> Issue Type: Bug
> Reporter: Kishor Patil
> Assignee: Kishor Patil
> Priority: Major
> Labels: pull-request-available
> Fix For: 1.2.0
>
> Time Spent: 2h 10m
> Remaining Estimate: 0h
>
> The backpressure implementation deletes the znode when not relevant but that
> hits zookeeper issue of too frequent deletion and creation or same path for
> ephemeral znode. Below is exception we get when zk hits this issue:
> {code}
> 017-09-18 15:00:34.980 b.s.util WorkerBackpressureThread [WARN] Expecting
> exception of class: class
> org.apache.storm.shade.org.apache.zookeeper.KeeperException$NoNodeException,
> but exception chain only contains: (#<NoAuthException
> org.apache.storm.shade.org.apache.zookeeper.KeeperException$NoAuthException:
> KeeperErrorCode = NoAuth for
> /backpressure/TestTopology--170916-005358-117-1505523256/d11af335-6e03-48b6-801e-7369acfe9ffd-127.0.0.1-6721>)
> 2017-09-18 15:00:34.980 b.s.d.worker WorkerBackpressureThread [ERROR]
> workerBackpressure update failed when connecting to ZK ... will retry
> java.lang.RuntimeException:
> org.apache.storm.shade.org.apache.zookeeper.KeeperException$NoAuthException:
> KeeperErrorCode = NoAuth for
> /backpressure/TestTopology--170916-005358-117-1505523256/d11af335-6e03-48b6-801e-7369acfe9ffd-127.0.0.1-6721
> at backtype.storm.util$wrap_in_runtime.invoke(util.clj:52)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at backtype.storm.zookeeper$delete_node.doInvoke(zookeeper.clj:110)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at clojure.lang.RestFn.invoke(RestFn.java:464) ~[clojure-1.6.0.jar:?]
> at backtype.storm.zookeeper$delete_recursive.invoke(zookeeper.clj:189)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> backtype.storm.cluster_state.zookeeper_state_factory$_mkState$reify__4207.delete_node(zookeeper_state_factory.clj:117)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at sun.reflect.GeneratedMethodAccessor860.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
> ~[clojure-1.6.0.jar:?]
> at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
> ~[clojure-1.6.0.jar:?]
> at
> org.apache.storm.pacemaker.pacemaker_state_factory$_mkState$reify__4254.delete_node(pacemaker_state_factory.clj:174)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at sun.reflect.GeneratedMethodAccessor859.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
> ~[clojure-1.6.0.jar:?]
> at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
> ~[clojure-1.6.0.jar:?]
> at
> backtype.storm.cluster$mk_storm_cluster_state$reify__3873.worker_backpressure_BANG_(cluster.clj:421)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at sun.reflect.GeneratedMethodAccessor857.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at clojure.lang.Reflector.invokeMatchingMethod(Reflector.java:93)
> ~[clojure-1.6.0.jar:?]
> at clojure.lang.Reflector.invokeInstanceMethod(Reflector.java:28)
> ~[clojure-1.6.0.jar:?]
> at
> backtype.storm.daemon.worker$mk_backpressure_handler$fn__7117.invoke(worker.clj:161)
> [storm-core-0.10.2.y.jar:0.10.2.y]
> at
> backtype.storm.disruptor$worker_backpressure_handler$reify__6432.onEvent(disruptor.clj:57)
> [storm-core-0.10.2.y.jar:0.10.2.y]
> at
> backtype.storm.utils.WorkerBackpressureThread.run(WorkerBackpressureThread.java:64)
> [storm-core-0.10.2.y.jar:0.10.2.y]
> Caused by:
> org.apache.storm.shade.org.apache.zookeeper.KeeperException$NoAuthException:
> KeeperErrorCode = NoAuth for
> /backpressure/TestTopology--170916-005358-117-1505523256/d11af335-6e03-48b6-801e-7369acfe9ffd-127.0.0.1-6721
> at
> org.apache.storm.shade.org.apache.zookeeper.KeeperException.create(KeeperException.java:113)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.framework.imps.DeleteBuilderImpl$5.call(DeleteBuilderImpl.java:239)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.framework.imps.DeleteBuilderImpl$5.call(DeleteBuilderImpl.java:234)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.framework.imps.DeleteBuilderImpl.pathInForeground(DeleteBuilderImpl.java:230)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.framework.imps.DeleteBuilderImpl.forPath(DeleteBuilderImpl.java:215)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at
> org.apache.storm.shade.org.apache.curator.framework.imps.DeleteBuilderImpl.forPath(DeleteBuilderImpl.java:42)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> at backtype.storm.zookeeper$delete_node.doInvoke(zookeeper.clj:107)
> ~[storm-core-0.10.2.y.jar:0.10.2.y]
> ... 23 more
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)