[
https://issues.apache.org/jira/browse/STORM-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Robert Joseph Evans resolved STORM-2736.
----------------------------------------
Resolution: Fixed
Fix Version/s: 1.1.2
1.2.0
2.0.0
Thanks [~hmcc],
I merged this into master 1.x-branch and 1.1.x-branch. I could not pull it
into 1.0.x-branch as there was a merge conflict and a missing dependency. If
you really want it there then feel free to reopen this and put up another pull
request. Keep up the good work.
> o.a.s.b.BlobStoreUtils [ERROR] Could not update the blob with key
> -----------------------------------------------------------------
>
> Key: STORM-2736
> URL: https://issues.apache.org/jira/browse/STORM-2736
> Project: Apache Storm
> Issue Type: Bug
> Components: storm-core
> Affects Versions: 1.1.1
> Reporter: Heather McCartney
> Assignee: Heather McCartney
> Priority: Minor
> Labels: pull-request-available
> Fix For: 2.0.0, 1.2.0, 1.1.2
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> Sometimes, after our topologies have been running for a while, Zookeeper does
> not respond within an appropriate time and we see
> {code}
> 2017-08-16 10:18:38.859 o.a.s.zookeeper [INFO] ip-10-181-20-70.ec2.internal
> lost leadership.
> 2017-08-16 10:21:31.144 o.a.s.zookeeper [INFO] ip-10-181-20-70.ec2.internal
> gained leadership, checking if it has all the topology code locally.
> 2017-08-16 10:21:46.201 o.a.s.zookeeper [INFO] Accepting leadership, all
> active topology found localy.
> {code}
> That's fine, and we probably need to allocate more resources. But after a new
> leader is chosen, we then see:
> {code}
> o.a.s.b.BlobStoreUtils [ERROR] Could not update the blob with key<key>
> {code}
> over and over.
> I can't figure out yet how to cause the conditions that lead to Zookeeper
> becoming unresponsive, but it is possible to reproduce the {{BlobStoreUtils}}
> error by restarting Zookeeper.
> The problem, I think, is that the loop
> [here|https://github.com/apache/storm/blob/v1.1.1/storm-core/src/jvm/org/apache/storm/blobstore/BlobStoreUtils.java#L175]
> never executes because the {{nimbusInfos}} list is empty. If I add a check
> similar to
> [this|https://github.com/apache/storm/blob/v1.1.1/storm-core/src/jvm/org/apache/storm/blobstore/BlobStoreUtils.java#L244]
> for a node which exists but has no children, the error goes away.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
