Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

[mailto:harlo...@fastmail.com] Sent: Tuesday, July 05, 2016 10:44 AM To: Matt Fischer Cc: openstack-dev@lists.openstack.org; OpenStack Operators Subject: Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?) Ah, those sets of command sound pretty nice to run

Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

Ah, those sets of command sound pretty nice to run periodically, Sounds like a useful script that could be placed in the ops tools repo (I forget where this repo exists at, but pretty sure it does exist?). Some other oddness though is that this issue seems to go away when we don't run

Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

We tried some of these (well I did last night), but the issue was that eventually rabbitmq actually died. I was trying some of the eval commands to try to get what was in the mgmt_db, bet any get-status call eventually lead to a timeout error. Part of the problem is that we can go from a

Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

For the record we're on 3.5.6-1. On Jul 5, 2016 11:27 AM, "Mike Lowe" wrote: > I was having just this problem last week. We updated to 3.6.2 from 3.5.4 > on ubuntu and stated seeing crashes due to excessive memory usage. I did > this on each node of my rabbit cluster and haven’t

Re: [openstack-dev] [Openstack-operators] [nova] Rabbit-mq 3.4 crashing (anyone else seen this?)

Yes! This happens often but I'd not call it a crash, just the mgmt db gets behind then eats all the memory. We've started monitoring it and have runbooks on how to bounce just the mgmt db. Here are my notes on that: restart rabbitmq mgmt server - this seems to clear the memory usage. rabbitmqctl