Re: [openstack-dev] Auditing Openstack

2013-07-31 Thread Jacob Bushman
e. On 07/30/2013 10:48 PM, Jacob Bushman wrote: I haven't opened it because currently it is too tied to our proprietary platform. I have actually submitted a talk for the summit and planned on having an open version ready for this. It is good to hear that I am not the only one out the

Re: [openstack-dev] Auditing Openstack

2013-07-30 Thread Jacob Bushman
he varying openstack db's believe is the 'state' of the clusters. Seems like a great analysis tool. What corrective actions does it do (if any?), aka, DB says X instances, really Y, then?? (delete them??) On 7/30/13 11:59 AM, "Jacob Bushman" wrote: In our deploymen

Re: [openstack-dev] Auditing Openstack

2013-07-30 Thread Jacob Bushman
compute nodes are in sync. On 07/30/2013 11:17 AM, Joshua Harlow wrote: Do u have a writeup of the corruption issues you have seen. I would most definitely appreciate said tools. Any little overview of what they do/are?? On 7/30/13 9:44 AM, "Jacob Bushman" wrote: I have been wo

[openstack-dev] Auditing Openstack

2013-07-30 Thread Jacob Bushman
I have been working with various corruption issues within openstack. Issues like failed or partial provisions, quantum port / ip corruption and database corruption. There are several edge cases that I have run into where the existing periodic task to clean up corruption were inadequate for ou