Gary, the mail does not display the screenshot for me. Also this is an old version (4.15) I think you should upgrade.
What might be the root of your issue is that *you* have seen the physical host crashed but CloudStack could not determine that. To prevent starting the same VM twice it would withhold taking any action in such situations. You may call this a bug or a "lack of feature", but the bottom line is that this is expected behaviour. I do not think a corrupt VR would crash a host. On Mon, Feb 26, 2024 at 1:25 PM Gary Dixon <gary.di...@quadris.co.uk.invalid> wrote: > ACS 4.15.2 > > KVM > > Ubuntu 20.04 > > > > Hi all > > > > We had a physical host crash on Friday due to hardware failure. This > appeared to have caused issues with some RVR’s going into an ‘unknown’ > state. > > > > The strange thing was that on any host where a RVR in an unknown state was > running – we could not console onto any VM’s on that host – nor could we > SSH directly to the RVR from the host. > > The UI was showing all hosts agent state as ‘UP’ > > > > Only when we restarted the ACS mgmt. service did we notice that the host > agent where a RVR was running in an ‘unknown’ state then was in a > ‘connecting’ state for some time – there were no networking issues either – > host was pingable from the mgmt. server. > > > > We were then briefly able to console onto one of the RVR’s in an unknown > state and then discovered that the RVR was indeed corrupt – this is the > screenshot of the RVR terminal : > > > > We then marked the RVR in the DB as ‘stopped’ and virsh destroyed it > directly on the host. We were then able to restart the VPC with cleanup > which then re-created the corrupt RVR. > > It then appeared that once the corrupt RVR had gone – all other RVR’s in > an unknown state transitioned to ‘backup’ state > > > > We are wondering if we have encountered a bug where if a corrupt RVR > crashes the host cloudstack agent if ACS tries to do anything with the RVR > – like restart it > > > > BR > > > > Gary > > > > > > > Gary Dixon > Quadris Cloud Manager > 0161 537 4980 <0161%20537%204980> > +44 7989717661 <+44%207989717661> > gary.di...@quadris.co.uk > www.quadris.com > Innovation House, 12‑13 Bredbury Business Park > Bredbury Park Way, Bredbury, Stockport, SK6 2SN > -- Daan
