Re: [ovirt-users] Suddenly all VM's down including HostedEngine & NFSshares (except HE) unmounted

2016-08-21 Thread Matt .
Some extra info: I see a very high load on all hosts without any VM started: top - 02:36:36 up 56 min, 1 user, load average: 9.95, 8.11, 7.67 Tasks: 247 total, 1 running, 246 sleeping, 0 stopped, 0 zombie %Cpu(s): 1.2 us, 0.8 sy, 0.0 ni, 97.9 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st

Re: [ovirt-users] Suddenly all VM's down including HostedEngine & NFSshares (except HE) unmounted

2016-08-21 Thread Matt .
I seem some very strange behaviour, hosts are random rebooting where I get the feeling it crashed on Sanlock or is, that is the last logline from /var/log/messages I saw this happening on the latest kernel (yum update) and different hardware, the filer is OK! Aug 22 01:35:27 host-01

Re: [ovirt-users] Suddenly all VM's down including HostedEngine & NFSshares (except HE) unmounted

2016-08-21 Thread Matt .
THe strange things is that there are no IP's duplicated in the ovirt environment, storage or whatever the VM's make running. What happens tho is that the statusses of all agents change, and why... don' t ask me. There is really nothing in the logs that shows this behaviour. Restarting broker,

Re: [ovirt-users] Suddenly all VM's down including HostedEngine & NFSshares (except HE) unmounted

2016-08-21 Thread Charles Kozler
This usually happens when SPM falls off or master storage domain was unreachable for a brief period of time in some capacity. Your logs should say something about an underlying storage problem so oVirt offlined or paused the VMs to avoid problems. I'd check the pathway to your master storage

[ovirt-users] Suddenly all VM's down including HostedEngine & NFSshares (except HE) unmounted

2016-08-21 Thread Matt .
HI All, I'm trying to tackle an issues on 4.0.2 that sunddenly all VM's including the HostedEngine are just down at once. I have also seen that all NFS shares are unmounted except the HostedEngine Storage, which is on the same NFS device as well. I have checked the logs, nothing strange to see