Try to reboot management server, after several time unsuccessful attempt to run system vms for now it event don't try to start them. Screenshot attached.
Regards, Jafar Aghabalayev From: Jafar Aghabalayev <jafar.aghabala...@pasha-technology.com> Sent: Wednesday, March 15, 2023 10:54 AM To: users@cloudstack.apache.org Subject: SystemVMs not starting after host reboot CAUTION: This email originated from outside the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. Please report all suspicious emails to s...@pasha-technology.com<mailto:s...@pasha-technology.com>. Hello community, Recently I rebooted the KVM host where systems running. After rebooting the KVM hosts System VMs unable to start. I can successfully create guest VMs. Cloudstack version: 4.17.2.0 The log from management server: 2023-03-15 02:42:09,545 WARN [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddaed1ac) (logid:ef20fea1) Unable to start proxy [1002] due to [Unable to create a deployment for VM instance {id: "1002", name: "v-1002-VM", uuid: "dccce3c6-7e8b-4449-8968-84b99143eac7", type="ConsoleProxy"}]. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM instance {id: "1002", name: "v-1002-VM", uuid: "dccce3c6-7e8b-4449-8968-84b99143eac7", type="ConsoleProxy"}Scope=interface com.cloud.dc.DataCenter; id=1 2023-03-15 02:42:09,548 INFO [c.c.c.ConsoleProxyManagerImpl] (consoleproxy-1:ctx-ddaed1ac) (logid:ef20fea1) Unable to start console proxy vm for standby capacity, vm id : 1002, will recycle it and start a new one 2023-03-15 02:42:09,558 WARN [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-47af890a) (logid:e6c491cc) Unable to start secondary storage VM [1003] due to [Unable to create a deployment for VM instance {id: "1003", name: "s-1003-VM", uuid: "fc61476a-50e7-426f-8cd6-82ef1dbbe144", type="SecondaryStorageVm"}]. com.cloud.exception.InsufficientServerCapacityException: Unable to create a deployment for VM instance {id: "1003", name: "s-1003-VM", uuid: "fc61476a-50e7-426f-8cd6-82ef1dbbe144", type="SecondaryStorageVm"}Scope=interface com.cloud.dc.DataCenter; id=1 2023-03-15 02:42:09,561 INFO [o.a.c.s.SecondaryStorageManagerImpl] (secstorage-1:ctx-47af890a) (logid:e6c491cc) Unable to start secondary storage VM [1003] for standby capacity, it will be recycled and will start a new one. 2023-03-15 02:42:10,464 DEBUG [o.a.c.u.p.ProcessRunner] (pool-2-thread-32:null) (logid:e5e27136) Process standard error output command [/usr/bin/ipmitool -I lanplus -R 1 -v -H 10.220.65.12 -p 623 -U Administrator -P ******* chassis power status]: [Unable to Get Channel Cipher Suites Error response 0xc1 from Get PICMG Properities Invalid completion code received: Invalid command 2023-03-15 02:42:10,501 DEBUG [o.a.c.u.p.ProcessRunner] (pool-2-thread-31:null) (logid:e5e27136) Process standard error output command [/usr/bin/ipmitool -I lanplus -R 1 -v -H 10.220.65.11 -p 623 -U Administrator -P ******* chassis power status]: [Unable to Get Channel Cipher Suites Error response 0xc1 from Get PICMG Properities Invalid completion code received: Invalid command 2023-03-15 02:42:11,572 DEBUG [c.c.a.ConsoleProxyAlertAdapter] (consoleproxy-1:ctx-ddaed1ac) (logid:ef20fea1) Console proxy creation failure, zone: Zone-1 2023-03-15 02:42:11,573 WARN [c.c.a.AlertManagerImpl] (consoleproxy-1:ctx-ddaed1ac) (logid:ef20fea1) alertType=[10] dataCenterId=[1] podId=[null] clusterId=[null] message=[Console proxy creation failure. zone: Zone-1, error details: null]. 2023-03-15 02:42:11,576 WARN [c.c.a.AlertManagerImpl] (consoleproxy-1:ctx-ddaed1ac) (logid:ef20fea1) No recipients set in global setting 'alert.email.addresses', skipping sending alert with subject [Console proxy creation failure. zone: Zone-1, error details: null] and content [Console proxy creation failure (zone Zone-1)]. 2023-03-15 02:42:11,577 DEBUG [c.c.a.SecondaryStorageVmAlertAdapter] (secstorage-1:ctx-47af890a) (logid:e6c491cc) Secondary Storage Vm creation failure, zone: Zone-1 2023-03-15 02:42:11,578 WARN [c.c.a.AlertManagerImpl] (secstorage-1:ctx-47af890a) (logid:e6c491cc) alertType=[19] dataCenterId=[1] podId=[null] clusterId=[null] message=[Secondary Storage Vm creation failure. zone: Zone-1, error details: null]. 2023-03-15 02:42:11,581 WARN [c.c.a.AlertManagerImpl] (secstorage-1:ctx-47af890a) (logid:e6c491cc) No recipients set in global setting 'alert.email.addresses', skipping sending alert with subject [Secondary Storage Vm creation failure. zone: Zone-1, error details: null] and content [Secondary Storage Vm creation failure (zone Zone-1)]. Appreciate your support. Regards, [cid:image001.png@01D9572C.60147030] Jafar Aghabalayev | Senior IT Infrastructure Engineer 157 Azadliq Avenue, AZ1106, Baku, Azerbaijan mob: +994 55 900 19 34 email: jafar.aghabala...@pasha-technology.com<mailto:jafar.aghabala...@pasha-technology.com> This communication contains information issued by "PASHA Technology" LLC. This e-mail message and all attachments transmitted with it are intended solely for the use of the addressee and may contain legally privileged and confidential information. If the reader of this message is not the intended recipient, or an employee or agent responsible for delivering this message to the intended recipient, the reader is hereby notified that any dissemination, distribution, copying, or other use of this message or its attachments is strictly prohibited. If you have received this message in error, please notify the sender immediately by replying to this message and please delete it from your computer. Within the bounds of law "PASHA Technology" LLC may monitor electronic transmissions through its internal and external networks to ensure compliance with internal policies and for legitimate business purposes.