[ovirt-users] Re: Server 2008R2 UEFI ISO Boot Problerm
If I change to "Other OS" or any flavor of Linux i get the same result. I've changed the ISO to a W764 ISO as well with the same hang. More modern versions of Windows Server boot fine, but I am not able to restore the backup with a version higher than 2008R2. This link "https://bugs.launchpad.net/qemu/+bug/1593605; references a similar problem that I am having and it's where I got the idea to pass the custom CPU flags. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/SRAITV53GNV6GKCCNQMSIXBIS5PNOCZT/
[ovirt-users] Server 2008R2 UEFI ISO Boot Problerm
Greetings oVirt team I'm using "Version 4.5.7-0.master.20240327074810.git14bca0502d.el8 on CentOS Stream 9" I have occasion to restore a windows backup image for the purpose of data extraction. To accomplish this I need to boot off a Server 2008R2 ISO. The machine to be restored was UEFI based originally and so it is required to be UEFI for the restoration process. I seem to be having a problem with booting off of the ISO image in the required UEFI-based system. In pursuit of a solution I've read on some of the other forums about this same problem on other KVM-based platforms. Booting that same ISO after changing the VM to BIOS works flawlessly. In the articles and threads I've read there is mention of hyper-v services that load during the guest boot process that are causing the ISO boot to hang. Is it possible to disable (or is it even necessary to disable) "hv_time,hv_relaxed,hv_spinlocks=0x2000" in the "Custom Properties" section of the VM config ? If any of you have some insight into this problem and a possible solution I'd appreciate the feedback. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/DX2UNOUTZ6Z2B6ROGPLVWSNN6XY7E3XF/
[ovirt-users] Re: Non responsive host (4.3.10)
Maria - Likely you can repair the gluster volumes on that host with xfs_repair and you most likely need to stop the gluster service on that node and unmount the filesystems to do so. After the filesystem is repaired you'll be able to mount them and start the gluster service. From there gluster will "heal" that node and your replica-3 will be redundant again. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WGQFWEUW6YYBAUU4LXHYB2N57MF4ZMZK/
[ovirt-users] Re: oVirt Engine Web Console
You do have to use an FQDN to access it. The web management will not respond to IP address requests. When you set up the engine, what FQDN did you use ? In the hosts file of the machine you are using to access the engine, create an entry for that website: Example: 10.10.254.10 your.fqdm.tld or better example 10.10.254.10ovirtmgmt.yourdomain.com ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/S5PR7ZZIJSJXT2OMN5GB4ZYVYVYXZV3Y/
[ovirt-users] Re: New oVirt HCI 4.5.4 Cluster Problems
Thank you Sandro. I solved the problem by manually configuring Gluster storage on my three nodes and the running the engine-deploy utility to stand up the management engine. I really appreciate you replying to my question. I know you're really busy. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/2JYKZWMYYJAJDOPRDECN3XIIQW3CKZSL/
[ovirt-users] Re: {REQUEST} oVirt (including RHHI) as HCI in the future
I see you never got a reply on this question. What may I ask, did you finally do to achieve the HCI of days gone by ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XTLU62BELTBOO2H55ISC2FEHG3OZP2HG/
[ovirt-users] New oVirt HCI 4.5.4 Cluster Problems
Good day all. I'm in the process of deploying a fresh, new cluster and i'm running into a few snags. I'm trying to use the cockpit environment to deploy the gluster storage setup as I have previously done and it's failing consistently. I looked through what I believe to be the current documentation and I don't see anything about HCI setup, and the Gluster storage documentation points to the Gluster community web presence. So, my question is, will the oVirt HCI deployment still be supported, and is the process the same with cockpit to configure the storage, and cli to deploy the hosted engine or did HCI and gluster not make the cut with the 4.5.4 release? I'm using the oVirt node installation iso from the oVirt site for this deployment. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AXJJE3BE77OSKEXOAXY55EP32G4HIPPK/
[ovirt-users] Re: oVirt 2.5.1.2 HCI Gluster Recovery Options
Good Day Strahil; The OS did survive. The OS was on a RAID1 array and the gluster bricks are on a RAID5 array. Since the time I requested guidance I did a whole lot of reading and learning. I found in /etc/ansible several yaml files that contained the configuration of the gluster bricks and the lvm volumes contained within them. I also found that lvm configurations can be restored from /etc/lvm/backup and /etc/lvm/archive. All very helpfull I must say. I re-created the RAID array and did a light initialization to wipe the array. Then I attempted to restore the backups from /etc/lvm/backup and /etc/lvm/array. I was unable to inspire the thinpool to enable with the "manual repair required" error each time. As there was not enough unused space on the system to cycle out the metadata lvm I was unable to proceed. I then deleted the LVM configuration and re-created the LVM volumes from the /etc/ansible yaml files I found. I made them identical to the other two nodes that were functioning in the cluster. I have them succesfully mounted via fstab with the new UUID that were generated when I recreated the volumes. Based on the documents and articles I have read and studied these past few weeks, at this point I believe that I need to re-apply the appropriate gluster-related attributes to the correct level of the gluster mounts and attempt to start the gluster service. I have not done this yet because I don't want to cause another outage and I want to be sure that what I am doing will result in the afflicted gluster volumes healing and sychronising with the healthy nodes. 1. What attributes and at what level should I apply them to the refurbished node ? 2. What problems could I encounter when I try to start the gluster service after making the changes ? 3. Should I remove the new node from the gluster cluster and then re-add it or will it heal in it's current refurbished state ? I appreciate you taking time to check on the status of this situation and thank you for any help or insight you can provide. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/UEIP7GKIG3IMT2UMPTLYV475XMVRULOE/
[ovirt-users] oVirt 2.5.1.2 HCI Gluster Recovery Options
Greetings oVirt community; I've got a three-node HCI cluster with hosted engine and on one of the three nodes I lost the underlying RAID array under the Gluster bricks. It looks like I'm going to have to rebuild the RAID array and thus likely lose the Gluster configuration that lives there. The host OS (oVirt Node) is fine and it's just the Gluster/RAID piece that is affected. Can one of you please point me to the best documentation link to the process of re-configuring that failed node to be identical to the rest of the nodes please ? It's configured for replica-three and I don't want to have a problem with nodes 2 and 3 before I get node 1 back up and healthy. Any help will be greatly appreciated. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QSWBLY3QJOSOTGIHYPJYQWP3XRQLEV7P/
[ovirt-users] Re: Manually Remove Snapshots
This worked for me. I was able to delete the bad snapshot reference and then hose the VM. Thank you for the help ! ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/YZQPR2DMPYV5424RXOFWTLHTXLMXLKCV/
[ovirt-users] Re: Manually Remove Snapshots
Attempting to create another snapshot fails with this snippit: - Result: 'cleanSuccess' -- Message: 'VDSGenericException: VDSErrorException: Failed in vdscommand to HSMGetAllTasksStatusesVDS, error = Cannot create volume snapshot from illegal volume: (u'576b2761-a5bc-427b-95a9-0594447f0705',)', -- Exception: 'VDSGenericException: VDSErrorException: Failed in vdscommand to HSMGetAllTasksStatusesVDS, error = Cannot create volume snapshot from illegal volume: (u'576b2761-a5bc-427b-95a9-0594447f0705',)' 2022-09-23 12:17:08,031-05 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-41) [] CommandAsyncTask::endActionIfNecessary: All tasks of command '2505390c-dd54-41ff-91f5-b56af5b0b3ee' has ended -> executing 'endAction' 2022-09-23 12:17:08,031-05 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-41) [] CommandAsyncTask::endAction: Ending action for '1' tasks (command ID: '2505390c-dd54-41ff-91f5-b56af5b0b3ee'): calling endAction '. 2022-09-23 12:17:08,032-05 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-73809) [] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction 'CreateSnapshot', 2022-09-23 12:17:08,041-05 INFO [org.ovirt.engine.core.bll.snapshots.CreateSnapshotCommand] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] Command [id=2505390c-dd54-41ff-91f5-b56af5b0b3ee]: Updating status to 'FAILED', The command end method logic will be executed by one of its parent commands. 2022-09-23 12:17:08,042-05 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type 'CreateSnapshot' completed, handling the result. 2022-09-23 12:17:08,042-05 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type 'CreateSnapshot' succeeded, clearing tasks. 2022-09-23 12:17:08,042-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] SPMAsyncTask::ClearAsyncTask: Attempting to clear task '835aef5c-ff62-4d14-aa24-4b82321e866d' 2022-09-23 12:17:08,043-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='31fdd642-6b06-11ea-a4c4-00163e333bd2', ignoreFailoverLimit='false', taskId='835aef5c-ff62-4d14-aa24-4b82321e866d'}), log id: a9fec48 2022-09-23 12:17:08,043-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] START, HSMClearTaskVDSCommand(HostName = hprvsr02.locacore.com, HSMTaskGuidBaseVDSCommandParameters:{hostId='ecad78a5-58e3-4fcd-8b84-e30e3e1993cf', taskId='835aef5c-ff62-4d14-aa24-4b82321e866d'}), log id: 6712f5cc 2022-09-23 12:17:08,076-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] FINISH, HSMClearTaskVDSCommand, return: , log id: 6712f5cc 2022-09-23 12:17:08,076-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] FINISH, SPMClearTaskVDSCommand, return: , log id: a9fec48 2022-09-23 12:17:08,087-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engine-Thread-73809) [dacd81ee-2d8c-4f8e-a590-181c0082bcea] BaseAsyncTask::removeTaskFromDB: Removed task '835aef5c-ff62-4d14-aa24-4b82321e866d' from DataBase ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TNFJK5BRYPCK6LBTJ2GB3BSDJQKXZ5BH/
[ovirt-users] Re: Manually Remove Snapshots
I just tried that clone method per your suggestion and I got "VDSM command CopyImageVDS failed: Image is not a legal chain: (u'6af66318-e6f8-45d7-8b4e-2183faf0a917',)" ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/GFV3BWAL3YP24GKDZNWOJT6L6PX2SWUJ/
[ovirt-users] Manually Remove Snapshots
I've got a VM with a pair of snapshots that won't delete and I'm needing a procedure to manually remove the snapshots. I don't need the VM and so while i'd prefer not to destroy it, it wouldn't be critical if I did damage the VM in the process. When I try to delete the snapshots that procedure fails, and when I try to delete the disk that procedure fails. Any pointers would be greatly appreciated. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/CTTS2LLU57LLHR6NM7YQVU622CC2YWAQ/
[ovirt-users] Re: VM Down With "Bad Volume Specification"
I was able to remedy the situation with the command "./taskcleaner.sh -z -R -J -A". Thank you for your help in pointing me in the right direction. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/GFDE6G4OMVUGVJYI42BSHAVFZTSXUVVI/
[ovirt-users] Re: VM Down With "Bad Volume Specification"
Thank you. I'll give that a try and report back. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/6AS6JHGYC4ETREKXWBM2D4MCEBYXEPGM/
[ovirt-users] Re: VM Down With "Bad Volume Specification"
I'm thinking that I need to somehow stop the disk move, and then delete the snapshot that existed prior to my attempt at moving the disk. Can someone please tell me how to stop that disk move ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/J2U4M3C6EC3GRXN6FCNW4KSHTGLANGWL/
[ovirt-users] VM Down With "Bad Volume Specification"
I had occasion to shutdown a VM for the purpose of adding RAM and processor to it and the VM willnot boot back up. I'm seeing "VM Issabel_PBX is down with error. Exit message: Bad volume specification {'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'serial': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'index': 0, 'iface': 'scsi', 'apparentsize': '5706743808', 'specParams': {}, 'cache': 'none', 'imageID': '6af66318-e6f8-45d7-8b4e-2183faf0a917', 'truesize': '5950070784', 'type': 'disk', 'domainID': '24c4dc1b-c843-4ae2-963f-9d0548305192', 'reqsize': '0', 'format': 'cow', 'poolID': '31fdd642-6b06-11ea-a4c4-00163e333bd2', 'device': 'disk', 'path': '/rhev/data-center/31fdd642-6b06-11ea-a4c4-00163e333bd2/24c4dc1b-c843-4ae2-963f-9d0548305192/images/6af66318-e6f8-45d7-8b4e-2183faf0a917/576b2761-a5bc-427b-95a9-0594447f0705', 'propagateErrors': 'off', 'name': 'sda', 'bootOrder': '1', 'volumeID': '576b2761-a5bc-427b-95a9-0594447f0705', 'diskType': 'file', 'a lias': 'ua-6af66318-e6f8-45d7-8b4e-2183faf0a917', 'discard': False}." in the log. I tried to move the VMs disk from one gluster datastore to another to see if the problem would clear and now the disk is locked and the move is stuck at %10. In the engine logs I have "2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,614-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Task id '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' has passed pre-polling period time and should be polled. Pre-polling period is 6 millis. 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] EVENT_ID: TASK_CLEARING_ASYNC_TASK(9,501), Clearing asynchronous task Unknown that started at Tue Jul 12 12:19:21 CDT 2022 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] Cleaning zombie tasks: Clearing async task 'Unknown' that started at 'Tue Jul 12 12:19:21 CDT 2022' since it reached a timeout of 3000 minutes 2022-09-19 12:48:25,631-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' 2022-09-19 12:48:25,632-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{storagePoolId='31fdd642-6b06-11ea-a4c4-00163e333bd2', ignoreFailoverLimit='false', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 40d6d67f 2022-09-19 12:48:25,633-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] START, HSMClearTaskVDSCommand(HostName = hprvsr00.locacore.com, HSMTaskGuidBaseVDSCommandParameters:{hostId='6c910725-fb42-4a64-b614-2a29bf0800e2', taskId='4b96a8e1-ab65-4d1c-97dd-e985ab7816c6'}), log id: 22c28060 2022-09-19 12:48:25,638-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, HSMClearTaskVDSCommand, return: , log id: 22c28060 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] FINISH, SPMClearTaskVDSCommand, return: , log id: 40d6d67f 2022-09-19 12:48:25,639-05 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-87) [] SPMAsyncTask::ClearAsyncTask: At time of attempt to clear task '4b96a8e1-ab65-4d1c-97dd-e985ab7816c6' the response code was 'TaskStateError' and message was 'Operation is not allowed in this task state: ("can't clean in state running",)'. Task will not be cleaned 2022-09-19 12:48:25,876-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-98) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupWithData' (id: '9e73adde-e485-461a-b349-7fd814890aa6') waiting on child command id: '5b4d0a00-7e40-4016-bf5c-0db013e22983' type:'CopyImageGroupVolumesData' to complete 2022-09-19 12:48:26,878-05 INFO [org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-84) [149db168-34c0-4814-869e-1ca0fdbde768] Command 'CopyImageGroupVolumesData' (id:
[ovirt-users] Re: Cannot Log Into Newly Deployed Hosted Engine
Disregard this entry. I have solved my own problem by net research. It appears that the default username has been changed from admin@internal to admin@ovirt. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HLRTBROUNUAMKP7F6Q3YZFRMQGDOAPNF/
[ovirt-users] Re: Cannot Log Into Newly Deployed Hosted Engine
Below is a clip from keycloak.log: 2022-06-29 10:19:07,007-05 WARN [org.keycloak.events] (default task-1) [] type=LOGIN_ERROR, realmId=0dd6bd82-1891-4dd9-b3bd-9d06b10de669, clientId=ovirt-engine-internal, userId=null, ipAddress=10.1.1.243, error=user_not_found, auth_method=openid-connect, auth_type=code, redirect_uri=https://ovirtmgmt.mycompany.com/ovirt-engine-grafana/login/generic_oauth, code_id=3604ab03-f6ac-4c37-bc09-7b9134fab738, username=admin, authSessionParentId=3604ab03-f6ac-4c37-bc09-7b9134fab738, authSessionTabId=aFumUTpYJd And another one: 2022-06-29 10:07:54,551-05 WARN [org.keycloak.events] (default task-1) [] type=LOGIN_ERROR, realmId=0dd6bd82-1891-4dd9-b3bd-9d06b10de669, clientId=ovirt-engine-internal, userId=null, ipAddress=10.1.1.243, error=user_not_found, auth_method=openid-connect, redirect_uri=https://ovirtmgmt.mycompany.com/ovirt-engine/callback, code_id=3604ab03-f6ac-4c37-bc09-7b9134fab738, username=admin, authSessionParentId=3604ab03-f6ac-4c37-bc09-7b9134fab738, authSessionTabId=xAhvvzLK6ZE ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XYPIKP4RDIVP277OPRWYKOWVPY5IWBHB/
[ovirt-users] Cannot Log Into Newly Deployed Hosted Engine
I have a fresh installation of a 4.5.1 hosted engine and the admin password I set during the process isn't working. I reset the password for the admin user from a root shell on the HE using the ovirt-aaa-jdbc-tool utility and still no dice. I found a log file for "keycloak" that I tailed while logging in and discovered that keycloak was denying me. I am not familiar with keycloak at all. It appears as though I enabled keycloak during the deployment. Just a few quick answers may get me back to where I need to be: 1. How do I log into the web management portal ? Previously it was admin@internal and then the password 2. If keycloak is looking for some kind of directory server outside of the engine I don't have one, if the engine is the keycloak server what are my credentials for the HE portal ? 3. Can I re-run engine-setup and turn Keycloak off so that I have internal based authentication ? Below is dump of my engine-setup command results: Default SAN wipe after delete : False Host FQDN : ovirtmgmt.mycompany.com Firewall manager: firewalld Update Firewall : True Set up Cinderlib integration: False Keycloak installation : True Engine database host: localhost Engine database port: 5432 Engine database secured connection : False Engine database host name validation: False Engine database name: engine Engine database user name : engine Engine installation : True PKI organization: mycompany.com Set up ovirt-provider-ovn : True Grafana integration : True Grafana database user name : ovirt_engine_history_grafana Keycloak database host : localhost Keycloak database port : 5432 Keycloak database secured connection: False Keycloak database host name validation : False Keycloak database name : ovirt_engine_keycloak Keycloak database user name : ovirt_engine_keycloak Configure VMConsole Proxy : True Configure WebSocket Proxy : True DWH installation: True DWH database host : localhost DWH database port : 5432 DWH database secured connection : False DWH database host name validation : False DWH database name : ovirt_engine_history DWH database user name : ovirt_engine_history Backup DWH database : True ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Q3V527WM7O5C2X3JLVZU646WMOSNKX6O/
[ovirt-users] Re: HCI Deployment oVirt 4.5
Thank you very much for the tip. I was able to successfully deploy the engine appliance on the gluster configuration that I deployed previously from the cockpit interface. I cannot log into the management portal via username and password and it appears as though keycloak is the culprit. I'll open another thread for that problem. Thank you again for your help. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AHAWINNLTPYAXNRYTZTHYCABKCUB474H/
[ovirt-users] Re: HCI Deployment oVirt 4.5
Today I reloaded all three nodes with the 4.5.1 ovirt node appliance iso. During the install I used the gui to bond the two 10gig interfaces using the recommended naming convention. I prepped the nodes according to the documentation and invoked the cockpit installation method from node1. The gluster portion of the hyperconverged deployment went well. When the gluster portion of the deployment was finished I proceeded to the hosted engine deployment phase in the cockpit environment. The system immediately threw that same interface error. "No valid network interface has been found If you are using Bonds or VLANs Use the following naming conventions:" [root@hprvsr0 ~]# nmcli con show NAMEUUID TYPE DEVICE bond0 c3823f14-4856-42f9-85a0-19370933a0ac bond bond0 bond1 25c9f64c-1cce-4b5f-93dd-488ee5c32729 bond bond1 virbr0 6ddf263d-a7df-4976-83c6-b241659c1023 bridgevirbr0 eno105208633-17f2-48b4-b8a7-d7ed006eb929 ethernet eno1 eno2c2720d01-f9c2-4f15-a63d-4a2214b1246b ethernet eno2 ens3f0 2c585f34-4f1d-4c46-8c04-f15749e09158 ethernet ens3f0 ens3f1 39b53c5b-9bfc-47ae-b659-b23320e612ab ethernet ens3f1 eno16981185b-2e06-4df7-ab1b-d161b2e3fd9f ethernet -- eno26b896a93-4e88-4e08-8d5e-2a48b33eb30e ethernet -- eno3caf0d4e4-88e3-46cd-a3a7-26797697f6ec ethernet -- eno4c945f081-872c-4756-910c-1749c6eb0cf2 ethernet -- ens3f0 6cfcb97b-aaf0-4536-99ea-7a85c44d5a5c ethernet -- ens3f1 b9d39a15-14df-4433-a1af-f05f5b88282e ethernet -- Anybody got any ideas ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z6LNHWMCHENJSZBDTWROOHU7X3FHIOLA/
[ovirt-users] Re: HCI Deployment oVirt 4.5
I did use classic bonding and not teaming. I'm trying to install hyperconverged three node oVirt cluster with self hosted engine. I've done it before in the 4.3 world but not in the 4.4 or 4.5 world. I'm using the cockpit method for deploying the cluster from the first node from the documentation. Should I reload the nodes and create the bonds from the nmcli command line instead of from the installation gui ? output from ip a: 1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 inet 127.0.0.1/8 scope host lo valid_lft forever preferred_lft forever inet6 ::1/128 scope host valid_lft forever preferred_lft forever 2: eno1: mtu 1500 qdisc mq master bond1 state UP group default qlen 1000 link/ether e4:43:4b:61:a9:b0 brd ff:ff:ff:ff:ff:ff 3: ens3f0: mtu 1500 qdisc mq master bond0 state UP group default qlen 1000 link/ether a0:36:9f:b8:97:9c brd ff:ff:ff:ff:ff:ff 4: eno2: mtu 1500 qdisc mq master bond1 state UP group default qlen 1000 link/ether e4:43:4b:61:a9:b0 brd ff:ff:ff:ff:ff:ff permaddr e4:43:4b:61:a9:b1 5: ens3f1: mtu 1500 qdisc mq master bond0 state UP group default qlen 1000 link/ether a0:36:9f:b8:97:9c brd ff:ff:ff:ff:ff:ff permaddr a0:36:9f:b8:97:9e 6: eno3: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether e4:43:4b:61:a9:b2 brd ff:ff:ff:ff:ff:ff 7: eno4: mtu 1500 qdisc mq state UP group default qlen 1000 link/ether e4:43:4b:61:a9:b3 brd ff:ff:ff:ff:ff:ff 8: ovs-system: mtu 1500 qdisc noop state DOWN group default qlen 1000 link/ether 2e:9e:5f:6d:50:7b brd ff:ff:ff:ff:ff:ff 9: br-int: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 link/ether 46:26:b5:a2:3a:0a brd ff:ff:ff:ff:ff:ff 10: ovirtmgmt: mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether a0:36:9f:b8:97:9c brd ff:ff:ff:ff:ff:ff inet 10.66.23.100/24 brd 10.66.23.255 scope global noprefixroute ovirtmgmt valid_lft forever preferred_lft forever inet6 fe80::a236:9fff:feb8:979c/64 scope link noprefixroute valid_lft forever preferred_lft forever 11: bond1: mtu 1500 qdisc noqueue state UP group default qlen 1000 link/ether e4:43:4b:61:a9:b0 brd ff:ff:ff:ff:ff:ff inet 10.55.21.100/24 brd 10.55.21.255 scope global noprefixroute bond1 valid_lft forever preferred_lft forever inet6 fe80::d70:c3f8:851c:c388/64 scope link noprefixroute valid_lft forever preferred_lft forever 12: bond0: mtu 1500 qdisc noqueue master ovirtmgmt state UP group default qlen 1000 link/ether a0:36:9f:b8:97:9c brd ff:ff:ff:ff:ff:ff 15: ip_vti0@NONE: mtu 1480 qdisc noop state DOWN group default qlen 1000 link/ipip 0.0.0.0 brd 0.0.0.0 Output From nmcli con show: ovirtmgmt b33ee040-938b-40ac-a52a-b3192c7ac9f3 bridgeovirtmgmt bond1 770d63df-62ea-4908-ae26-7887d3cdea4f bond bond1 bond0 09a0fb7f-98da-43cd-8013-461c0884c64d ethernet ens3f0 bond0 a5637915-df3f-408c-a8dd-004795599028 ethernet ens3f1 bond0 ca2b3e59-879f-4040-a4e6-62d0bb0a08e7 bond bond0 bond1 459d6944-d017-4b54-a657-2eeaeccb9efa ethernet eno2 bond1 e58b10ee-77e8-4254-a66d-baf3c295d559 ethernet eno1 bond2 731b08c8-2dc8-456a-aadb-4693f9b51bd8 ethernet -- bond2 3b7a36be-101e-47ab-a351-7a887cc07b70 ethernet -- bond2 83c07c03-629a-4f90-b6bd-16e29b2f5f3e bond -- eno1 1a1d7226-fa0c-4527-b0da-7465213c561b ethernet -- eno2 1eacb960-00b7-4778-a692-1c34d64cce3f ethernet -- eno3 7d7b633a-99da-4272-93af-13596f63a308 ethernet -- eno4 c537f2d3-3d17-487c-a89a-5d91f5536a18 ethernet -- ens3f0 fb63f81f-08b8-4d01-975e-9b35cd9bedcc ethernet -- ens3f1 a50979ea-e6b4-4da5-90cd-1cb1c320abb8 ethernet -- ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/GP7IYDVJ23BJW2CNACTT3CPZJE7K23FT/
[ovirt-users] Re: HCI Deployment oVirt 4.5
"No valid network interface has been found If you are using Bonds or VLANs Use the following naming conventions: " However I am using a supported naming convention. I've searched the forums and the general WWW and read the articles that match my errors. i've tried some of the options that are referenced in the articles but still no forward motion. Is this a common problem that somebody else has already solved and I just am not finding it on the web ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/AC5RYTJBATLZTS5OKAXPR2QBPCEAJUF3/
[ovirt-users] HCI Deployment oVirt 4.5
Hello oVirt Team I'm in the process of deploying a three-node oVirt hyperconverged platform and from the cockpit interface of the deployment node I keep running into the same error. The system finishes the gluster deployment phase (sometimes) and then prompts to continue with the hosted engine deployment but then fails immediately complaining about the naming convention of my network interfaces. My network interfaces are 802.3ad bonds configured during the installation process of each node using "bondx" naming convention consistent across all three nodes. Any wisdom or pointers would be appreciated. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HTKEHRFJIQFBAEI5GLV2X5DZ4GJYW7HN/
[ovirt-users] Re: Preferred RHEL Based Distro For oVirt
Thank you Gilboa. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/RLEWMGR4DLYIO5FXMVE7PDRW7YYF4EHG/
[ovirt-users] Re: Preferred RHEL Based Distro For oVirt
Thanks a bunch for the input Neal. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/6OULTTH2QMXM2LIK2QBDPWK6TISD22SS/
[ovirt-users] Preferred RHEL Based Distro For oVirt
Good Day All; i am inquiring about which RHEL based distros are currently preferred and which ones are currently supported. I know the oVirt project is a RH entity and so RHEL and CentOS-Stream are the base offering. Would it, or is it, feasible for Rocky 8.X, or Alma 8.X to be the base OS for an oVirt deployment seeing as though they both RHEL clones ? How confident is the user community in the stability of CentOS-Stream in terms of production use as compared to Alma or Rocky ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/L4OYL2OOGT4J7GBKX2UCCLQDIVD2XZ26/
[ovirt-users] Re: Dedicated Migration Network
Thank you Abe, Angus, and Strahil. I appreciate your direction and input. ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/2M6HF4FU2FYAHIRIMOVILVGYZSU72MP5/
[ovirt-users] Re: Dedicated Migration Network
Thanks for the input Abe. For the dedicated migration network, would I need to IP the bonds that I plan to use for that migration network and should they be in an isolated vlan or should the bonds be sans IP in their own vlan ? ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/LRSUTY7YC2QZ3DOL6LTZPGINWUZHFTLQ/
[ovirt-users] Dedicated Migration Network
Good Day All; I am in the process of assembling a new oVirt cluster and I am wondering if there is any benefit to having a dedicated set of nics solely dedicated to VM migration. If so, would those nics (bonded) be on their own vlan and subnet or would they share a subnet with gluster storage or the management network ? Right now i'm planning on the following architecture. 1. Management = 10G X2 Bond per hypervisor host (10.66.0.0/24) 2. Gluster/iSCSI Storage = 10G X2 Bond per hypervisor host (10.244.0.0/24) 3. VM Production Network(s) = 10G X2 Bond per hypervisor host (No IP Range) 4. ?? Possible Dedicated VM Migration Thank you very much as any input would be greatly appreciated ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/JFHLAJ2RGWFA4VEOJZCDT2UND2AEVKHI/
[ovirt-users] HCI Cluster Configuration
Ovirt 4.3.9 HCI Gluster 3 Dell 730XD Managed Engine When I finished the "hosted engine deploy" I failed to add the gluster storage according to the documentation and i'd like to get that back on track. 1. I ticked the check box in the cluster configuration to "enable gluster service", all of my current gluster storage domains went "red triangle" on me and the hosts also went "red triangle" so I quickly changed it back and all went back to normal. Do I need to check that box to make the "Use Managed Gluster Volume" check box and drop down menu show my HCI gluster volumes that exist on the three nodes ? Do I need to put the storage domain(s) in maintenance mode to change them from unmanaged to managed ? Will the system honor the VM(s) that live in my "engine" and "vmstore" gluster volumes which are currently in use in the system if/when I change them from unmanaged to managed,or will the system wipe them and hose my managed engine and VMs ? Thank you for your help ! ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/RHEAWT7TY2GDHNVCI6EWXSLB5IJIHWFO/
[ovirt-users] Cannot Activate iSCSI Storage Domain After Errors
Good Day To all; oVirt 4.3.4.3-1.el7 6 Dell R710 oVirt Nodes 10 gig Infiniband iSCSI Standalone Engine After an error during scheduled automated VM backkup, the iSCSi datastore that the VMs beinng backed up lived on suddenly went inactive and refuse to activate. The backup job did not finish as the source datastore went inactive but the task did clear from the console after i restarted the ovirt-engine service. I have tried: 1. Restart the ovirt-engine service 2. Restarted the engine physical server. 3. Tried to migrate the VM disks to a different datastore (failure) The virtual machines that are currently living on the inactive datastore are still running and accessible. Trying to reboot one of those VM as a test fails as the VM will not come up due to the system believing that the datastore is inactive. From engin.log: 2019-09-15 17:09:08,787-05 INFO [org.ovirt.engine.core.bll.storage.disk.RemoveDiskCommand] (EE-ManagedThreadFactory-commandCoordinator-Thread-8) [fbdd9b7] Removing 'Wildix4-PBX_snapshot_metadata' disk 2019-09-15 17:09:13,399-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-commandCoordinator-Thread-8) [fbdd9b7] EVENT_ID: IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command DeleteImageGroupVDS failed: General Storage Exception: ('5 [\' Logical volume d1c5f4da-9024-4599-9135-4dabafe86cf8/c5f64501-142b-4a38-9b9c-faf283a64b06 changed.\'] [\' WARNING: This metadata update is NOT backed up.\', \' WARNING: Combining activation change with other commands is not advised.\', \' /dev/mapper/36001405f448f60ecea7479f9d920ac51: Checksum error at offset 19198423553536\', " Couldn\'t read volume group metadata from /dev/mapper/36001405f448f60ecea7479f9d920ac51.", \' Metadata location on /dev/mapper/36001405f448f60ecea7479f9d920ac51 at 19198423553536 has invalid summary for VG.\', \' Failed to read metadata summary from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Failed to scan VG from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Volume group "d1c5f4da-9024-4599-9135-4dabafe86cf8" not found\', \' Cannot process volume group d1c5f4da-9024-4599-9135-4dabafe86cf8\']\nd1c5f4da-9024-4599-9135-4dabafe86cf8/{\'c5f64501-142b-4a38-9b9c-faf283a64b06\': ImgsPar(imgs=[\'aadbfed3-af54-4400-af79-65d09b74c687\'], parent=\'----\')}',) 2019-09-15 17:09:13,399-05 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (EE-ManagedThreadFactory-commandCoordinator-Thread-8) [fbdd9b7] IrsBroker::Failed::DeleteImageGroupVDS: IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS, error = General Storage Exception: ('5 [\' Logical volume d1c5f4da-9024-4599-9135-4dabafe86cf8/c5f64501-142b-4a38-9b9c-faf283a64b06 changed.\'] [\' WARNING: This metadata update is NOT backed up.\', \' WARNING: Combining activation change with other commands is not advised.\', \' /dev/mapper/36001405f448f60ecea7479f9d920ac51: Checksum error at offset 19198423553536\', " Couldn\'t read volume group metadata from /dev/mapper/36001405f448f60ecea7479f9d920ac51.", \' Metadata location on /dev/mapper/36001405f448f60ecea7479f9d920ac51 at 19198423553536 has invalid summary for VG.\', \' Failed to read metadata summary from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Failed to scan VG from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Volume group "d1c5f4da-9024-4599-9135-4dabafe86cf8" not found\', \' Cannot process volume group d1c5f4da-9024-4599-9135-4dabafe86cf8\']\nd1c5f4da-9024-4599-9135-4dabafe86cf8/{\'c5f64501-142b-4a38-9b9c-faf283a64b06\': ImgsPar(imgs=[\'aadbfed3-af54-4400-af79-65d09b74c687\'], parent=\'----\')}',), code = 200 2019-09-15 17:09:13,463-05 ERROR [org.ovirt.engine.core.bll.storage.disk.image.RemoveImageCommand] (EE-ManagedThreadFactory-commandCoordinator-Thread-8) [fbdd9b7] Command 'org.ovirt.engine.core.bll.storage.disk.image.RemoveImageCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.irsbroker.IRSErrorException: IRSGenericException: IRSErrorException: Failed to DeleteImageGroupVDS, error = General Storage Exception: ('5 [\' Logical volume d1c5f4da-9024-4599-9135-4dabafe86cf8/c5f64501-142b-4a38-9b9c-faf283a64b06 changed.\'] [\' WARNING: This metadata update is NOT backed up.\', \' WARNING: Combining activation change with other commands is not advised.\', \' /dev/mapper/36001405f448f60ecea7479f9d920ac51: Checksum error at offset 19198423553536\', " Couldn\'t read volume group metadata from /dev/mapper/36001405f448f60ecea7479f9d920ac51.", \' Metadata location on /dev/mapper/36001405f448f60ecea7479f9d920ac51 at 19198423553536 has invalid summary for VG.\', \' Failed to read metadata summary from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Failed to scan VG from /dev/mapper/36001405f448f60ecea7479f9d920ac51\', \' Volume group
[ovirt-users] VM With Snapshots Marked As Illegal
Greetings oVirt Users; Environment: oVirt 4.2.0.2-1 1 Dedicated Engine 6 Hypervisor Nodes iSCSI Storage All running CentOS 7.5 I have a VM with the illegal snapshot error. After doing some research on the condition i have found some methods for fixing the problem by connecting to the database and repairing the fault. I am unable to connect to the engine database from the engine command line with the password in 10-setup-database.conf for whatever reason. (likely user error) I don't really need the disk that is attached to this VM that is at fault as it is a disk that is being utilized by the VM to perform local backups and that function has been moved to an offsite backup solution. If I shut down the afflicted VM, then delete the un-needed disk, will the snapshots be deleteed and thus the problem alleviated ? Or will the system not delete the un-needed disk because of the fault and then not reboot because if the illegal statu of the snapshot ? I have tried to delete the snapshots, and the system refuses to do so. I may need some guidance regarding connecting to my engine database if i cannot delete the un-needed disk. Thank you all for any help in this matter, and if more information is needed please let me know. ~Clint Boggio ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/XXA5545OHXMPOA6LGKV46N3ULBN5U66I/
Re: [ovirt-users] newbie questions on networking
You should query the network to team for sure. You should also use use the ping command (from the VM) to troubleshoot possible MTU problems getting to your infrastructure DNS servers and gateway. # ping -M do -s 1472 xxx.xxx.xxx.xxx Starting at 1472 and “walking” the -s up and down will help you determine your situation. If at all possible, you could take the production switches and gateway out of the equation with your own isolated gear. > On May 7, 2018, at 5:45 PM, Rue, Randy <randy...@gmail.com> wrote: > > Looks like the physical interface on the host and the virtual interface on > the VM are both at the default 1500 MTU. > > How can I determine the MTU setting for the physical switches without admin > access to them? Or do I need to ask the network team? > > > >> On 5/7/2018 2:03 PM, Clint Boggio wrote: >> Randy this flaky layer two problem reeks of a possible MTU situation between >> your oVirt switches and your physical switches. >> >>> On May 7, 2018, at 3:59 PM, Dominik Holler <dhol...@redhat.com> wrote: >>> >>> On Mon, 7 May 2018 11:43:51 -0700 >>> "Rue, Randy" <randy...@gmail.com> wrote: >>> >>>> I've sort of had some progress. On Friday I went to the dentist and >>>> when I returned, my VM could ping google. >>>> >>>> I don't believe I changed anything Friday morning but I confess I've >>>> been flailing on this for so long I'm not keeping detailed notes on >>>> what I change. And as I'm evaluating oVirt as a possible replacement >>>> for our production xencenter/xenserver systems, I need to know what >>>> was wrong and what fixed it. >>>> >>>> I reinstalled the ovirt-engine box and two hosts and started again. >>>> The only change I've made beyond the default is to remove the >>>> no-mac-spoofing filter from the ovirtmgmt vNIC profile so there are >>>> no filters applied. At this point I'm back to an ubuntu LTS server VM >>>> that again, is getting a DHCP IP address, nameserver entries in >>>> resolv.conf, and "route" shows correct local routing for addresses on >>>> the same subnet and the correct gateway for the rest of the world. >>>> The VM is even registering its hostname in our DNS correctly. And I >>>> can ping the static IP of the host the VM is on, but not the subnet >>>> gateway or anything in the real world. >>>> >>> Can you ping the DHCP server? >>> >>>> Two things I haven't mentioned that I haven't seen anything in the >>>> docs about. My ovirt-engine box is on a different subnet than my >>>> hosts, and my hosts are using a bonded pair of physical interfaces >>>> (XOR mode) for their single LAN connection. >>> Was the bond created before adding the hosts to oVirt, or after adding >>> the hosts via oVirt web UI? >>> If the switch requires configuration for the bond, is this applied? >>> Can you check if the VM can ping the getaway, if you use a simple >>> Ethernet connection instead of the bond? >>> >>>> Did I miss something in the docs where these are a problem? >>>> >>>> Dominik, to answer your thoughts earlier: >>>> >>>> * name resolution isn't happening at all, the VM can't reach a DNS >>>> server >>>> >>>> * I don't manage the data center network gear but am pretty sure >>>> there's no configuration that blocks traffic. This is supported by my >>>> temporary success on Friday. And we also have other virtualization >>>> hosts (VMWare hosts) in the same subnet, that forward traffic to/from >>>> their VMs just fine. >>>> >>> OK, L3 seems to work now sometimes. >>> >>>> * tcpdump on the host's ovirtmgmt interface is pretty noisy but if I >>>> grep for the ubuntu DDNS name I see a slew of ARP requests. I can see >>>> pings to the host's IP address, and attempts to SSH from the VM to >>>> its host. Any attempt to touch anything past the host shows nothing >>>> on any interface in tcpdump, not a ping to the subnet gateway, not an >>>> SSH attempt, not a DNS query or a ping to known IP address. >>>> >>> The outgoing ARP requests looks like the traffic of the VM is forwarded >>> to ovirtmgmt. >>> Do you see ARP reply to the VM? >>> Maybe the VM fails to get the MAC address of the gateway. >>> >>>> * hot damn, here's a clue! I can ping other oVirt hosts! (by IP only) >>>> I also tried pinging the ovirt-engine box, wasn't surprised when that >>>> failed as the VM would need to reach the gateway to get to the >>>> different subnet. >>>> >>>> So it appears that even though I've set up the ovirtmgmt network >>>> using defaults, and it has the "VM Network" option checked, my >>>> logical network is still set to only allow traffic between the VMs >>>> and hosts. >>>> >>>> What am I missing? >>>> >>>> -randy >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] newbie questions on networking
Randy this flaky layer two problem reeks of a possible MTU situation between your oVirt switches and your physical switches. > On May 7, 2018, at 3:59 PM, Dominik Hollerwrote: > > On Mon, 7 May 2018 11:43:51 -0700 > "Rue, Randy" wrote: > >> I've sort of had some progress. On Friday I went to the dentist and >> when I returned, my VM could ping google. >> >> I don't believe I changed anything Friday morning but I confess I've >> been flailing on this for so long I'm not keeping detailed notes on >> what I change. And as I'm evaluating oVirt as a possible replacement >> for our production xencenter/xenserver systems, I need to know what >> was wrong and what fixed it. >> >> I reinstalled the ovirt-engine box and two hosts and started again. >> The only change I've made beyond the default is to remove the >> no-mac-spoofing filter from the ovirtmgmt vNIC profile so there are >> no filters applied. At this point I'm back to an ubuntu LTS server VM >> that again, is getting a DHCP IP address, nameserver entries in >> resolv.conf, and "route" shows correct local routing for addresses on >> the same subnet and the correct gateway for the rest of the world. >> The VM is even registering its hostname in our DNS correctly. And I >> can ping the static IP of the host the VM is on, but not the subnet >> gateway or anything in the real world. >> > > Can you ping the DHCP server? > >> Two things I haven't mentioned that I haven't seen anything in the >> docs about. My ovirt-engine box is on a different subnet than my >> hosts, and my hosts are using a bonded pair of physical interfaces >> (XOR mode) for their single LAN connection. > > Was the bond created before adding the hosts to oVirt, or after adding > the hosts via oVirt web UI? > If the switch requires configuration for the bond, is this applied? > Can you check if the VM can ping the getaway, if you use a simple > Ethernet connection instead of the bond? > >> Did I miss something in the docs where these are a problem? >> >> Dominik, to answer your thoughts earlier: >> >> * name resolution isn't happening at all, the VM can't reach a DNS >> server >> >> * I don't manage the data center network gear but am pretty sure >> there's no configuration that blocks traffic. This is supported by my >> temporary success on Friday. And we also have other virtualization >> hosts (VMWare hosts) in the same subnet, that forward traffic to/from >> their VMs just fine. >> > > OK, L3 seems to work now sometimes. > >> * tcpdump on the host's ovirtmgmt interface is pretty noisy but if I >> grep for the ubuntu DDNS name I see a slew of ARP requests. I can see >> pings to the host's IP address, and attempts to SSH from the VM to >> its host. Any attempt to touch anything past the host shows nothing >> on any interface in tcpdump, not a ping to the subnet gateway, not an >> SSH attempt, not a DNS query or a ping to known IP address. >> > > The outgoing ARP requests looks like the traffic of the VM is forwarded > to ovirtmgmt. > Do you see ARP reply to the VM? > Maybe the VM fails to get the MAC address of the gateway. > >> * hot damn, here's a clue! I can ping other oVirt hosts! (by IP only) >> I also tried pinging the ovirt-engine box, wasn't surprised when that >> failed as the VM would need to reach the gateway to get to the >> different subnet. >> >> So it appears that even though I've set up the ovirtmgmt network >> using defaults, and it has the "VM Network" option checked, my >> logical network is still set to only allow traffic between the VMs >> and hosts. >> >> What am I missing? >> >> -randy > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Cluster Processor Change
Forgive me if this is a duplicate, as I had spam filter problems previously when I sent this inquiry. Environment Rundown: OVirt 4.2 6 CentOS 7.4 Compute Nodes Intel Xeon 1 CentOS 7.4 Dedicated Engine Node Intel Xeon 1 Datacenter 1 Storage Domain 1 Cluster 10Gig-E iSCSI Storage 10Gig-E NFS Export Domain 20 VM’s of various OS’s and uses The current cluster is using the Nehalem architecture. I’ve got the deploy two new VMs that the current system will not allow me to configure with the Nehalem based cluster, so I’ve got to bump up the architecture of the cluster to accommodate them. Before i shut down all the current VMs to upgrade the cluster, I have some questions about the effect this is going to have on the environment. 1. Will all of the current VM’s use the legacy processor architecture or will I have to change them ? 2. Can I elevate the cluster processor functionality higher than the underlying hardware architecture ? 3. In regards to the new cluster processor, will all of the processor architectures below the one I choose be an option for the existing and future VMs ? I apologize for the long post and I hope that I haven’t left out any vital information. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Greetings oVirt Users
Environment Rundown: OVirt 4.2 6 CentOS 7.4 Compute Nodes Intel Xeon 1 CentOS 7.4 Dedicated Engine Node Intel Xeon 1 Datacenter 1 Storage Domain 1 Cluster 10Gig-E iSCSI Storage 10Gig-E NFS Export Domain 20 VM’s of various OS’s and uses The current cluster is using the Nehalem architecture. I’ve got the deploy two new VMs that the current system will not allow me to configure with the Nehalem based cluster, so I’ve got to bump up the architecture of the cluster to accommodate them. Before i shut down all the current VMs to upgrade the cluster, I have some questions about the effect this is going to have on the environment. 1. Will all of the current VM’s use the legacy processor architecture or will I have to change them ? 2. Can I elevate the cluster processor functionality higher than the underlying hardware architecture ? 3. In regards to the new cluster processor, will all of the processor architectures below the one I choose be an option for the existing and future VMs ? I apologize for the long post and I hope that I haven’t left out any vital information. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] VM Disks Locked
Well Brett that's not totally out of the question however I'd prefer not to. I've seen other threads whereby there was a database command to locate the problem, and then a command to take that information and solve the problem. This system is very much in production and I'd like to avoid poking it with a stick lol. Clint Boggio Cell 903.918.8461 Office 903.213.2523 ext. 210 On Jan 5, 2017, at 9:38 AM, Maton, Brett <mat...@ltresources.co.uk<mailto:mat...@ltresources.co.uk>> wrote: Hopefully someone else will confirm or scream don't do it, before you try this. In the past I've managed to resolve hung tasks and the like by running engine-setup on the engine host On 5 January 2017 at 14:35, Clint Boggio <cbog...@inlinenetworks.com<mailto:cbog...@inlinenetworks.com>> wrote: Good day ovirt family. I'm having trouble with a VM showing that the disk is locked after trying to clone that VM to a new VM. The source machine was powered off when the clone was initiated. The source and destination disks both show to be locked and are currently un-usable. This situation was brought on around December 27 2016 and persists. I have read some of the other threads and using the information therein, have not been able to alleviate the condition. I have not tried to alter the database though, which I know is one of the solutions to this problem. I am not confident enough in my diagnosis of the condition to alter the database at this time. I have tried moving SPM to another node, and I have restarted ovirt-engine on the management server. My setup is: 1. Dedicated ovirt-engine version 3.6 on CentOS 7 2. 6 hosts running version 3.6 on CentOS 7 Any help to resolve this would be appreciated. ___ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] VM Disks Locked
Good day ovirt family. I'm having trouble with a VM showing that the disk is locked after trying to clone that VM to a new VM. The source machine was powered off when the clone was initiated. The source and destination disks both show to be locked and are currently un-usable. This situation was brought on around December 27 2016 and persists. I have read some of the other threads and using the information therein, have not been able to alleviate the condition. I have not tried to alter the database though, which I know is one of the solutions to this problem. I am not confident enough in my diagnosis of the condition to alter the database at this time. I have tried moving SPM to another node, and I have restarted ovirt-engine on the management server. My setup is: 1. Dedicated ovirt-engine version 3.6 on CentOS 7 2. 6 hosts running version 3.6 on CentOS 7 Any help to resolve this would be appreciated. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Adding Infiniband VM Network Fails
That is correct. We are successfully using ib0 to access iSCSI and NFS on all nodes. We are now trying to create a network for the VMs to use on ib1. > On Nov 16, 2016, at 1:40 PM, "users-requ...@ovirt.org" >wrote: > > Adding Infiniband VM Network Fails ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Adding Infiniband VM Network Fails
That is correct. The ib0 in all of the HV nodes are accessing iSCSI and NFS over that IB link successfully. What we are trying to do now is create a network that utilizes the second IB port (ib1) on the cards for some of the virtual machines that live inside the environment. > On Nov 16, 2016, at 1:40 PM, Markus Stockhausen> wrote: > > Hi, > > we are running Infiniband on the NFS storage network only. Did I get > it aight that this works or do you already have issues there? > > Best regards. > > Markus > > Web: www.collogia.de > > > Von: users-boun...@ovirt.org [users-boun...@ovirt.org] im Auftrag von > cl...@theboggios.com [cl...@theboggios.com] > Gesendet: Mittwoch, 16. November 2016 20:10 > An: users@ovirt.org > Betreff: [ovirt-users] Adding Infiniband VM Network Fails > > Good Day; > > I am trying to add an infiniband VM network to the hosts on my ovirt > deployment, and the network configuration on the hosts fails to save. > The network bridge is added successfully, but applying the bridge to the > IB1 nic fails with little information other than it failed. > > My system: > > 6 HV nodes running CentOS 7 and OV version 4 > 1 Dedicated engine running CentOS 7 and engine version 4 in 3.6 mode. > > The HV nodes all have Mellanox IB cards, dual port. Port 0 is for iSCSI > and NFS connectivity and runs fine. Port 1 is for VM usage of the 10Gb > network. > > Have any of you had any dealings with this ? > > > ___ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > = > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] 3.6 to 4.0 Functionality Elevation
Greetings OVirt Community I have a production system that started life as a OV 3.6 system, and I've recently upgraded the engine to 4.0. I see in the cluster config, a configuration element that indicates the cluster functionality level. It has a drop down that allows me to toggle between 3.6, and 4.0. If I select 4.0 and save, what potential problems could I expect ? Setup; 1 Dedicated engine CentOS7 OV version 4 6 hosts running CentOS7 and OV version 4.0 and 3.6 repos. Main data domain is iscsi over IB. ISO and all other data domains are NFS over IB ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Dashboard Never Loads
Yes i changed my browser from IE to Chrome and the dashboard loads beautifully. I should have checked that first and i apologize. Thank you for your help. On Wed, 2016-10-12 at 11:37 -0400, Rafael Martins wrote: > - Original Message - > > > > From: "Clint Boggio" <cl...@theboggios.com> > > To: users@ovirt.org > > Sent: Wednesday, October 12, 2016 5:26:19 PM > > Subject: [ovirt-users] Dashboard Never Loads > > > > Greetings ovirt community; > > > > I have an oVirt environment with a dedicated engine, and 4 > > compute nodes all running CentOS 7, and oVirt 4.0.1.1. On the > > management interface, the "Dashboard" tab displays "Loading" and > > the > > spinning applet is working hard, but nothing ever materializes on > > the > > screen. I aplogize if this has apready been addressed, and i > > searched > > deeply before I decided to ask the forum. > > > > Is there a document on troubleshooting this problem ? > > Hi, > > I got this issue a few times in past, and it was fixed after I > upgraded Firefox to a newer version. I don't know if this was exactly > the reason of the issue, but upgrading your browser may help, if > that's the case. > > Thanks, > Rafael > > > > > ___ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Dashboard Never Loads
Greetings ovirt community; I have an oVirt environment with a dedicated engine, and 4 compute nodes all running CentOS 7, and oVirt 4.0.1.1. On the management interface, the "Dashboard" tab displays "Loading" and the spinning applet is working hard, but nothing ever materializes on the screen. I aplogize if this has apready been addressed, and i searched deeply before I decided to ask the forum. Is there a document on troubleshooting this problem ? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Management Engine Down
Thank you both for your help in this matter. I did alleviate 95% of the problem by removing the old ldap authentication method, and successfully upgrading the engine to 4.0. Upon completion the engine did start and all is well. AD authentication is currently broken due to my own ignorance as to which option to choose when running the new tool. This is not a huge problem and I will work through it. I may need some hand holding regarding the aaa setup, but I'll ask after I've read the documentation and failed to complete the task. Thank you again for your willingness to help. > On Aug 2, 2016, at 4:23 AM, Ondra Machacek <omach...@redhat.com> wrote: > > > >> On 08/02/2016 09:40 AM, Martin Perina wrote: >> Hi, >> >> could you please share us logs from /var/log/ovirt-engine and also you >> aaa-ldap profile configuration? >> >> Thanks >> >> Martin Perina >> >> >> On Mon, Aug 1, 2016 at 9:24 PM, Clint Boggio <cbog...@inlinenetworks.com >> <mailto:cbog...@inlinenetworks.com>> wrote: >> >>Stand Alone Engine Version 3.6.X >>CentOS 7 >> >>I was preparing to upgrade from OME 3.6.2 to 4.0, when I followed >>the systems instructions to "migrate" to ovirt-engine-aaa-ldap >>authentication from the current authentication method. The >>management engine did fail to restart after the process with the >>following excerpt from "journalctl -xe" Any help or advice would be >>most appreciated. >> >>-- Subject: Unit ovirt-engine.service has begun shutting down >>-- Defined-By: systemd >>-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel >>-- >>-- Unit ovirt-engine.service has begun shutting down. >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>systemd[1]: Starting oVirt Engine... >>-- Subject: Unit ovirt-engine.service has begun start-up >>-- Defined-By: systemd >>-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel >>-- >>-- Unit ovirt-engine.service has begun starting up. >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>ovirt-engine.py[20656]: 2016-08-01 14:11:11,621 ovirt-engine: ERROR >>run:532 Error: cannot find 'getstring' > > According to this ^ error, it looks like your setup wasn't migrated properly. > It can't find method > 'getstring', which is not used anymore in 4.0, as we use jinja instead of > cheetach now, > so also assure you have correctly migrated > '/usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.xml.in' > >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>systemd[1]: ovirt-engine.service: main process exited, code=exited, >>status=1/FAILURE >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>systemd[1]: Failed to start oVirt Engine. >>-- Subject: Unit ovirt-engine.service has failed >>-- Defined-By: systemd >>-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel >>-- >>-- Unit ovirt-engine.service has failed. >>-- >>-- The result is failed. >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>systemd[1]: Unit ovirt-engine.service entered failed state. >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>systemd[1]: ovirt-engine.service failed. >>Aug 01 14:11:11 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>polkitd[8919]: Unregistered Authentication Agent for >>unix-process:20622:1107662074 (system bus name :1.6616, object pat >>Aug 01 14:13:07 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>sshd[20725]: Connection closed by 127.0.0.1 [preauth] >>Aug 01 14:15:23 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>postfix/smtpd[20767]: connect from localhost[127.0.0.1] >>Aug 01 14:15:23 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>postfix/smtpd[20767]: 0E147449: client=localhost[127.0.0.1] >>Aug 01 14:15:23 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>postfix/cleanup[20770]: 0E147449: >> >> message-id=<1441844851.3302.1470078923013.javamail.ov...@ovirtmgmt.ana-lab.com >> >> <mailto:1441844851.3302.1470078923013.javamail.ov...@ovirtmgmt.ana-lab.com>> >>Aug 01 14:15:23 oVirtMGMT.ana-lab.com <http://oVirtMGMT.ana-lab.com> >>postfix/qmgr[30740]: 0E147
[ovirt-users] Management Engine Down
Stand Alone Engine Version 3.6.X CentOS 7 I was preparing to upgrade from OME 3.6.2 to 4.0, when I followed the systems instructions to "migrate" to ovirt-engine-aaa-ldap authentication from the current authentication method. The management engine did fail to restart after the process with the following excerpt from "journalctl -xe" Any help or advice would be most appreciated. -- Subject: Unit ovirt-engine.service has begun shutting down -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-engine.service has begun shutting down. Aug 01 14:11:11 oVirtMGMT.ana-lab.com systemd[1]: Starting oVirt Engine... -- Subject: Unit ovirt-engine.service has begun start-up -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-engine.service has begun starting up. Aug 01 14:11:11 oVirtMGMT.ana-lab.com ovirt-engine.py[20656]: 2016-08-01 14:11:11,621 ovirt-engine: ERROR run:532 Error: cannot find 'getstring' Aug 01 14:11:11 oVirtMGMT.ana-lab.com systemd[1]: ovirt-engine.service: main process exited, code=exited, status=1/FAILURE Aug 01 14:11:11 oVirtMGMT.ana-lab.com systemd[1]: Failed to start oVirt Engine. -- Subject: Unit ovirt-engine.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-engine.service has failed. -- -- The result is failed. Aug 01 14:11:11 oVirtMGMT.ana-lab.com systemd[1]: Unit ovirt-engine.service entered failed state. Aug 01 14:11:11 oVirtMGMT.ana-lab.com systemd[1]: ovirt-engine.service failed. Aug 01 14:11:11 oVirtMGMT.ana-lab.com polkitd[8919]: Unregistered Authentication Agent for unix-process:20622:1107662074 (system bus name :1.6616, object pat Aug 01 14:13:07 oVirtMGMT.ana-lab.com sshd[20725]: Connection closed by 127.0.0.1 [preauth] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: connect from localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: 0E147449: client=localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/cleanup[20770]: 0E147449: message-id=<1441844851.3302.1470078923013.javamail.ov...@ovirtmgmt.ana-lab.com> Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/qmgr[30740]: 0E147449: from=, size=636, nrcpt=1 (queue active) Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: disconnect from localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: connect from localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: 10116BED4C: client=localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/cleanup[20770]: 10116BED4C: message-id=<1543794816.3303.1470078923063.javamail.ov...@ovirtmgmt.ana-lab.com> Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/qmgr[30740]: 10116BED4C: from= , size=654, nrcpt=1 (queue active) Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtpd[20767]: disconnect from localhost[127.0.0.1] Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtp[20771]: 0E147449: to= , relay=zimbra.ana-lab.com[63.98.234.179]:25, delay=0.52, delays= Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/qmgr[30740]: 0E147449: removed Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/smtp[20772]: 10116BED4C: to= , relay=inlinenetworks.com.1.0001.arsmtp.com[8.31.233.7 Aug 01 14:15:23 oVirtMGMT.ana-lab.com postfix/qmgr[30740]: 10116BED4C: removed Aug 01 14:16:33 oVirtMGMT.ana-lab.com polkitd[8919]: Registered Authentication Agent for unix-process:20798:1107694537 (system bus name :1.6617 [/usr/bin/pkt Aug 01 14:16:33 oVirtMGMT.ana-lab.com systemd[1]: Starting oVirt Engine... -- Subject: Unit ovirt-engine.service has begun start-up -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-engine.service has begun starting up. Aug 01 14:16:34 oVirtMGMT.ana-lab.com ovirt-engine.py[20803]: 2016-08-01 14:16:34,146 ovirt-engine: ERROR run:532 Error: cannot find 'getstring' Aug 01 14:16:34 oVirtMGMT.ana-lab.com systemd[1]: ovirt-engine.service: main process exited, code=exited, status=1/FAILURE Aug 01 14:16:34 oVirtMGMT.ana-lab.com systemd[1]: Failed to start oVirt Engine. -- Subject: Unit ovirt-engine.service has failed -- Defined-By: systemd -- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel -- -- Unit ovirt-engine.service has failed. -- -- The result is failed. Aug 01 14:16:34 oVirtMGMT.ana-lab.com systemd[1]: Unit ovirt-engine.service entered failed state. Aug 01 14:16:34 oVirtMGMT.ana-lab.com systemd[1]: ovirt-engine.service failed. Aug 01 14:16:34 oVirtMGMT.ana-lab.com polkitd[8919]: Unregistered Authentication Agent for unix-process:20798:1107694537 (system bus name :1.6617, object pat [root@oVirtMGMT yum.repos.d]# ___ Users mailing list Users@ovirt.org
Re: [ovirt-users] iSCSI Data Domain Down
Thank you so much Arman. With use of that command, I was able to restore service. I really appreciate the help > On May 1, 2016, at 2:58 PM, Arman Khalatyan <arm2...@gmail.com> wrote: > > Hi, before to start target cli you should remove all lvm auto-imported > volumes: > dmsetup remove_all > Then restart your targetcli. > Am 01.05.2016 1:51 nachm. schrieb "Clint Boggio" <cl...@theboggios.com>: >> Greetings oVirt Family; >> >> Due to catastrophic power failure, my datacenter lost power. I am using a >> CentOS7 server to provide ISCSI services to my OVirt platform. >> >> When the power came back on, and the iscsi server booted back up, the >> filters in lvm.conf were faulty and LVM assumed control over the LVM's that >> OVirt uses as the disks for the VMs. This tanked target.service because it >> claims "device already in use" and my datacenter is down. >> >> I've tried several filter combinations in lvm.conf to no avail, and in my >> search I've found no documentation on how to make LVM "forget" about the >> volumes that it had assumed and release them. >> >> Do any of you know of a procedure to make lvm forget about and release the >> volumes on /dev/sda ? >> >> OVirt 3.6.5 on CentOS 7 >> 4 Hypervisor nodes CentOS7 >> 1 Dedicated engine CentOS7 >> 1 iscsi SAN CentOS 7 exporting 10TB block device from a Dell Perc RAID >> controller /dev/sda with targetcli. >> 1 NFS server for ISO and Export Domains 5TB >> >> I'm out I ideas and any help would be greatly appreciated. >> >> I'm currently using dd to recover the VM disk drives over to the NFS server >> in case this cannot be recovered. >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] iSCSI Data Domain Down
Greetings oVirt Family; Due to catastrophic power failure, my datacenter lost power. I am using a CentOS7 server to provide ISCSI services to my OVirt platform. When the power came back on, and the iscsi server booted back up, the filters in lvm.conf were faulty and LVM assumed control over the LVM's that OVirt uses as the disks for the VMs. This tanked target.service because it claims "device already in use" and my datacenter is down. I've tried several filter combinations in lvm.conf to no avail, and in my search I've found no documentation on how to make LVM "forget" about the volumes that it had assumed and release them. Do any of you know of a procedure to make lvm forget about and release the volumes on /dev/sda ? OVirt 3.6.5 on CentOS 7 4 Hypervisor nodes CentOS7 1 Dedicated engine CentOS7 1 iscsi SAN CentOS 7 exporting 10TB block device from a Dell Perc RAID controller /dev/sda with targetcli. 1 NFS server for ISO and Export Domains 5TB I'm out I ideas and any help would be greatly appreciated. I'm currently using dd to recover the VM disk drives over to the NFS server in case this cannot be recovered. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Users Digest, Vol 55, Issue 155
Bug is filed. [Bug 1329000] Snapshot Images Flagged as "ILLEGAL" After Backup Script Is Run Is there a technique for recovery from this condition or should I back up the data on the VM's that are afflicted and still running and start over ? Thank you all for your help. > On Apr 20, 2016, at 3:19 PM, Nir Soffer <nsof...@redhat.com> wrote: > >> On Wed, Apr 20, 2016 at 10:42 PM, Clint Boggio <cl...@theboggios.com> wrote: >> I grepped out the engine logs until i found reference to the illegal >> disk in question. The log indicates that the image has been flagged >> illegal because the original disk is no longer present. So it is very >> possible that the backup script, somehow through the miracle of 1's and >> 0's deleted the base VM disks. >> >> ## >> # BEGIN >> ## >> >> 2016-03-27 18:57:41,769 >> INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSComma >> nd] (org.ovirt.thread.pool-8-thread-11) [30680dce] START, >> CreateSnapshotVDSCommand( >> CreateSnapshotVDSCommandParameters:{runAsync='true', >> storagePoolId='85a72afd-7bde-4065-a1bc-7fc6e22e6bf6', >> ignoreFailoverLimit='false', storageDomainId='045c7fda-ab98-4905-876c- >> 00b5413a619f', imageGroupId='ad486d26-4594-4d16-a402-68b45d82078a', >> imageSizeInBytes='268435456000', volumeFormat='COW', >> newImageId='e87e0c7c-4f6f-45e9-90ca-cf34617da3f6', >> newImageDescription='', imageInitialSizeInBytes='0', imageId='d538e0ef- >> 2f55-4c74-b8f1-8900fd6b814b', sourceImageGroupId='ad486d26-4594-4d16- >> a402-68b45d82078a'}), log id: 7648bbd2 >> 2016-03-27 18:57:42,835 >> INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSComma >> nd] (org.ovirt.thread.pool-8-thread-11) [30680dce] FINISH, >> CreateSnapshotVDSCommand, return: e87e0c7c-4f6f-45e9-90ca-cf34617da3f6, >> log id: 7648bbd2 >> 2016-03-27 18:58:24,395 >> INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand >> ] (org.ovirt.thread.pool-8-thread-20) [30680dce] START, >> GetImageInfoVDSCommand( >> GetImageInfoVDSCommandParameters:{runAsync='true', >> storagePoolId='85a72afd-7bde-4065-a1bc-7fc6e22e6bf6', >> ignoreFailoverLimit='false', storageDomainId='045c7fda-ab98-4905-876c- >> 00b5413a619f', imageGroupId='ad486d26-4594-4d16-a402-68b45d82078a', >> imageId='e87e0c7c-4f6f-45e9-90ca-cf34617da3f6'}), log id: 6d2d19f6 >> 2016-03-28 14:14:49,454 >> INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MergeVDSCommand] >> (pool-7-thread-3) [718f57] START, MergeVDSCommand(HostName = KVM04, >> MergeVDSCommandParameters:{runAsync='true', hostId='b51933a3-9201-4446- >> a3e3-906a2ec1b467', vmId='6ef30172-b010-46fa-9482-accd30682232', >> storagePoolId='85a72afd-7bde-4065-a1bc-7fc6e22e6bf6', >> storageDomainId='045c7fda-ab98-4905-876c-00b5413a619f', >> imageGroupId='ad486d26-4594-4d16-a402-68b45d82078a', imageId='e87e0c7c- >> 4f6f-45e9-90ca-cf34617da3f6', baseImageId='6e008200-3c21-4285-96b8- >> 07c29c0cb72c', topImageId='d538e0ef-2f55-4c74-b8f1-8900fd6b814b', >> bandwidth='0'}), log id: 2cc2db4 >> 2016-03-28 17:01:22,368 >> INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSComma >> nd] (default task-77) [410b6a44] START, CreateSnapshotVDSCommand( >> CreateSnapshotVDSCommandParameters:{runAsync='true', >> storagePoolId='85a72afd-7bde-4065-a1bc-7fc6e22e6bf6', >> ignoreFailoverLimit='false', storageDomainId='045c7fda-ab98-4905-876c- >> 00b5413a619f', imageGroupId='ad486d26-4594-4d16-a402-68b45d82078a', >> imageSizeInBytes='268435456000', volumeFormat='COW', >> newImageId='919d6991-43e4-4f26-868e-031a01011191', >> newImageDescription='', imageInitialSizeInBytes='0', imageId='e87e0c7c- >> 4f6f-45e9-90ca-cf34617da3f6', sourceImageGroupId='ad486d26-4594-4d16- >> a402-68b45d82078a'}), log id: 4ed3e9ca >> 2016-03-28 18:36:28,404 >> INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.MergeVDSCommand] >> (pool-7-thread-1) [6911a44f] START, MergeVDSCommand(HostName = KVM04, >> MergeVDSCommandParameters:{runAsync='true', hostId='b51933a3-9201-4446- >> a3e3-906a2ec1b467', vmId='6ef30172-b010-46fa-9482-accd30682232', >> storagePoolId='85a72afd-7bde-4065-a1bc-7fc6e22e6bf6', >> storageDomainId='045c7fda-ab98-4905-876c-00b5413a619f', >> imageGroupId='ad486d26-4594-4d16-a402-68b45d82078a', imageId='919d6991- >> 43e4-4f26-868e-031a01011191', baseImageId='e87e0c7c-4f6f-45e9-90ca- >> cf34617da3f6', topImageId='919d6991-43e4-4f26-868e-031a01011191', >> bandwidth='0'}), log id: d09cb70 >> 2016-03-28 18:39:53,773 >> INFO [org.ovirt.engine.core.bll.MergeCommandCallback] >>
Re: [ovirt-users] Users Digest, Vol 55, Issue 155
ok do this by default? I don?t see any new > > read-only device mounted in the guest. Is there additional > > work I need to do to mount this and access the data from > > within the guest? > > > > Many thanks, > > > > Simon > > > > > > > > > > > > ___ > > > > Users mailing list > > > > Users@ovirt.org <mailto:Users@ovirt.org> > > > > http://lists.ovirt.org/mailman/listinfo/users > > > -- next part ------ > An HTML attachment was scrubbed... > URL: <http://lists.ovirt.org/pipermail/users/attachments/20160420/d5d > 7d06b/attachment-0001.html> > -- next part -- > A non-text attachment was scrubbed... > Name: not available > Type: image/png > Size: 6941 bytes > Desc: not available > URL: <http://lists.ovirt.org/pipermail/users/attachments/20160420/d5d > 7d06b/attachment-0001.png> > > -- > > Message: 2 > Date: Wed, 20 Apr 2016 20:33:06 +0300 > From: Nir Soffer <nsof...@redhat.com> > To: Clint Boggio <cl...@theboggios.com>, Ala Hino <ah...@redhat.com>, > Adam Litke <ali...@redhat.com> > Cc: users <users@ovirt.org> > Subject: Re: [ovirt-users] Disks Illegal State > Message-ID: > <CAMRbyyvfxT4h_T_qgyXNNm+OwQF7xPuwk_qOeiLP+xQ-JkkWdg@mail.gmail > .com> > Content-Type: text/plain; charset=UTF-8 > > On Wed, Apr 20, 2016 at 5:34 PM, Clint Boggio <cl...@theboggios.com> > wrote: > > > > The "vdsm-tool dump-volume-chains" command on the iSCSI storage > > domain > > shows one disk in "ILLEGAL" state while the gui shows 8 disk images > > in > > the same state. > Interesting - it would be useful to find the missing volume ids in > engine log and > understand wahy they are marked as illegal. > > > > > > > ### > > # BEGIN COMMAND OUTPUT > > ### > > > > > > > > [root@KVM01 ~]# vdsm-tool dump-volume-chains 045c7fda-ab98-4905- > > 876c- > > 00b5413a619f > > > > Images volume chains (base volume first) > > > > image:477e73af-e7db-4914-81ed-89b3fbc876f7 > > > > - c8320522-f839-472e-9707-a75f6fbe5cb6 > > status: OK, voltype: LEAF, format: COW, legality: > > LEGAL, > > type: SPARSE > > > > > > image:882c73fc-a833-4e2e-8e6a-f714d80c0f0d > > > > - 689220c0-70f8-475f-98b2-6059e735cd1f > > status: OK, voltype: LEAF, format: COW, legality: > > LEGAL, > > type: SPARSE > > > > > > image:0ca8c49f-452e-4f61-a3fc-c4bf2711e200 > > > > - dac06a5c-c5a8-4f82-aa8d-5c7a382da0b3 > > status: OK, voltype: LEAF, format: RAW, legality: > > LEGAL, > > type: PREALLOCATED > > > > > > image:0ca0b8f8-8802-46ae-a9f8-45d5647feeb7 > > > > - 51a6de7b-b505-4c46-ae2a-25fb9faad810 > > status: OK, voltype: LEAF, format: COW, legality: > > LEGAL, > > type: SPARSE > > > > > > image:ae6d2c62-cfbb-4765-930f-c0a0e3bc07d0 > > > > - b2d39c7d-5b9b-498d-a955-0e99c9bd5f3c > > status: OK, voltype: INTERNAL, format: COW, > > legality: > > LEGAL, type: SPARSE > > > > - bf962809-3de7-4264-8c68-6ac12d65c151 > > status: ILLEGAL, voltype: LEAF, format: COW, > > legality: > > ILLEGAL, type: SPARSE > Lets check vdsm and engine log, and find when and why this disk > became > illegal. > > If this was a result of a live merge that failed while finalizing the > merge > on the engine side, we can safely delete the illegal volume. > > If this is the case, we should find a live merge for volume > bf962809-3de7-4264-8c68-6ac12d65c151, and the live merge > should be successful on vdsm side. At this point, vdsm set the old > volume state to illegal. Engine should ask to delete this volume > later in this flow. > > Adding Ala and Adam to look at this case. > > > > > > > > > image:ff8c64c4-d52b-4812-b541-7f291f98d961 > > > > - 85f77cd5-2f86-49a9-a411-8539114d3035 > > status: OK, voltype: LEAF, format: COW, legality: > > LEGAL, > > type: SPARSE > > > > > > image:
Re: [ovirt-users] Disks Illegal State
In my case Markus, the backing disks are MIA and show only as bright red broken symbolic links. Using the postgres commands to set them as OK would be folly, and likley cause more trouble. if the snapshot disks are truly gone, (and they are), what procedure would i use to inform the database and set the VM's in a usable status status again ? On Mon, 2016-04-18 at 12:39 +, Markus Stockhausen wrote: > > > > Von: users-boun...@ovirt.org [users-boun...@ovirt.org] im > > Auftrag von Clint Boggio [cl...@theboggios.com] > > Gesendet: Montag, 18. April 2016 14:16 > > An: users@ovirt.org > > Betreff: [ovirt-users] Disks Illegal State > > > > OVirt 3.6, 4 node cluster with dedicated engine. Main storage > > domain is iscsi, ISO and Export domains are NFS. > > > > Several of my VM snapshot disks show to be in an "illegal state". > > The system will not allow me to manipulate the snapshots in any > > way, nor clone the active system, or create a new snapshot. > > > > In the logs I see that the system complains about not being able to > > "get volume size for xxx", and also that the system appears to > > believe that the image is "locked" and is currently in the snapshot > > process. > > > > Of the VM's with this status, one rebooted and was lost due to > > "cannot get volume size for domain xxx". > > > > I fear that in this current condition, should any of the other > > machine reboot, they too will be lost. > > > > How can I troubleshoot this problem further, and hopefully > > alleviate the condition ? > > > > Thank you for your help. > Hi Clint, > > for us the problem always boils down to the following steps. Might be > simpler as we use > NFS for all of our domains and have direct access to the image files. > > 1) Check if snapshot disks are currently used. Capture the qemu > command line with a "ps -ef" > on the nodes. There you can see what images qemu is started with. For > each of the files check > the backing chain: > > # qemu-img info /rhev/.../bbd05dd8-c3bf-4d15-9317-73040e04abae > image: bbd05dd8-c3bf-4d15-9317-73040e04abae > file format: qcow2 > virtual size: 50G (53687091200 bytes) > disk size: 133M > cluster_size: 65536 > backing file: ../f8ebfb39-2ac6-4b87-b193-4204d1854edc/595b95f4-ce1a- > 4298-bd27-3f6745ae4e4c > backing file format: raw > Format specific information: > compat: 0.10 > > # qemu-img info .../595b95f4-ce1a-4298-bd27-3f6745ae4e4c (see above) > ... > > I don't know how you can accomplish this on ISCSI (and LVM based > images inside iirc). We > usually follow the backing chain and test if all the files exist and > are linked correctly. Especially > if everything matches the OVirt GUI. I guess this is the most > important part for you. > > 2) In most of our cases everything is fine and only the OVirt > database is wrong. So we fix it > at our own risk. Because of your explanation I do not recommend that > for you. It is just for > documentation purpose. > > engine# su - postgres > > > > psql engine postgres > > > > select image_group_id,imagestatus from images where imagestatus =4; > > ... list of illegal images > > update images set imagestatus =1 where imagestatus = 4 and > criteria>; > > commit > > > > select description,status from snapshots where status <> 'OK'; > > ... list of locked snapshots > > update snapshots set status = 'OK' where status <> 'OK' and > criteria>; > > commit > > > > \q > Restart engine and everything should be in sync again. > > Best regards. > > Markus ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Disks Illegal State
oltype: LEAF, format: RAW, legality: LEGAL, type: PREALLOCATED ### # END COMMAND OUTPUT ### ### # BEGIN LOG OUTPUT FROM ENGINE ### The below output is an excerpt from the engine.log while attemtping to start one of the afflicted VM's. Following the storage chain out i have discovered that "919d6991-43e4-4f26-868e-031a01011191" does not exist. This is likely due to a failure of the backup python script that the client is using. I can provide that script if you all would like. 2016-04-20 08:56:58,285 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-8) [] Correlation ID: abd1342, Job ID: 1ad2ee48-2c2c-437e-997b-469e09498e41, Call Stack: null, Custom Event ID: -1, Message: VM Bill-V was started by admin@internal (Host: KVM03). 2016-04-20 08:57:00,392 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ForkJoinPool-1-worker-1) [] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM Bill-V is down with error. Exit message: Unable to get volume size for domain 045c7fda-ab98-4905-876c- 00b5413a619f volume 919d6991-43e4-4f26-868e-031a01011191. 2016-04-20 08:57:00,393 INFO [org.ovirt.engine.core.vdsbroker.VmAnalyzer] (ForkJoinPool-1-worker-1) [] VM '6ef30172-b010-46fa-9482-accd30682232(Bill-V) is running in db and not running in VDS 'KVM03' 2016-04-20 08:57:00,498 WARN [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-5) [] Correlation ID: abd1342, Job ID: 1ad2ee48-2c2c-437e-997b-469e09498e41, Call Stack: null, Custom Event ID: -1, Message: Failed to run VM Bill-V on Host KVM03. ### # END LOG OUTPUT FROM ENGINE ### I have followed the storage chain out to where the UUID'ed snapshots live, and discovered that all of the "ILLEGAL" snapshots show to be broken symbolic links. Attached is a screenshot of the snapshots as they appear in the GUI. ALL of the UUID's illustrated show as broken symbolic links in the storage domains. On Tue, 2016-04-19 at 21:28 +0300, Nir Soffer wrote: > On Mon, Apr 18, 2016 at 3:16 PM, Clint Boggio <cl...@theboggios.com> > wrote: > > > > OVirt 3.6, 4 node cluster with dedicated engine. Main storage > > domain is iscsi, ISO and Export domains are NFS. > > > > Several of my VM snapshot disks show to be in an "illegal state". > > The system will not allow me to manipulate the snapshots in any > > way, nor clone the active system, or create a new snapshot. > > > > In the logs I see that the system complains about not being able to > > "get volume size for xxx", and also that the system appears to > > believe that the image is "locked" and is currently in the snapshot > > process. > > > > Of the VM's with this status, one rebooted and was lost due to > > "cannot get volume size for domain xxx". > > > Can you share the vdsm log showing these errors? > > Also it may helpful to get the output of this command: > > vdsm-tool dump-volume-chains SDUUID > > Nir > > > > > I fear that in this current condition, should any of the other > > machine reboot, they too will be lost. > > > > How can I troubleshoot this problem further, and hopefully > > alleviate the condition ? > > > > Thank you for your help. > > > > Clint > > ___ > > Users mailing list > > Users@ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Disks Illegal State
Markus thank you so much for the information. I'll be focusing on resolution of this problem this week and I'll keep you in the loop. On Apr 18, 2016, at 7:39 AM, Markus Stockhausen <stockhau...@collogia.de> wrote: >> Von: users-boun...@ovirt.org [users-boun...@ovirt.org] im Auftrag von >> Clint Boggio [cl...@theboggios.com] >> Gesendet: Montag, 18. April 2016 14:16 >> An: users@ovirt.org >> Betreff: [ovirt-users] Disks Illegal State >> >> OVirt 3.6, 4 node cluster with dedicated engine. Main storage domain is >> iscsi, ISO and Export domains are NFS. >> >> Several of my VM snapshot disks show to be in an "illegal state". The system >> will not allow me to manipulate the snapshots in any way, nor clone the >> active system, or create a new snapshot. >> >> In the logs I see that the system complains about not being able to "get >> volume size for xxx", and also that the system appears to believe that the >> image is "locked" and is currently in the snapshot process. >> >> Of the VM's with this status, one rebooted and was lost due to "cannot get >> volume size for domain xxx". >> >> I fear that in this current condition, should any of the other machine >> reboot, they too will be lost. >> >> How can I troubleshoot this problem further, and hopefully alleviate the >> condition ? >> >> Thank you for your help. > > Hi Clint, > > for us the problem always boils down to the following steps. Might be simpler > as we use > NFS for all of our domains and have direct access to the image files. > > 1) Check if snapshot disks are currently used. Capture the qemu command line > with a "ps -ef" > on the nodes. There you can see what images qemu is started with. For each of > the files check > the backing chain: > > # qemu-img info /rhev/.../bbd05dd8-c3bf-4d15-9317-73040e04abae > image: bbd05dd8-c3bf-4d15-9317-73040e04abae > file format: qcow2 > virtual size: 50G (53687091200 bytes) > disk size: 133M > cluster_size: 65536 > backing file: > ../f8ebfb39-2ac6-4b87-b193-4204d1854edc/595b95f4-ce1a-4298-bd27-3f6745ae4e4c > backing file format: raw > Format specific information: >compat: 0.10 > > # qemu-img info .../595b95f4-ce1a-4298-bd27-3f6745ae4e4c (see above) > ... > > I don't know how you can accomplish this on ISCSI (and LVM based images > inside iirc). We > usually follow the backing chain and test if all the files exist and are > linked correctly. Especially > if everything matches the OVirt GUI. I guess this is the most important part > for you. > > 2) In most of our cases everything is fine and only the OVirt database is > wrong. So we fix it > at our own risk. Because of your explanation I do not recommend that for you. > It is just for > documentation purpose. > > engine# su - postgres >> psql engine postgres > >> select image_group_id,imagestatus from images where imagestatus =4; >> ... list of illegal images >> update images set imagestatus =1 where imagestatus = 4 and ; >> commit > >> select description,status from snapshots where status <> 'OK'; >> ... list of locked snapshots >> update snapshots set status = 'OK' where status <> 'OK' and ; >> commit > >> \q > > Restart engine and everything should be in sync again. > > Best regards. > > Markus= > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Disks Illegal State
Thank you I will read on the link provided and follow the course. > On Apr 18, 2016, at 7:20 AM, Ollie Armstrong <ol...@fubra.com> wrote: > >> On 18 April 2016 at 13:16, Clint Boggio <cl...@theboggios.com> wrote: >> Several of my VM snapshot disks show to be in an "illegal state". The system >> will not allow me to manipulate the snapshots in any way, nor clone the >> active system, or create a new snapshot. >> >> How can I troubleshoot this problem further, and hopefully alleviate the >> condition ? > > I've experienced a similar thing before and referred to this [1] > comment on BZ1302215 to help me out. Followed those steps and my > issue was resolved. I'm still not aware of the root cause of this > problem though. > > [1] https://bugzilla.redhat.com/show_bug.cgi?id=1302215#c13 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Disks Illegal State
Yes i did try that and the system would not allow it. > On Apr 18, 2016, at 7:27 AM, Raz Tamir <rata...@redhat.com> wrote: > > Hi Clint, > Did you try to remove the relevant snapshots with illegal disks? > In case you do, the removal failed or passed? > > See this: https://bugzilla.redhat.com/show_bug.cgi?id=1275836 > > > > > Thanks, > Raz Tamir > Red Hat Israel > >> On Mon, Apr 18, 2016 at 3:20 PM, Ollie Armstrong <ol...@fubra.com> wrote: >> On 18 April 2016 at 13:16, Clint Boggio <cl...@theboggios.com> wrote: >> > Several of my VM snapshot disks show to be in an "illegal state". The >> > system will not allow me to manipulate the snapshots in any way, nor clone >> > the active system, or create a new snapshot. >> > >> > How can I troubleshoot this problem further, and hopefully alleviate the >> > condition ? >> >> I've experienced a similar thing before and referred to this [1] >> comment on BZ1302215 to help me out. Followed those steps and my >> issue was resolved. I'm still not aware of the root cause of this >> problem though. >> >> [1] https://bugzilla.redhat.com/show_bug.cgi?id=1302215#c13 >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Disks Illegal State
OVirt 3.6, 4 node cluster with dedicated engine. Main storage domain is iscsi, ISO and Export domains are NFS. Several of my VM snapshot disks show to be in an "illegal state". The system will not allow me to manipulate the snapshots in any way, nor clone the active system, or create a new snapshot. In the logs I see that the system complains about not being able to "get volume size for xxx", and also that the system appears to believe that the image is "locked" and is currently in the snapshot process. Of the VM's with this status, one rebooted and was lost due to "cannot get volume size for domain xxx". I fear that in this current condition, should any of the other machine reboot, they too will be lost. How can I troubleshoot this problem further, and hopefully alleviate the condition ? Thank you for your help. Clint ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Single VM Down After Attempted Snapshot
Greetings users; I've got a single VM in a 3.6 environment that is in a down state after and attempt at creating a snapshot via script, and exporting said snapshot to the export domain. I see some indications of what could possibly be wrong in the filtered engine.log, and i'm at a loss on how to repair the problem. Below is a "tailf" of the engine.log as i attempt to run the VM in it's current state. Any guidance or wisdom would be much appreciated. **BEGIN LOG*** [root@oVirtMGMT ovirt-engine]# tailf engine.log |grep -e Bill-V 2016-04-11 10:32:36,283 INFO [org.ovirt.engine.core.vdsbroker.CreateVmVDSCommand] (org.ovirt.thread.pool-8-thread-13) [1a797672] START, CreateVmVDSCommand( CreateVmVDSCommandParameters:{runAsync='true', hostId='605c731f-726a-4135-9c22-5db6f34409fc', vmId='6ef30172-b010-46fa-9482-accd30682232', vm='VM [Bill-V]'}), log id: 36247abb 2016-04-11 10:32:36,288 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-13) [1a797672] START, CreateVDSCommand(HostName = KVM02, CreateVmVDSCommandParameters:{runAsync='true', hostId='605c731f-726a-4135-9c22-5db6f34409fc', vmId='6ef30172-b010-46fa-9482-accd30682232', vm='VM [Bill-V]'}), log id: 590576e1 2016-04-11 10:32:36,330 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand] (org.ovirt.thread.pool-8-thread-13) [1a797672] org.ovirt.engine.core.vdsbroker.vdsbroker.CreateVDSCommand memGuaranteedSize=2048,smpThreadsPerCore=1,cpuType=Nehalem,vmId=6ef30172-b010-46fa-9482-accd30682232,acpiEnable=true,numaTune={nodeset=0,1, mode=interleave},spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard,vmType=kvm,keyboardLayout=en-us,smp=4,smpCoresPerSocket=1,emulatedMachine=pc-i440fx-rhel7.2.0,smartcardEnable=false,fileTransferEnable=true,guestNumaNodes=[{memory=16383, cpus=0,1,2,3, nodeIndex=0}],transparentHugePages=true,displayNetwork=ovirtmgmt,vmName=Bill-V,maxVCpus=16,kvmEnable=true,devices=[{address={bus=0x00, domain=0x, function=0x0, slot=0x02, type=pci}, type=video, specParams={heads=1, vram=32768}, device=qxl, deviceId=046209a4-ced4-4360-991a-51c2427b55b8}, {type=graphics, specParams={fileTransferEnable=true, copyPasteEnable=true}, device=spice, deviceId=9f82bc46-0f7e-482f-a07d-8a66af5f1e87}, {iface=ide, shared=false, path=, address={bus=1, controller=0, unit=0, type=drive, target=0}, readonly=true, index=2, type=disk, specParams={path=}, device=cdrom, deviceId=07d52a48-16f3-46be-831c-5dff2f9db4f9}, {shared=false, address={bus=0, controller=0, unit=0, type=drive, target=0}, imageID=ad486d26-4594-4d16-a402-68b45d82078a, format=cow, index=0, optional=false, type=disk, deviceId=ad486d26-4594-4d16-a402-68b45d82078a, domainID=045c7fda-ab98-4905-876c-00b5413a619f, propagateErrors=off, iface=ide, readonly=false, bootOrder=1, poolID=85a72afd-7bde-4065-a1bc-7fc6e22e6bf6, volumeID=919d6991-43e4-4f26-868e-031a01011191, specParams={}, device=disk}, {filter=vdsm-no-mac-spoofing, nicModel=rtl8139, address={bus=0x00, domain=0x, function=0x0, slot=0x03, type=pci}, type=interface, specParams={inbound={}, outbound={}}, device=bridge, linkActive=true, deviceId=b9e193dd-4350-4b82-8409-e28d4a30965c, macAddr=00:1a:4a:16:01:51, network=Inside-Network}, {address={bus=0x00, domain=0x, function=0x0, slot=0x05, type=pci}, type=sound, specParams={}, device=ich6, deviceId=0f194af3-178f-4a09-a294-bbfa94f3d377}, {address={bus=0x00, domain=0x, function=0x0, slot=0x04, type=pci}, type=controller, specParams={}, device=virtio-serial, deviceId=5390ac7e-5c38-4d97-a394-444e690b36c6}],custom={device_93412e9c-dfd5-4aa3-b139-c729f5711b88device_f401dfe7-c6ec-425e-b15f-8129ed74f86a=VmDevice:{id='VmDeviceId:{deviceId='f401dfe7-c6ec-425e-b15f-8129ed74f86a', vmId='6ef30172-b010-46fa-9482-accd30682232'}', device='spicevmc', type='CHANNEL', bootOrder='0', specParams='[]', address='{bus=0, controller=0, type=virtio-serial, port=3}', managed='false', plugged='true', readOnly='false', deviceAlias='channel2', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false'}, device_93412e9c-dfd5-4aa3-b139-c729f5711b88device_f401dfe7-c6ec-425e-b15f-8129ed74f86adevice_11cff128-1362-41ac-8006-54952f083d81device_1acda734-f75e-4505-a2e6-1f8df72fcfef=VmDevice:{id='VmDeviceId:{deviceId='1acda734-f75e-4505-a2e6-1f8df72fcfef', vmId='6ef30172-b010-46fa-9482-accd30682232'}', device='unix', type='CHANNEL', bootOrder='0', specParams='[]', address='{bus=0, controller=0, type=virtio-serial, port=2}', managed='false', plugged='true', readOnly='false', deviceAlias='channel1', customProperties='[]', snapshotId='null', logicalName='null', usingScsiReservation='false'}, device_93412e9c-dfd5-4aa3-b139-c729f5711b88=VmDevice:{id='VmDeviceId:{deviceId='93412e9c-dfd5-4aa3-b139-c729f5711b88', vmId='6ef30172-b010-46fa-9482-accd30682232'}', device='ide', type='CONTROLLER', bootOrder='0', specParams='[]', address='{slot=0x01, bus=0x00, domain=0x, type=pci, function=0x1}', managed='false',
Re: [ovirt-users] Storage Diversity Options oVirt 3.6
Thank you Simone ! > On Mar 22, 2016, at 8:44 AM, Simone Tiraboschi <stira...@redhat.com> wrote: > > > >> On Fri, Mar 18, 2016 at 5:27 PM, Clint Boggio <cl...@theboggios.com> wrote: >> Greetings all, and Happy Friday; >> >> I'm running oVirt 3.6 management engine that is currently overseeing 4 >> compute nodes, attached to iSCSI storage over Infiniband. The compute >> nodes have 8 hot-swap hard drive slots, with each only having 2 slots >> occupied in a hardware RAID array level one for the hypervisor to live >> on. >> >> Would it be possible for me to set up each compute node with a second >> array in the remaining 6 hot-swap slots, and utilize that new space for >> a nice fault tolerant GlusterFS storage array ? > > That schema is called hyper-converged. > Please see: > https://fosdem.org/2016/schedule/event/virt_iaas_ovirt_hyperconverge/attachments/slides/1119/export/events/attachments/virt_iaas_ovirt_hyperconverge/slides/1119/presentation_fosdem.pdf > > Take care that currently it's not production ready. > >> >> 1. Would the system allow me to add the Gluster storage to the existing >> datacenter/cluster that is currently using iSCSI ? >> >> 2. Would I be able to configure all aspects of the Gluster >> environment(except the hardware RAID array)through the GUI ? >> >> 3. What hardware RAID level would be optimal for this configuration ? >> (RHEV documentation says RAID 6 is "Mandatory") >> >> 4. Will the system support live migration between storage domains ? >> >> I'm reading through the gluster documentation now to get a better >> understanding of it's inner workings. Is there a good source for Gluster >> on oVirt that i can reference as well ? >> >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Storage Diversity Options oVirt 3.6
Greetings all, and Happy Friday; I'm running oVirt 3.6 management engine that is currently overseeing 4 compute nodes, attached to iSCSI storage over Infiniband. The compute nodes have 8 hot-swap hard drive slots, with each only having 2 slots occupied in a hardware RAID array level one for the hypervisor to live on. Would it be possible for me to set up each compute node with a second array in the remaining 6 hot-swap slots, and utilize that new space for a nice fault tolerant GlusterFS storage array ? 1. Would the system allow me to add the Gluster storage to the existing datacenter/cluster that is currently using iSCSI ? 2. Would I be able to configure all aspects of the Gluster environment(except the hardware RAID array)through the GUI ? 3. What hardware RAID level would be optimal for this configuration ? (RHEV documentation says RAID 6 is "Mandatory") 4. Will the system support live migration between storage domains ? I'm reading through the gluster documentation now to get a better understanding of it's inner workings. Is there a good source for Gluster on oVirt that i can reference as well ? ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Admin lockout
That worked like a charm. I'll add that to my cheat sheet. Thank you for your help ! > On Mar 9, 2016, at 3:00 PM, Douglas Landgraf <dland...@redhat.com> wrote: > > Hi Clint, > >> On Wed, Mar 9, 2016 at 2:52 PM, Clint Boggio <cl...@theboggios.com> wrote: >> I had a keyboard problem and entered the wrong password for admin@internal >> enough times to finally lock the account. >>How do I recover from this ? >>OVirt engine 3.6.2 > > > You might try from engine machine: > > # ovirt-aaa-jdbc-tool user unlock admin > > More info: > http://www.ovirt.org/develop/release-management/features/infra/aaa-jdbc/ > > > >> ___ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > > > > -- > Cheers > Douglas ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Admin lockout
I had a keyboard problem and entered the wrong password for admin@internal enough times to finally lock the account. How do I recover from this ? OVirt engine 3.6.2 ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Promiscuous Mode
I am deploying an OpenVPN server in my OVirt environment and I've come to a dead stop with the developer support on a topic related to OVirt configuration. The developer wants me to put the VM's underlying NIC into promiscuous mode. I've seen this in a VMware environment and I know what they are asking me to do, and I'm wondering if there is a clear way to do this in my OVirt environment. I found "port mirroring" but no "promiscuous mode" Cheers and thank you ! ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] virt-v2v converting multi-disk
Thanks Rich for the clarification and thanks Moran for getting me to the right human :-) I'll be searching for the import feature tomorrow after I build out the main storage domain and the datacenter goes green. I REALLY appreciate all you guys do, and the help you provide. I've tried the -i libvirtxml method and it fails and I suspect it's because the legacy KVM environment is Ubuntu based. Any tricks or pointers would be appreciated. I typically scp the VM image file to the root of the export domain and use the -i method because of the limitation of Ubuntu. Thank you again > On Feb 29, 2016, at 6:24 AM, Richard W.M. Jones <rjo...@redhat.com> wrote: > >> On Mon, Feb 29, 2016 at 01:44:19PM +0200, Moran Goldboim wrote: >> +Richard, v2v maintainer. >> >>> On Sat, Feb 27, 2016 at 8:45 PM, Clint Boggio <cl...@theboggios.com> wrote: >>> >>> I'm in the process of migrating a series of VM's from KVM environment, to >>> an OVirt environment. I've used virt-v2v to convert quite a few M$ and >>> Linux machines with great success. > > You don't really need to use virt-v2v when the guest already runs on > KVM. The latest oVirt supports direct import of disk images, and > there is also my import script for older versions of oVirt which > didn't have this feature: > > http://git.annexia.org/?p=import-to-ovirt.git;a=summary > > -- > > Nevertheless I'll answer the rest of these questions because it's an > interesting topic for people importing from other hypervisors ... > >>> Coming up I've got to convert a Linux VM that has 3 virtual disks. Inside >>> that VM, the three disks are part of an LVM volume. >>> >>> 1. How will virt-v2v handle these three virtual disks ? > > Should just work. > >>> 2. On which disk image will I run virt-v2v ? > > On all 3 :-) Are you using `-i disk' input mode? That only supports a > single disk, but you can use `-i libvirtxml' mode instead, and then > you can specify as many input disks as you want: > > http://libguestfs.org/virt-v2v.1.html#minimal-xml-for--i-libvirtxml-option > >>> 3. Will virt-v2v "follow" the three images and convert the machine or will >>> I have to somehow tell it to include all three disks ? > > You always have to tell virt-v2v. > >>> 4. Shall I have all three images together in the same directory when I run >>> the tool ? > > With `-i libvirtxml' it doesn't matter. You specify the XML file, and > that contains references to the disks. > >>> 5. Is this the appropriate forum for this question ? > > Yup. > > Rich. > >>> As of the writing of this question I'll be using OVirt 3.6 updated on a 4 >>> node cluster running CentOS 7 , and the most recent version of virt-v2v as >>> is available on Fedora 23. >>> >>> ___ >>> Users mailing list >>> Users@ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users > > -- > Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones > Read my programming and virtualization blog: http://rwmj.wordpress.com > virt-top is 'top' for virtual machines. Tiny program with many > powerful monitoring features, net stats, disk stats, logging, etc. > http://people.redhat.com/~rjones/virt-top ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] virt-v2v converting multi-disk
I'm in the process of migrating a series of VM's from KVM environment, to an OVirt environment. I've used virt-v2v to convert quite a few M$ and Linux machines with great success. Coming up I've got to convert a Linux VM that has 3 virtual disks. Inside that VM, the three disks are part of an LVM volume. 1. How will virt-v2v handle these three virtual disks ? 2. On which disk image will I run virt-v2v ? 3. Will virt-v2v "follow" the three images and convert the machine or will I have to somehow tell it to include all three disks ? 4. Shall I have all three images together in the same directory when I run the tool ? 5. Is this the appropriate forum for this question ? As of the writing of this question I'll be using OVirt 3.6 updated on a 4 node cluster running CentOS 7 , and the most recent version of virt-v2v as is available on Fedora 23. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users