[ovirt-users] Re: Mounting CephFS
Hi Leo, Check libvirt's logs on the destination host. Maybe they can provide more information. Best Regards, Strahil NikolovOn Mar 2, 2019 15:40, Leo David wrote: > > Thank you, > I am trying to migrate a vm that has its disks on cephfs ( as posix domain - > mounted on all hosts ), and it does not work. Not sure if this is normal, > considering the vm disks being on this type of storage. The error logs in > engine are: > > 2019-03-02 13:35:03,483Z ERROR > [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] > (ForkJoinPool-1-worker-0) [] Migration of VM 'centos7-test' to host > 'node1.internal' failed: VM destroyed during the startup. > 2019-03-02 13:35:03,505Z ERROR > [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] > (ForkJoinPool-1-worker-14) [] Rerun VM > 'bec1cd40-9d62-4f6d-a9df-d97a79584441'. Called from VDS 'node2.internal' > 2019-03-02 13:35:03,566Z ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engine-Thread-42967) [] EVENT_ID: > VM_MIGRATION_TO_SERVER_FAILED(120), Migration failed (VM: centos7-test, > Source: node2.internal, Destination: node1.internal). > > Any thoughts ? > > Thanks, > > Leo > > > On Sat, Mar 2, 2019 at 11:59 AM Strahil wrote: >> >> If you mean storage migration - could be possible. >> If it is about live migration between hosts - shouldn't happen. >> Anything in the logs ? >> >> Best Regards, >> Strahil Nikolov >> >> On Mar 2, 2019 09:23, Leo David wrote: >>> >>> Thank you Strahil, yes thought about that too, I'll give it a try. >>> Now ( to be a bit offtopic ), it seems that I can't live migrate the vm, >>> even thought the cephfs mountpoint exists on all the hosts. >>> Could it be the fact that the storage type is "posix" and live migration >>> not being possible ? >>> >>> Thank you ! >>> >>> On Sat, Mar 2, 2019, 04:05 Strahil wrote: Can you try to set the credentials in a file (don't recall where that was for ceph) , so you can mount without specifying user/pass ? Best Regards, Strahil Nikolov On Mar 1, 2019 13:46, Leo David wrote: > > Hi Everyone, > I am trying to mount cephfs as a posix storage domain and getting an > error in vdsm.log, although the direct command run on the node " mount -t > ceph 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. > I have configured: > Storage type: POSIX compliant FS > Path: 10.10.6.1:/sata/ovirt-data > VFS Type: ceph > Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== > > > 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting > 10.10.6.1:/sata/ovirt-data at > /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data (mount:204) > 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] > RPC call Host.ping2 succeeded in 0.00 seconds (__init__:312) > 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not > connect to storageServer (hsm:2414) ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/OUXZLOTDC4LEJDRP54PQJ4FN2E5CYTZX/
[ovirt-users] Re: Mounting CephFS
Thank you, I am trying to migrate a vm that has its disks on cephfs ( as posix domain - mounted on all hosts ), and it does not work. Not sure if this is normal, considering the vm disks being on this type of storage. The error logs in engine are: 2019-03-02 13:35:03,483Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-0) [] Migration of VM 'centos7-test' to host 'node1.internal' failed: VM destroyed during the startup. 2019-03-02 13:35:03,505Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] (ForkJoinPool-1-worker-14) [] Rerun VM 'bec1cd40-9d62-4f6d-a9df-d97a79584441'. Called from VDS 'node2.internal' 2019-03-02 13:35:03,566Z ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-42967) [] EVENT_ID: VM_MIGRATION_TO_SERVER_FAILED(120), Migration failed (VM: centos7-test, Source: node2.internal, Destination: node1.internal). Any thoughts ? Thanks, Leo On Sat, Mar 2, 2019 at 11:59 AM Strahil wrote: > If you mean storage migration - could be possible. > If it is about live migration between hosts - shouldn't happen. > Anything in the logs ? > > Best Regards, > Strahil Nikolov > On Mar 2, 2019 09:23, Leo David wrote: > > Thank you Strahil, yes thought about that too, I'll give it a try. > Now ( to be a bit offtopic ), it seems that I can't live migrate the vm, > even thought the cephfs mountpoint exists on all the hosts. > Could it be the fact that the storage type is "posix" and live migration > not being possible ? > > Thank you ! > > On Sat, Mar 2, 2019, 04:05 Strahil wrote: > > Can you try to set the credentials in a file (don't recall where that was > for ceph) , so you can mount without specifying user/pass ? > > Best Regards, > Strahil Nikolov > On Mar 1, 2019 13:46, Leo David wrote: > > Hi Everyone, > I am trying to mount cephfs as a posix storage domain and getting an error > in vdsm.log, although the direct command run on the node " mount -t ceph > 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. I > have configured: > Storage type: POSIX compliant FS > Path: 10.10.6.1:/sata/ovirt-data > VFS Type: ceph > Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== > > > 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting > 10.10.6.1:/sata/ovirt-data at /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data > (mount:204) > 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC > call Host.ping2 succeeded in 0.00 seconds (__init__:312) > 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not > connect to storageServer (hsm:2414) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2411, > in connectStorageServer > conObj.connect() > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 180, in connect > six.reraise(t, v, tb) > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 172, in connect > self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line > 207, in mount > cgroup=cgroup) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 56, in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 54, in > **kwargs) > File "", line 2, in mount > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in > _callmethod > raise convert_to_error(kind, result) > *MountError: (1, ';mount: unsupported option format: * > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ==\n') > Any thoughts on this, what could it be wrong with the options field ? > Using oVirt 4.3.1 > Thank you very much and have a great day ! > > Leo > > -- > Best regards, Leo David > > -- Best regards, Leo David ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/2S3CM23KME6CHTES7KGY2TNGDGXZHBMO/
[ovirt-users] Re: Mounting CephFS
If you mean storage migration - could be possible. If it is about live migration between hosts - shouldn't happen. Anything in the logs ? Best Regards, Strahil NikolovOn Mar 2, 2019 09:23, Leo David wrote: > > Thank you Strahil, yes thought about that too, I'll give it a try. > Now ( to be a bit offtopic ), it seems that I can't live migrate the vm, even > thought the cephfs mountpoint exists on all the hosts. > Could it be the fact that the storage type is "posix" and live migration not > being possible ? > > Thank you ! > > On Sat, Mar 2, 2019, 04:05 Strahil wrote: >> >> Can you try to set the credentials in a file (don't recall where that was >> for ceph) , so you can mount without specifying user/pass ? >> >> Best Regards, >> Strahil Nikolov >> >> On Mar 1, 2019 13:46, Leo David wrote: >>> >>> Hi Everyone, >>> I am trying to mount cephfs as a posix storage domain and getting an error >>> in vdsm.log, although the direct command run on the node " mount -t ceph >>> 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o >>> name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. I >>> have configured: >>> Storage type: POSIX compliant FS >>> Path: 10.10.6.1:/sata/ovirt-data >>> VFS Type: ceph >>> Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== >>> >>> >>> 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting >>> 10.10.6.1:/sata/ovirt-data at >>> /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data (mount:204) >>> 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC >>> call Host.ping2 succeeded in 0.00 seconds (__init__:312) >>> 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not >>> connect to storageServer (hsm:2414) >>> Traceback (most recent call last): >>> File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2411, >>> in connectStorageServer >>> conObj.connect() >>> File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", >>> line 180, in connect >>> six.reraise(t, v, tb) >>> File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", >>> line 172, in connect >>> self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) >>> File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 207, >>> in mount >>> cgroup=cgroup) >>> File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line >>> 56, in __call__ >>> return callMethod() >>> File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line >>> 54, in >>> **kwargs) >>> File "", line 2, in mount >>> File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in >>> _callmethod >>> raise convert_to_error(kind, result) >>> MountError: (1, ';mount: unsupported option format: >>> name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ==\n') >>> Any thoughts on this, what could it be wrong with the options field ? >>> Using oVirt 4.3.1 >>> Thank you very much and have a great day ! >>> >>> Leo >>> >>> -- >>> Best regards, Leo David___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TAJR7E23V7U2JUIZQV4VSVSND5IMHNDN/
[ovirt-users] Re: Mounting CephFS
Thank you Strahil, yes thought about that too, I'll give it a try. Now ( to be a bit offtopic ), it seems that I can't live migrate the vm, even thought the cephfs mountpoint exists on all the hosts. Could it be the fact that the storage type is "posix" and live migration not being possible ? Thank you ! On Sat, Mar 2, 2019, 04:05 Strahil wrote: > Can you try to set the credentials in a file (don't recall where that was > for ceph) , so you can mount without specifying user/pass ? > > Best Regards, > Strahil Nikolov > On Mar 1, 2019 13:46, Leo David wrote: > > Hi Everyone, > I am trying to mount cephfs as a posix storage domain and getting an error > in vdsm.log, although the direct command run on the node " mount -t ceph > 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. I > have configured: > Storage type: POSIX compliant FS > Path: 10.10.6.1:/sata/ovirt-data > VFS Type: ceph > Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== > > > 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting > 10.10.6.1:/sata/ovirt-data at /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data > (mount:204) > 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC > call Host.ping2 succeeded in 0.00 seconds (__init__:312) > 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not > connect to storageServer (hsm:2414) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2411, > in connectStorageServer > conObj.connect() > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 180, in connect > six.reraise(t, v, tb) > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 172, in connect > self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line > 207, in mount > cgroup=cgroup) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 56, in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 54, in > **kwargs) > File "", line 2, in mount > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in > _callmethod > raise convert_to_error(kind, result) > *MountError: (1, ';mount: unsupported option format: * > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ==\n') > Any thoughts on this, what could it be wrong with the options field ? > Using oVirt 4.3.1 > Thank you very much and have a great day ! > > Leo > > -- > Best regards, Leo David > > ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/R43YYSI5WE7GQS7KANSJ52DTE7U7GA5X/
[ovirt-users] Re: Mounting CephFS
Can you try to set the credentials in a file (don't recall where that was for ceph) , so you can mount without specifying user/pass ? Best Regards, Strahil NikolovOn Mar 1, 2019 13:46, Leo David wrote: > > Hi Everyone, > I am trying to mount cephfs as a posix storage domain and getting an error in > vdsm.log, although the direct command run on the node " mount -t ceph > 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. I > have configured: > Storage type: POSIX compliant FS > Path: 10.10.6.1:/sata/ovirt-data > VFS Type: ceph > Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== > > > 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting > 10.10.6.1:/sata/ovirt-data at > /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data (mount:204) > 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC > call Host.ping2 succeeded in 0.00 seconds (__init__:312) > 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not > connect to storageServer (hsm:2414) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2411, in > connectStorageServer > conObj.connect() > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", line > 180, in connect > six.reraise(t, v, tb) > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", line > 172, in connect > self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 207, in > mount > cgroup=cgroup) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 56, > in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 54, > in > **kwargs) > File "", line 2, in mount > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in > _callmethod > raise convert_to_error(kind, result) > MountError: (1, ';mount: unsupported option format: > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ==\n') > Any thoughts on this, what could it be wrong with the options field ? > Using oVirt 4.3.1 > Thank you very much and have a great day ! > > Leo > > -- > Best regards, Leo David___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/VAVMU2ULRVM7RPA72EDP7Z2HJ2EOB2QA/
[ovirt-users] Re: Mounting CephFS
Hi, That was just me not properly reading the log... :( Seems that I was passing a cr at the and of the options ( \n ), now I am able to do the mount. Thank you ! Leo On Fri, Mar 1, 2019 at 1:46 PM Leo David wrote: > Hi Everyone, > I am trying to mount cephfs as a posix storage domain and getting an error > in vdsm.log, although the direct command run on the node " mount -t ceph > 10.10.6.1:/sata/ovirt-data /cephfs-sata/ -o > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== " works fine. I > have configured: > Storage type: POSIX compliant FS > Path: 10.10.6.1:/sata/ovirt-data > VFS Type: ceph > Mount Options: name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ== > > > 2019-03-01 11:35:33,457+ INFO (jsonrpc/4) [storage.Mount] mounting > 10.10.6.1:/sata/ovirt-data at /rhev/data-center/mnt/10.10.6.1:_sata_ovirt-data > (mount:204) > 2019-03-01 11:35:33,464+ INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC > call Host.ping2 succeeded in 0.00 seconds (__init__:312) > 2019-03-01 11:35:33,471+ ERROR (jsonrpc/4) [storage.HSM] Could not > connect to storageServer (hsm:2414) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2411, > in connectStorageServer > conObj.connect() > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 180, in connect > six.reraise(t, v, tb) > File "/usr/lib/python2.7/site-packages/vdsm/storage/storageServer.py", > line 172, in connect > self._mount.mount(self.options, self._vfsType, cgroup=self.CGROUP) > File "/usr/lib/python2.7/site-packages/vdsm/storage/mount.py", line 207, > in mount > cgroup=cgroup) > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 56, in __call__ > return callMethod() > File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line > 54, in > **kwargs) > File "", line 2, in mount > File "/usr/lib64/python2.7/multiprocessing/managers.py", line 773, in > _callmethod > raise convert_to_error(kind, result) > *MountError: (1, ';mount: unsupported option format: * > name=admin,secret=AQAzncZY0VyYHBAAoeeePdv8Rr5kZlW07EVhZZ==\n') > Any thoughts on this, what could it be wrong with the options field ? > Using oVirt 4.3.1 > Thank you very much and have a great day ! > > Leo > > -- > Best regards, Leo David > -- Best regards, Leo David ___ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-le...@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WI2LASQYJBU3YWNHNR7SJICDRPC5HUHP/