Hello,
me again. Adding a NFS Domain to the cluster fails. It looks like the error
from http://lists.ovirt.org/pipermail/users/2013-April/014080.html but I
have a Fedora 19 host and sanlock seems to be a newer version. I wanted
to restart the setup process but ovirt-engine tells me that the storage
domain already exists on the host. How can I recover from this failed
action?
Just in case you are interested in the current situation you will find the
logs attached.
Markus
[root@colovn1 dom_md]# getsebool -a | grep virt_use_nfs
virt_use_nfs --> on
[root@colovn1 dom_md]# df
Filesystem
...
10.10.30.251:/var/nas5/ovirt 7810410496 7094904832 715505664 91%
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt
content of /var/log/sanlock
2013-09-04 15:47:04+0200 14844 [2655]: sanlock daemon started 2.8 host
e35ca5ca-dfab-4521-b267-4d9b1f48ded4.colovn1.co
2013-09-04 15:58:04+0200 23 [1024]: sanlock daemon started 2.8 host
b3a8ef4a-0966-4ffa-9086-e5a8c6ad7363.colovn1.co
2013-09-04 19:25:53+0200 23 [919]: sanlock daemon started 2.8 host
9654f1d0-6d87-4dd1-abdc-68c00fc4fe64.colovn1.co
2013-09-05 06:39:47+0200 25 [1173]: sanlock daemon started 2.8 host
e2829012-4b8f-417f-809e-532c64108955.colovn1.co
2013-09-05 06:48:01+0200 518 [1178]: s1 lockspace
8dd2a4a5-b49f-4fef-a427-e62627fc09f7:250:/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids:0
2013-09-05 06:48:01+0200 518 [1786]: open error -13
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
2013-09-05 06:48:01+0200 518 [1786]: s1 open_disk
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
error -13
2013-09-05 06:48:02+0200 519 [1178]: s1 add_lockspace fail result -19
permissions of file:
[root@colovn1 dom_md]# ls -al
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
-rw-rw----. 1 vdsm kvm 1048576 5. Sep 06:47
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
vdsm.log
Thread-186::DEBUG::2013-09-05
06:48:01,872::task::974::TaskManager.Task::(_decref)
Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::ref 1 aborting False
Thread-186::INFO::2013-09-05
06:48:01,872::sp::592::Storage.StoragePool::(create)
spUUID=b054727d-fe4a-41ed-8393-a81e36b8a1af poolName=Collogia
master_sd=8dd2a4a5-b49f-4fef-a427-e62627fc09f7
domList=['8dd2a4a5-b49f-4fef-a427-e62627fc09f7'] masterVersion=1
{'LEASETIMESEC': 60, 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3,
'LOCKRENEWALINTERVALSEC': 5}
Thread-186::INFO::2013-09-05
06:48:01,872::fileSD::315::Storage.StorageDomain::(validate)
sdUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7
Thread-186::DEBUG::2013-09-05
06:48:01,888::persistentDict::234::Storage.PersistentDict::(refresh) read lines
(FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB', 'IOOPTIMEOUTSEC=1',
'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5',
'POOL_UUID=', 'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular',
'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3',
'_SHA_CKSUM=b0b0af59d3c7c6ec83dd18ca11a6c1653de9a3b6']
Thread-186::DEBUG::2013-09-05
06:48:01,898::persistentDict::234::Storage.PersistentDict::(refresh) read lines
(FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB', 'IOOPTIMEOUTSEC=1',
'LEASERETRIES=3', 'LEASETIMESEC=5', 'LOCKPOLICY=', 'LOCKRENEWALINTERVALSEC=5',
'POOL_UUID=', 'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular',
'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3',
'_SHA_CKSUM=b0b0af59d3c7c6ec83dd18ca11a6c1653de9a3b6']
Thread-186::DEBUG::2013-09-05
06:48:01,899::persistentDict::167::Storage.PersistentDict::(transaction)
Starting transaction
Thread-186::DEBUG::2013-09-05
06:48:01,900::persistentDict::173::Storage.PersistentDict::(transaction)
Flushing changes
Thread-186::DEBUG::2013-09-05
06:48:01,900::persistentDict::299::Storage.PersistentDict::(flush) about to
write lines (FileMetadataRW)=['CLASS=Data', 'DESCRIPTION=NAS3_IB',
'IOOPTIMEOUTSEC=10', 'LEASERETRIES=3', 'LEASETIMESEC=60', 'LOCKPOLICY=',
'LOCKRENEWALINTERVALSEC=5', 'POOL_UUID=',
'REMOTE_PATH=10.10.30.251:/var/nas5/ovirt', 'ROLE=Regular',
'SDUUID=8dd2a4a5-b49f-4fef-a427-e62627fc09f7', 'TYPE=NFS', 'VERSION=3',
'_SHA_CKSUM=e2dfa292d09c0cb420dc4d30ab5eed11c84a399e']
Thread-186::DEBUG::2013-09-05
06:48:01,903::persistentDict::175::Storage.PersistentDict::(transaction)
Finished transaction
Thread-186::INFO::2013-09-05
06:48:01,903::clusterlock::174::SANLock::(acquireHostId) Acquiring host id for
domain 8dd2a4a5-b49f-4fef-a427-e62627fc09f7 (id: 250)
Thread-186::ERROR::2013-09-05
06:48:02,905::task::850::TaskManager.Task::(_setError)
Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::Unexpected error
Traceback (most recent call last):
File "/usr/share/vdsm/storage/task.py", line 857, in _run
return fn(*args, **kargs)
File "/usr/share/vdsm/logUtils.py", line 45, in wrapper
res = f(*args, **kwargs)
File "/usr/share/vdsm/storage/hsm.py", line 960, in createStoragePool
masterVersion, leaseParams)
File "/usr/share/vdsm/storage/sp.py", line 617, in create
self._acquireTemporaryClusterLock(msdUUID, leaseParams)
File "/usr/share/vdsm/storage/sp.py", line 559, in
_acquireTemporaryClusterLock
msd.acquireHostId(self.id)
File "/usr/share/vdsm/storage/sd.py", line 458, in acquireHostId
self._clusterLock.acquireHostId(hostId, async)
File "/usr/share/vdsm/storage/clusterlock.py", line 189, in acquireHostId
raise se.AcquireHostIdFailure(self._sdUUID, e)
AcquireHostIdFailure: Cannot acquire host id:
('8dd2a4a5-b49f-4fef-a427-e62627fc09f7', SanlockException(19, 'Sanlock
lockspace add failure', 'No such device'))
/var/log/messages content
Sep 5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep 5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep 5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep 5 06:48:01 colovn1 multipathd: dm-3: remove map (uevent)
Sep 5 06:48:01 colovn1 sanlock[1173]: 2013-09-05 06:48:01+0200 518 [1786]:
open error -13
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
Sep 5 06:48:01 colovn1 sanlock[1173]: 2013-09-05 06:48:01+0200 518 [1786]: s1
open_disk
/rhev/data-center/mnt/10.10.30.251:_var_nas5_ovirt/8dd2a4a5-b49f-4fef-a427-e62627fc09f7/dom_md/ids
error -13
Sep 5 06:48:02 colovn1 sanlock[1173]: 2013-09-05 06:48:02+0200 519 [1178]: s1
add_lockspace fail result -19
Sep 5 06:48:02 colovn1 vdsm TaskManager.Task ERROR
Task=`22e150b3-2fae-42e2-ac85-52cee9eadfb9`::Unexpected error
Sep 5 06:50:13 colovn1 su: (to root) root on none
Sep 5 06:54:23 colovn1 systemd[1]: Starting Cleanup of Temporary Directories...
Sep 5 06:54:23 colovn1 systemd[1]: Started Cleanup of Temporary Directories.
Sep 5 06:55:05 colovn1 ntpd[1241]: 0.0.0.0 c612 02 freq_set kernel -32.960 PPM
Sep 5 06:55:05 colovn1 ntpd[1241]: 0.0.0.0 c615 05 clock_sync
sanlock version
[root@colovn1 dom_md]# yum list | grep sanlock
libvirt-lock-sanlock.x86_64 1.0.5.5-1.fc19 @updates
sanlock.x86_64 2.8-1.fc19 @updates
sanlock-lib.x86_64 2.8-1.fc19 @updates
sanlock-python.x86_64 2.8-1.fc19 @updates
fence-sanlock.x86_64 2.8-1.fc19 updates
sanlock-devel.i686 2.8-1.fc19 updates
sanlock-devel.x86_64 2.8-1.fc19 updates
sanlock-lib.i686 2.8-1.fc19 updates
****************************************************************************
Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte
Informationen. Wenn Sie nicht der richtige Adressat sind oder diese E-Mail
irrtümlich erhalten haben, informieren Sie bitte sofort den Absender und
vernichten Sie diese Mail. Das unerlaubte Kopieren sowie die unbefugte
Weitergabe dieser Mail ist nicht gestattet.
Ãber das Internet versandte E-Mails können unter fremden Namen erstellt oder
manipuliert werden. Deshalb ist diese als E-Mail verschickte Nachricht keine
rechtsverbindliche Willenserklärung.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
Vorstand:
Kadir Akin
Dr. Michael Höhnerbach
Vorsitzender des Aufsichtsrates:
Hans Kristian Langva
Registergericht: Amtsgericht Köln
Registernummer: HRB 52 497
This e-mail may contain confidential and/or privileged information. If you
are not the intended recipient (or have received this e-mail in error)
please notify the sender immediately and destroy this e-mail. Any
unauthorized copying, disclosure or distribution of the material in this
e-mail is strictly forbidden.
e-mails sent over the internet may have been written under a wrong name or
been manipulated. That is why this message sent as an e-mail is not a
legally binding declaration of intention.
Collogia
Unternehmensberatung AG
Ubierring 11
D-50678 Köln
executive board:
Kadir Akin
Dr. Michael Höhnerbach
President of the supervisory board:
Hans Kristian Langva
Registry office: district court Cologne
Register number: HRB 52 497
****************************************************************************
_______________________________________________
Users mailing list
[email protected]
http://lists.ovirt.org/mailman/listinfo/users
