[ovirt-users] Re: Hosted engine unaviable after storage rebuild

[sebastian . w]

the vdsm log is endless.
These are the last lines
Hope it helps 

OSError: [Errno 13] Permission denied
2018-07-29 16:56:17,069+0200 INFO  (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call 
StorageDomain.getStats failed (error 350) in 0.19 seconds (__init__:573)
2018-07-29 16:56:17,097+0200 INFO  (jsonrpc/0) [vdsm.api] START 
prepareImage(sdUUID=u'2395042b-7031-4c83-85a4-a2bb325fdbfd', 
spUUID=u'----', 
imgUUID=u'e14ecef8-28ec-4b93-b0a7-7f490358ddbf', 
leafUUID=u'a6caa26a-6584-420f-8f55-2c396aac589a', allowIllegal=False) 
from=::1,43892, task_id=286bd8bf-69a1-4c4e-b496-99efd7220fe0 (api:46)
2018-07-29 16:56:17,105+0200 INFO  (jsonrpc/0) [vdsm.api] FINISH prepareImage 
error=[Errno 13] Permission denied from=::1,43892, 
task_id=286bd8bf-69a1-4c4e-b496-99efd7220fe0 (api:50)
2018-07-29 16:56:17,105+0200 ERROR (jsonrpc/0) [storage.TaskManager.Task] 
(Task='286bd8bf-69a1-4c4e-b496-99efd7220fe0') Unexpected error (task:875)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in 
_run
return fn(*args, **kargs)
  File "", line 2, in prepareImage
  File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
ret = func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 3156, in 
prepareImage
dom = sdCache.produce(sdUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 110, in 
produce
domain.getRealDomain()
  File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 51, in 
getRealDomain
return self._cache._realProduce(self._sdUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 134, in 
_realProduce
domain = self._findDomain(sdUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/sdc.py", line 151, in 
_findDomain
return findMethod(sdUUID)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/nfsSD.py", line 128, in 
findDomain
return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
  File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 391, in 
__init__
validateFileSystemFeatures(manifest.sdUUID, manifest.mountpoint)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/fileSD.py", line 104, in 
validateFileSystemFeatures
oop.getProcessPool(sdUUID).directTouch(testFilePath)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/outOfProcess.py", line 
320, in directTouch
ioproc.touch(path, flags, mode)
  File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 567, in 
touch
self.timeout)
  File "/usr/lib/python2.7/site-packages/ioprocess/__init__.py", line 451, in 
_sendCommand
raise OSError(errcode, errstr)
OSError: [Errno 13] Permission denied
2018-07-29 16:56:17,105+0200 INFO  (jsonrpc/0) [storage.TaskManager.Task] 
(Task='286bd8bf-69a1-4c4e-b496-99efd7220fe0') aborting: Task is aborted: 
u'[Errno 13] Permission denied' - code 100 (task:1181)
2018-07-29 16:56:17,105+0200 ERROR (jsonrpc/0) [storage.Dispatcher] FINISH 
prepareImage error=[Errno 13] Permission denied (dispatcher:86)
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/vdsm/storage/dispatcher.py", line 73, 
in wrapper
result = ctask.prepare(func, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 108, in 
wrapper
return m(self, *a, **kw)
  File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 1189, in 
prepare
raise self.error
OSError: [Errno 13] Permission denied
2018-07-29 16:56:17,105+0200 INFO  (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call 
Image.prepare failed (error 100) in 0.01 seconds (__init__:573)
2018-07-29 16:56:17,431+0200 INFO  (vmrecovery) [vdsm.api] START 
getConnectedStoragePoolsList(options=None) from=internal, 
task_id=48e0e011-5c17-466c-9a21-fe427dd5c8e3 (api:46)
2018-07-29 16:56:17,431+0200 INFO  (vmrecovery) [vdsm.api] FINISH 
getConnectedStoragePoolsList return={'poollist': []} from=internal, 
task_id=48e0e011-5c17-466c-9a21-fe427dd5c8e3 (api:52)
2018-07-29 16:56:17,431+0200 INFO  (vmrecovery) [vds] recovery: waiting for 
storage pool to go up (clientIF:707)
2018-07-29 16:56:21,930+0200 INFO  (periodic/0) [vdsm.api] START 
repoStats(domains=()) from=internal, 
task_id=19446066-361d-49ab-aef4-653f42c819ed (api:46)
2018-07-29 16:56:21,930+0200 INFO  (periodic/0) [vdsm.api] FINISH repoStats 
return={} from=internal, task_id=19446066-361d-49ab-aef4-653f42c819ed (api:52)
2018-07-29 16:56:21,931+0200 INFO  (periodic/0) [vdsm.api] START 
multipath_health() from=internal, task_id=6fe54950-82f6-4881-9cdd-2363b002203e 
(api:46)
2018-07-29 16:56:21,931+0200 INFO  (periodic/0) [vdsm.api] FINISH 
multipath_health return={} from=internal, 
task_id=6fe54950-82f6-4881-9cdd-2363b002203e (api:52)
2018-07-29 16:56:21,937+0200 ERROR (periodic/0) [root] failed to retrieve 
Hosted Engine HA score '[Errno 2] No such file or directory'Is the Hosted 
Engine setup finished? (api:196)
2018-07-29 

[ovirt-users] Re: Hosted engine unaviable after storage rebuild

[sebastian . w]

sorry for the late replay, I was in holiday...

I only checked the "normal" logs mentioned in the docs of oVirt.

In /var/log/ovirt-hosted-engine-ha/broker.log I found 

MainThread::WARNING::2018-07-22 
08:33:20,338::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__)
 Can't connect vdsm storage: Command Image.prepare with args {'imageID': 
'e14ecef8-28ec-4b93-b0a7-7f490358ddbf', 'storagepoolID': 
'----', 'volumeID': 
'a6caa26a-6584-420f-8f55-2c396aac589a', 'storagedomainID': 
'2395042b-7031-4c83-85a4-a2bb325fdbfd'} failed:
(code=100, message=[Errno 13] Permission denied)

But the NFS share I can mount (as root) on /mnt.
I changed the permission of the Folder to 777 and the owner is the user 36/vdsm

drwxrwxrwx.5 vdsm kvm  4096 Jul 22 09:19 
2395042b-7031-4c83-85a4-a2bb325fdbfd

But stil I get a Permission denied

Thank for you help
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/YH26KNTYJX2IQF5XFJFMNZHXSPHSNVVF/

[ovirt-users] Hosted engine unaviable after storage rebuild

[sebastian . w]

Hello all,
My hosted engine does not start up anymore, because the node can't reach the 
storage.

The hosted engine configuration has not been retrieved from shared storage. 
Please ensure that ovirt-ha-agent is running and the storage server is 
reachable.

What happend is that my NAS crashed and I had to rebuild it from the backup. 
I'm quit sure that I called all the NFS shares the same way as they  bevore the 
issue.

How can I figure out whats the issue with the storage?
The logs wheren't realy helpful for me (but may it's me and not the logs to 
blame)

Regards and thanks
Sebi
___
Users mailing list -- users@ovirt.org
To unsubscribe send an email to users-le...@ovirt.org
Privacy Statement: https://www.ovirt.org/site/privacy-policy/
oVirt Code of Conduct: 
https://www.ovirt.org/community/about/community-guidelines/
List Archives: 
https://lists.ovirt.org/archives/list/users@ovirt.org/message/2TWEIRH45T6C3DOK7IEDLY7ZIWS6XX5C/