Re: [Users] problem adding a gluster storage domain.
I am not sure how you have created a gluster volume with name as 'volume'. In gluster you cannot create volume with name 'volume'. If i try to do that, gluster says '"volume" cannot be the name of a volume'. Can you replace 'volume' with actual volume name while creating storage domain and repeat the steps? something like: 192.168.77.107:/test_vol or localhost:/test_vol - Original Message - From: "yoshinobu.ushida" To: "Kanagaraj Mayilsamy" Cc: users@ovirt.org Sent: Thursday, November 29, 2012 8:57:12 PM Subject: Re: [Users] problem adding a gluster storage domain. Thank you very much. I have executed the mount. Result is below. # /usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost\:_volume unknown option vers (ignored) I can mounted when I have created using gluster's command. # gluster volume create test_vol replica 2 transport tcp 192.168.77.107:/test 192.168.77.108:/test Creation of volume test_vol has been successful. Please start the volume to access data. # gluster volume start test_vol Starting volume test_vol has been successful # mount.glusterfs localhost:/test_vol /mnt # df -h | grep test_vol localhost:/test_vol 50G 2.2G 45G 5% /mnt Regards, Ushida 2012/11/29 Kanagaraj Mayilsamy < kmayi...@redhat.com > Have tried mounting the gluster volume? (to make sure problem is not there in gluster) Something like 'mount -t glusterfs localhost:/volume /tmp/volume'. You could execute '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' and see what happens. - Original Message - From: "yoshinobu.ushida" < yoshinobu.ush...@gmail.com > To: "Kanagaraj Mayilsamy" < kmayi...@redhat.com > Cc: users@ovirt.org Sent: Thursday, November 29, 2012 8:09:33 PM Subject: Re: [Users] problem adding a gluster storage domain. Hi Kanagaraj-san, Thank you for your reply. The check list are all okay. Do you have other check list? I have created another volume. However, result is same. vdsm.log is as follows. vdsm.log Thread-3849::DEBUG::2012-11-29 07:34:11,810::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state init -> state preparing Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='----', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '**', 'id': '----'}], options=None) Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '----'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::1172::TaskManager.Task::(prepare) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::finished: {'statuslist': [{'status': 0, 'id': '----'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state preparing -> state finished Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::978::TaskManager.Task::(_decref) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::ref 0 aborting False Thread-3850::DEBUG::2012-11-29 07:34:11,828::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3850::DEBUG::2012-11-29 07:34:11,828::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state init -> state preparing Thread-3850::INFO::2012-11-29 07:34:11,829::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='----', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn'
Re: [Users] problem adding a gluster storage domain.
Have tried mounting the gluster volume? (to make sure problem is not there in gluster) Something like 'mount -t glusterfs localhost:/volume /tmp/volume'. You could execute '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' and see what happens. - Original Message - From: "yoshinobu.ushida" To: "Kanagaraj Mayilsamy" Cc: users@ovirt.org Sent: Thursday, November 29, 2012 8:09:33 PM Subject: Re: [Users] problem adding a gluster storage domain. Hi Kanagaraj-san, Thank you for your reply. The check list are all okay. Do you have other check list? I have created another volume. However, result is same. vdsm.log is as follows. vdsm.log Thread-3849::DEBUG::2012-11-29 07:34:11,810::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state init -> state preparing Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::37::dispatcher::(wrapper) Run and protect: validateStorageServerConnection(domType=6, spUUID='----', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '**', 'id': '----'}], options=None) Thread-3849::INFO::2012-11-29 07:34:11,811::logUtils::39::dispatcher::(wrapper) Run and protect: validateStorageServerConnection, Return response: {'statuslist': [{'status': 0, 'id': '----'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,811::task::1172::TaskManager.Task::(prepare) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::finished: {'statuslist': [{'status': 0, 'id': '----'}]} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::588::TaskManager.Task::(_updateState) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::moving from state preparing -> state finished Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::809::ResourceManager.Owner::(releaseAll) Owner.releaseAll requests {} resources {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3849::DEBUG::2012-11-29 07:34:11,812::task::978::TaskManager.Task::(_decref) Task=`e2011748-ff36-4ffe-bb2d-4244ba461f29`::ref 0 aborting False Thread-3850::DEBUG::2012-11-29 07:34:11,828::BindingXMLRPC::156::vds::(wrapper) [192.168.77.1] Thread-3850::DEBUG::2012-11-29 07:34:11,828::task::588::TaskManager.Task::(_updateState) Task=`b21afac6-67df-49f2-9d5e-57888a8471a6`::moving from state init -> state preparing Thread-3850::INFO::2012-11-29 07:34:11,829::logUtils::37::dispatcher::(wrapper) Run and protect: connectStorageServer(domType=6, spUUID='----', conList=[{'port': '', 'connection': 'localhost:/volume', 'mnt_options': 'vers=3', 'portal': '', 'user': '', 'iqn': '', 'vfs_type': 'glusterfs', 'password': '**', 'id': 'a3675b5e-9433-435f-aecb-d9cad60f6d36'}], options=None) Thread-3850::DEBUG::2012-11-29 07:34:11,840::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/sudo -n /usr/bin/mount -t glusterfs -o vers=3 localhost:/volume /rhev/data-center/mnt/localhost:_volume' (cwd None) Thread-3850::ERROR::2012-11-29 07:34:11,906::hsm::1932::Storage.HSM::(connectStorageServer) Could not connect to storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 1929, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 179, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 190, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 206, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (1, 'unknown option vers (ignored)\nMount failed. Please check the log file for more details.\n;ERROR: failed to create logfile "/var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log" (Permission denied)\nERROR: failed to open logfile /var/log/glusterfs/rhev-data-center-mnt-localhost:_volume.log\n') Thread-3850::DEBUG::2012-11-29 07:34:11,907::lvm::457::OperationMutex::(_invalidateAllPvs) Ope
Re: [Users] problem adding a gluster storage domain.
vdsm.log? (from 'Use Host') Possible checklist: - all the bricks of the volume should have 36:36 permission - 'Use Host' should have gluster client packages - you could try without passing any mount options(vers=3) Regards, Kanagaraj - Original Message - From: "yoshinobu.ushida" To: users@ovirt.org Sent: Thursday, November 29, 2012 7:00:54 PM Subject: [Users] problem adding a gluster storage domain. Hi All, I have failed to create the new domain of glusterfs. After create volume, I am creating with reference to the below. http://middleswarth.net/content/installing-ovirt-31-and-glusterfs-using-either-nfs-or-posix-native-file-system-volume-setu-0 If you have any ideas, please let me know.. engine.log : 2012-11-29 22:26:50,742 WARN [org.ovirt.engine.core.bll.GetConfigurationValueQuery] (ajp--0.0.0.0-8009-2) calling GetConfigurationValueQuery (StorageDomainNameSizeLimit) with null version, using default general for version 2012-11-29 22:26:50,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ValidateStorageServerConnectionVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = ----, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 494f6442 2012-11-29 22:26:50,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=0}, log id: 494f6442 2012-11-29 22:26:50,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-10) [312d49f8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa0----123456789aaa Type: System 2012-11-29 22:26:50,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ConnectStorageServerVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = ----, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 2f838360 2012-11-29 22:26:50,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ConnectStorageServerVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=477}, log id: 2f838360 2012-11-29 22:26:50,937 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-10) [312d49f8] The connection with details localhost:/data failed because of error code 477 and error message is: 477 2012-11-29 22:26:50,971 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-4) [4b06833c] The message key AddPosixFsStorageDomain is missing from bundles/ExecutionMessages 2012-11-29 22:26:50,980 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Running command: AddPosixFsStorageDomainCommand internal: false. Entities affected : ID: aaa0----123456789aaa Type: System 2012-11-29 22:26:50,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] START, CreateStorageDomainVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@bce5367e, args=localhost:/data), log id: 72b00ef2 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Failed in CreateStorageDomainVDS method 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Error code StorageDomainFSNotMounted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Vds: node5 2012-11-29 22:26:53,481 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4) [
[Users] problem adding a gluster storage domain.
Hi All, I have failed to create the new domain of glusterfs. After create volume, I am creating with reference to the below. http://middleswarth.net/content/installing-ovirt-31-and-glusterfs-using-either-nfs-or-posix-native-file-system-volume-setu-0 If you have any ideas, please let me know.. engine.log : 2012-11-29 22:26:50,742 WARN [org.ovirt.engine.core.bll.GetConfigurationValueQuery] (ajp--0.0.0.0-8009-2) calling GetConfigurationValueQuery (StorageDomainNameSizeLimit) with null version, using default general for version 2012-11-29 22:26:50,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ValidateStorageServerConnectionVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = ----, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 494f6442 2012-11-29 22:26:50,839 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ValidateStorageServerConnectionVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ValidateStorageServerConnectionVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=0}, log id: 494f6442 2012-11-29 22:26:50,842 INFO [org.ovirt.engine.core.bll.storage.AddStorageServerConnectionCommand] (ajp--0.0.0.0-8009-10) [312d49f8] Running command: AddStorageServerConnectionCommand internal: false. Entities affected : ID: aaa0----123456789aaa Type: System 2012-11-29 22:26:50,843 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] START, ConnectStorageServerVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storagePoolId = ----, storageType = POSIXFS, connectionList = [{ id: 8713e422-eb64-48b4-99ba-c2d1bb20a98f, connection: localhost:/data };]), log id: 2f838360 2012-11-29 22:26:50,936 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (ajp--0.0.0.0-8009-10) [312d49f8] FINISH, ConnectStorageServerVDSCommand, return: {8713e422-eb64-48b4-99ba-c2d1bb20a98f=477}, log id: 2f838360 2012-11-29 22:26:50,937 ERROR [org.ovirt.engine.core.bll.storage.POSIXFSStorageHelper] (ajp--0.0.0.0-8009-10) [312d49f8] The connection with details localhost:/data failed because of error code 477 and error message is: 477 2012-11-29 22:26:50,971 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector] (ajp--0.0.0.0-8009-4) [4b06833c] The message key AddPosixFsStorageDomain is missing from bundles/ExecutionMessages 2012-11-29 22:26:50,980 INFO [org.ovirt.engine.core.bll.storage.AddPosixFsStorageDomainCommand] (ajp--0.0.0.0-8009-4) [4b06833c] Running command: AddPosixFsStorageDomainCommand internal: false. Entities affected : ID: aaa0----123456789aaa Type: System 2012-11-29 22:26:50,986 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] START, CreateStorageDomainVDSCommand(vdsId = cd7f71f6-3991-11e2-8952-e83935ee65b2, storageDomain=org.ovirt.engine.core.common.businessentities.storage_domain_static@bce5367e, args=localhost:/data), log id: 72b00ef2 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Failed in CreateStorageDomainVDS method 2012-11-29 22:26:53,479 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Error code StorageDomainFSNotMounted and error message VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand return value Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusOnlyReturnForXmlRpc mStatus Class Name: org.ovirt.engine.core.vdsbroker.vdsbroker.StatusForXmlRpc mCode 360 mMessage Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,480 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Vds: node5 2012-11-29 22:26:53,481 ERROR [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4) [4b06833c] Command CreateStorageDomainVDS execution failed. Exception: VDSErrorException: VDSGenericException: VDSErrorException: Failed to CreateStorageDomainVDS, error = Storage domain remote path not mounted: ('/rhev/data-center/mnt/localhost:_data',) 2012-11-29 22:26:53,481 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.CreateStorageDomainVDSCommand] (ajp--0.0.0.0-8009-4) [4b06833c] FINISH, CreateStorageDomainVDSCommand, log id: 72b00ef2 2012-11-29 22:26:53,482 ERROR