Re: [ovirt-users] Using Local Harddisks on the Host for Storage Domains
Hey, On 26/10/16 12:51 pm, Anantha Raghava wrote: Hello to all, Can we make use of large hard disk drives on the Hosts for shared storage domains? Use NFS on each host to export the local disk to your cluster. Ensure this is remembered, as when you want to reboot a specific node, you have to put the storage into maintenance as well. I also like to pin each VM using the storage to the node the NFS export lives on. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Hosted Engine oVirt 3.6 iscsi multipath
On 20/07/2016 5:28 PM, Simone Tiraboschi wrote: On Wed, Jul 20, 2016 at 7:09 AM, Julian De Marchi <jul...@jdcomputers.com.au> wrote: heya-- i have an ovirt 3.6 installation. all my iscsi LUNs are mulipath, however the hostedengine storage is not. i tried to import the hostedengine storage domain into my cluster but got a warning it is controlled via another oVirt cluster. i accepted the warning and imported anyway, but it crashed my hosted engine and hosted-engine broker restarted as expected. You don't have to try manually importing it: the engine will automatically import once you correctly added your first regular storage domain. When I first installed my 3.6 oVirt cluster, there was a bug where the storage domain didn't show up after first deploy. I have since upgraded the cluster to the latest oVirt 3.6, and the sotrage domain appeared, however I never tried to import it until now. i am curious of how to configure multipath for the hosted engine storage domain ? We have an open RFE for that, unfortunately it's still not ready. Thanks. My reason for looking into this is I need to reboot my prod SAN switch. I have the ports split between my two SAN switches, however only hostedengine is not multi-path, so during a reboot I will loose access to the LUN. Any solutions to the problem with oVirt? Shutting down the cluster is not an option. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] Hosted Engine oVirt 3.6 iscsi multipath
heya-- i have an ovirt 3.6 installation. all my iscsi LUNs are mulipath, however the hostedengine storage is not. i tried to import the hostedengine storage domain into my cluster but got a warning it is controlled via another oVirt cluster. i accepted the warning and imported anyway, but it crashed my hosted engine and hosted-engine broker restarted as expected. i am curious of how to configure multipath for the hosted engine storage domain ? many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Educational use case question
Hey Michael, > I am teaching IT subjects in TAFE (a kind of post-secondary technical > college) in Australia. Great news for this tech to be in tafe. I remember my time at Logan tafe got me into linux. We are currently looking for a virtualisation platform that will allow students to install and manage VMs via web interface. VMware is being proposed but I am trying to get KVM and the RedHat ecosystem in the lab as much as possible. I have reasonable experience with running virt manager on CentOS 7, but oVirt is new. I have it installed and running OK but am not sure how to proceed with configuration. I basically want to run a single physical server which will be the KVM host, the ISO and data store, and the home of oVirt engine ... in other words a complete oVirt-managed KVM virtualisation platform running on one physical machine (32GB RAM). It will only ever need to run a handful of VMs with little or no real data or load. Is this possible/feasible? If possible/feasible, where should oVirt engine go ... on the host itself, or into a VM guest? If it was me, I would do the engine install on the metal host itself. Will be a lot easier for you, as long as you _know_ you will not be adding more metal nodes to the oVirt setup. I would also be looking into the "VM Pool" feature for your student. This will give you a pool of VMs which after use can be reset to a default configuration. The web interface is what is making oVirt an attractive option at this stage, as students will be working from Windows clients on a corporate network. Do VM GUI display well in the browser? I have no experience using oVirt from Windows, but if there is a splice client available I see no reason why it shouldn't work. If you're local to QLD, I am more then happy to help in person. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [UPDATE] oVirt update process
On 21/12/2015 5:23 PM, Oved Ourfali wrote: In order to upgrade a cluster you need to press right click and upgrade for each host in the cluster. Note that this option exists only if there is indeed actually an upgrade available for the host. Also note that it will love migrate all running VMs to another host before doing the upgrade. Thanks! I didn't think it'd be that easy when I saw the upgrade button. You can of course automate that through scripting using the API, CLI or SDK. What about the engine itself? There is a bug in 3.6.0 where it does not show up in the oVirt cluster. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [UPDATE] oVirt update process
On 22/12/2015 4:43 PM, Oved Ourfali wrote: On Dec 22, 2015 00:36, "Julian De Marchi" <jul...@jdcomputers.com.au> wrote: On 21/12/2015 5:23 PM, Oved Ourfali wrote: In order to upgrade a cluster you need to press right click and upgrade for each host in the cluster. Note that this option exists only if there is indeed actually an upgrade available for the host. Also note that it will love migrate all running VMs to another host before doing the upgrade. Thanks! I didn't think it'd be that easy when I saw the upgrade button. You can of course automate that through scripting using the API, CLI or SDK. What about the engine itself? There is a bug in 3.6.0 where it does not show up in the oVirt cluster. Engine upgrades are done from outside, manually via yum and Engine-setup. Any tips on this part(re engine-setup)? And should the engine or nodes be done first? Not sure what bug you are referring to. Can you elaborate please? https://bugzilla.redhat.com/1269768 Many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [UPDATE] oVirt update process
Hey, I have updates ready for my oVirt cluster. 3.6.1.3 from 3.6.0.1 What is the process for updating a cluster? I've looked in the admin guide, and couldn't find the info I'm after. A step by step guide would be nice. Many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] Node not talking NFS to Node.
On 26/11/2015 10:05 PM, admin wrote: (cwd None) Thread-19211::ERROR::2015-11-26 11:56:23,213::storageServer::213::Storage.StorageServer.MountConnection::(c onnect) Mount failed: (32, ';mount.nfs: Connection timed out\n') Traceback (most recent call last): File "/usr/share/vdsm/storage/storageServer.py", line 211, in connect self._mount.mount(self.options, self._vfsType) File "/usr/share/vdsm/storage/mount.py", line 223, in mount return self._runcmd(cmd, timeout) File "/usr/share/vdsm/storage/mount.py", line 239, in _runcmd raise MountError(rc, ";".join((out, err))) MountError: (32, ';mount.nfs: Connection timed out\n') Thread-19211::ERROR::2015-11-26 11:56:23,214::hsm::2449::Storage.HSM::(connectStorageServer) Could not connect to storageServer Traceback (most recent call last): File "/usr/share/vdsm/storage/hsm.py", line 2446, in connectStorageServer conObj.connect() File "/usr/share/vdsm/storage/storageServer.py", line 330, in connect return self._mountCon.connect() File "/usr/share/vdsm/storage/storageServer.py", line 219, in connect raise e MountError: (32, ';mount.nfs: Connection timed out\n') Tried to manually mount the NFS share? The above is a clue from your logs. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] hosted-hs-agent
On 19/11/2015 9:02 PM, Martin Sivak wrote: Hi Julian, sorry for the late reply.. we had holidays here. Can you please give us the broker.log too if you ever encounter this again?. Anyway, glad to hear it resolved itself after reinstall. That's ok. Even the best need a break. :) I will give the log if it occurs again. However my ovirt 3.6 has been very stable since. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [EVENTS] oVirt event about storage domain
On 17/11/2015 9:03 PM, Simone Tiraboschi wrote: It should be automatically imported; we have an open bug about that: https://bugzilla.redhat.com/1269768 We are going to fix it for 3.6.1 This doesn't really affect other VMs cause you still have to create a second storage domain for regular VMs. As a side effect of this bug you will not see the engine VM in the VM list. Many thanks. It's not affecting anything as you say, just annoying. I never really understood the point of seeing the engine in the adminUI anyway, you can't perform actions with it, well you couldn't in 3.5 IIRC. I'd like to see it hidden and controlled via hosted-engine solely. Another nice thing with hosted-engine would be a migration feature. I've noticed when I put a node into local maint, it doesn't migrate the engine, I have to shut it down then let it restart on another node. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [EVENTS] oVirt event about storage domain
Bump... On 16/11/2015 9:44 AM, Julian De Marchi wrote: heya-- I am running a 3.6 cluster using hosted-engine. I have finally got the cluster running and left it over the weekend. Today however in my Events panel in the manager interface I am seeing this entry: The Hosted Engine Storage Domain doesn't no exist. It should be imported into the setup. I go to import data into my cluster and it says there is no data domains to import. In 3.5 this was never an issue and the hosted-engine pool was never visible in the management interface. Would appreciate any help. Thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [EVENTS] oVirt event about storage domain
heya-- I am running a 3.6 cluster using hosted-engine. I have finally got the cluster running and left it over the weekend. Today however in my Events panel in the manager interface I am seeing this entry: The Hosted Engine Storage Domain doesn't no exist. It should be imported into the setup. I go to import data into my cluster and it says there is no data domains to import. In 3.5 this was never an issue and the hosted-engine pool was never visible in the management interface. Would appreciate any help. Thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] hosted-hs-agent
This issue is now resolved. I re-installed the cluster, and this error never came back. On 11/11/2015 5:59 PM, Sandro Bonazzola wrote: On Wed, Nov 11, 2015 at 6:52 AM, Julian De Marchi <jul...@jdcomputers.com.au wrote: Heya-- Having issues starting ovirt-ha-agent on centos7. Any ideas? The IP is pingable from the host. This is fresh install. ovirt-hosted-engine-ha-1.2.7.2-1.el7.centos.noarch ==> agent.log <== MainThread::ERROR::2015-11-11 15:49:13,340::brokerlink::278::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_communicate) Connection closed MainThread::ERROR::2015-11-11 15:49:13,340::hosted_engine::406::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Failed to start necessary monitors MainThread::ERROR::2015-11-11 15:49:13,341::agent::177::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Error: 'Failed to start monitor ping, options {'addr': '10.254.83.1'}: Connection closed' - trying to restart agent Adding Martin. I suppose you already tried to restart the agent as suggested in above logs right? Many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [BACKUPS] oVirt 3.6 Backups
heya-- Trying to get oVirt backups working after seeing the notifications in my admin interface that no backups have occurred. I am having a few dramas running it. First if I just run engine-backup mode=backup it fails as it does not have a default option for a log file. So I musy run engine-backup --mode=backup --log=/var/log/ovirt-backup Next once it runs it fails to notify the engine. Here is the output from the log file: 2015-11-16 09:34:57 28124: OUTPUT: Notifying engine 2015-11-16 09:34:57 28124: pg_cmd running: psql -w -U engine -h localhost -p 5432 engine -t -c SELECT LogEngineBackupEvent('files', now(), -1, 'Failed', '$HOSTNAME', '/tmp/test'); psql: fe_sendauth: no password supplied 2015-11-16 09:34:57 28124: FATAL: Failed notifying engine 2015-11-16 09:34:57 28124: OUTPUT: Notifying engine 2015-11-16 09:34:57 28124: pg_cmd running: psql -w -U engine -h localhost -p 5432 engine -t -c SELECT LogEngineBackupEvent('files', now(), -1, 'Failed notifying engine', '$HOSTNAME', '/tmp/test'); psql: fe_sendauth: no password supplied 2015-11-16 09:34:57 28124: FATAL: Failed notifying engine 2015-11-16 09:34:57 28124: OUTPUT: Notifying engine 2015-11-16 09:34:57 28124: pg_cmd running: psql -w -U engine -h localhost -p 5432 engine -t -c SELECT LogEngineBackupEvent('files', now(), -1, 'Failed notifying engine', '$HOSTNAME', '/tmp/test'); psql: fe_sendauth: no password supplied 2015-11-16 09:34:57 28124: FATAL: Failed notifying engine 2015-11-16 09:34:57 28124: OUTPUT: Notifying engine 2015-11-16 09:34:57 28124: pg_cmd running: psql -w -U engine -h localhost -p 5432 engine -t -c SELECT LogEngineBackupEvent('files', now(), -1, 'Failed notifying engine', '$HOSTNAME', '/tmp/test'); psql: fe_sendauth: no password supplied Any help with this would be great! Thanks a lot. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [BACKUPS] oVirt 3.6 Backups
On 16/11/2015 4:43 PM, Yedidyah Bar David wrote: It's most probably [1]. If it's something else, please provide full command line and log. Thanks! The below command worked flawlessly. Thanks so much! /usr/bin/engine-backup --mode=backup --file=`pwd`/test.tar --log=/tmp/test --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [SOLVED] Re: oVirt 3.6 disk speeds
heya-- Issue came down to memory. The engine had 4095MB while my test VM had 1048MB. Bumping up memory on my test VM saw speeds increase. In any case, 48 - 60MBs is my real speed. Time for iozone. Hopefully this helps others. --julian On 23/10/2015 1:55 PM, Julian De Marchi wrote: heya-- Playing around with oVirt 3.6 on some new kit before I rack and stack in the DC. - Dell Eql PS4210(Raid-6) - Dell R630 - Dell N400 10GB switch I have my 10GB interfaces bonded and in a port-channel. I have setup a basic 3.6 oVirt self-hosted stack. I am seeing some pretty big differences in disks speeds from the self-hosted engine and a VM guest. Both are direct luns via iscsi from the SAN on the 10GB port-channel. Normal network traffic does not go over the 10GB. On the engine I'm seeing this: # dd if=/dev/zero of=~/testfile bs=1G count=1 oflag=dsync 1+0 records in 1+0 records out 1073741824 bytes (1.1 GB) copied, 1.58877 s, 676 MB/s On a test VM I'm seeing this: # dd if=/dev/zero of=~/testfile bs=1G count=1 oflag=dsync 1+0 records in 1+0 records out 1073741824 bytes (1.1 GB) copied, 22.0732 s, 48.6 MB/s I have played with the disk drivers for my guest VM, changing between drivers does not change the speed at all. What ideas do you folks have for me to narrow down this slow down? I don't really know where to start with this one. I also noticed that 3.6 does not yet have ovirt-guest-agent available. I know DD is not the best test for disk speeds, but it works for what I need right now, iozone will be next when I'm happy. Many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] oVirt 3.6 disk speeds
heya-- Playing around with oVirt 3.6 on some new kit before I rack and stack in the DC. - Dell Eql PS4210(Raid-6) - Dell R630 - Dell N400 10GB switch I have my 10GB interfaces bonded and in a port-channel. I have setup a basic 3.6 oVirt self-hosted stack. I am seeing some pretty big differences in disks speeds from the self-hosted engine and a VM guest. Both are direct luns via iscsi from the SAN on the 10GB port-channel. Normal network traffic does not go over the 10GB. On the engine I'm seeing this: # dd if=/dev/zero of=~/testfile bs=1G count=1 oflag=dsync 1+0 records in 1+0 records out 1073741824 bytes (1.1 GB) copied, 1.58877 s, 676 MB/s On a test VM I'm seeing this: # dd if=/dev/zero of=~/testfile bs=1G count=1 oflag=dsync 1+0 records in 1+0 records out 1073741824 bytes (1.1 GB) copied, 22.0732 s, 48.6 MB/s I have played with the disk drivers for my guest VM, changing between drivers does not change the speed at all. What ideas do you folks have for me to narrow down this slow down? I don't really know where to start with this one. I also noticed that 3.6 does not yet have ovirt-guest-agent available. I know DD is not the best test for disk speeds, but it works for what I need right now, iozone will be next when I'm happy. Many thanks! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] oVirt Engine redundant ?
On 12/10/2015 1:56 AM, Nico wrote: Hello I got a question regarding the redundancy of oVirt Engine; where we can control everything through the GUI; aka the vCenter. Initially; my setup was on a single server; installed following the doc AllinOne. Then after; i figured out that i would need redundancy; so i installed a second node. my question is about the vCenter; is it possible to start it on the second node when the first node is down or in maintenance ? how to ensure it is replicated ? i see there is a postgres DB on first node; but not on second node. I'm a bit worried. So, is it possible to have a dormant/slave ovirt ENGINE (oVirt web GUI ) ; and if yes, could you point me to the related documentation as i didn't find it. Maybe, it is possible to run it in a VM ? is it a good idea ? and is it still possible to migrate ? The oVirt hosted-engine will do what you want. Have a read of the below. http://www.ovirt.org/Migrate_to_Hosted_Engine --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [STORAGE] Remove detached storage from list
On 08/02/15 22:38, Aharon Canan wrote: I tried to reproduce your issue and failed (Using POSIX domain), I can destroy the SD even if it is unattached. Mine is NFS Domain. Can you provide some more info? When I go into the storage view vis the Data Center asset on the left I can view my 3 active SDs. When I click attach data two old SDs are viewable in the list. I'm unable to find a way to delete these two SDs with out first attaching them. In this instance they are un-attachable thus I can't proceed to remove them. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [STORAGE] Remove detached storage from list
Heya-- I currently have two storage domains in the detach list in Ovirt 3.5. These are old storage domains that can no longer me mounted. I'm trying to find a way to remove these as I can't just attach them again to destroy them. Any help would be awesome! --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
Sorry for belated reply... Holidays etc... On 12/18/14 16:12, Vered Volansky wrote: Hi Julian, Hi Vared, Please see my questions inline. Answered inline, not trimmed to keep context for all. Vered - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: Vered Volansky ve...@redhat.com Cc: users@ovirt.org Sent: Wednesday, December 17, 2014 4:29:36 PM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 17/12/14 21:38, Vered Volansky wrote: Hi Julian, Hey Vered, IIUC the you have a self-created lvm, to which you're trying to connect as posix using ovirt. If that's the case please try to manually change the device's permissions to 36:36 under /dev/your_VG. If that doesn't work try the actual device it's mapped to (which is what vdsm actually tries to mount). If that also doesn't work please send us the output of: ls -lh /dev/your_VG . Still failed mate after a chmod 36:36. The thing is though, it _does_ mount the device for a moment before failing and unmounting it... Is this the same behaviour as before? [root@blade01 ~]# ls /dev/VolGroup/lv_images -lh lrwxrwxrwx 1 root root 7 Dec 15 16:52 /dev/VolGroup/lv_images - ../dm-2 I see /dev/VolGroup/lv_images are still root:root. Please chown 36:36 as well. Please state the all the chown you tried. This is the symlink so you can never chown that part, only the source. I did a chown foo:bar [root@blade01 ~]# ls /dev/dm-2 -lh brw-rw 1 vdsm kvm 253, 2 Dec 15 16:52 /dev/dm-2 Regards, Vered - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Wednesday, December 17, 2014 3:35:34 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS Think I found some more clues. Thread-21910::DEBUG::2014-12-17 11:26:07,277::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = [^/dev/mapper/] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 3ba06bee-861e-4868-8e89-f29f785bab65 (cwd None) Thread-21910::DEBUG::2014-12-17 11:26:07,348::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: err = ' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found\n Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65\n'; rc = 5 Thread-21910::WARNING::2014-12-17 11:26:07,350::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found', ' Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65'] Thread-21910::DEBUG::2014-12-17 11:26:07,351::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex But I still don't understand what it's trying to do. Just to recap, I do see it create the dir and mount the device. But when it fails it umounts everything. I tried to manually create the DIR it is expecting, but ovirt seems to remove it and re-create it which then ends up with root:root. I can see this as when I add the storage I run watch ls -lh and can see it all occur. Any help would still be greatly appreciated! On 12/16/14 19:46, Julian De Marchi wrote: On 16/12/14 17:20, Aharon Canan wrote: Did you chown 36:36 the folder to get the right permissions for adding to ovirt? That's the thing. Ovirt actually creates that dir when I go and try to add the storage. It mounts the LVM device to that dir then fails. In the logs I posted at http://pastebin.com/fzN9ktAX you can see it is failing with a permission denied error. The command that is above the error is touch. I think it is trying to touch a file to ensure all is well and when that fails it gives the error. If I knew where in the code to prefix the touch command with sudo and add a line to the sudoers entry I can test this idea. [...] - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Tuesday, December 16, 2014 4:40:04 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 12/16/14 08:57, Julian De Marchi wrote: Heya-- I'm using ovirt 3.5 and trying to add a posix compliant FS to a node in my cluster. The storage I'm trying to add is contained within LVM. Below is a link to my log files on the node where I'm trying to attach the storage. http://pastebin.com/fzN9ktAX I've read the ovirt manual for adding posix compliant storage and believe I'm doing everything correct. Any help to get this storage added would be great thanks and if I forgot to include any info please ask. More info to add. I was doing an ls on the dir it does the mount in and saw
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
On 12/18/14 18:23, Gianluca Cecchi wrote: On Thu, Dec 18, 2014 at 7:12 AM, Vered Volansky ve...@redhat.com wrote: Hey Vered, IIUC the you have a self-created lvm, to which you're trying to connect as posix using ovirt. If that's the case please try to manually change the device's permissions to 36:36 under /dev/your_VG. If that doesn't work try the actual device it's mapped to (which is what vdsm actually tries to mount). If that also doesn't work please send us the output of: ls -lh /dev/your_VG . Still failed mate after a chmod 36:36. The thing is though, it _does_ mount the device for a moment before failing and unmounting it... Is this the same behaviour as before? [root@blade01 ~]# ls /dev/VolGroup/lv_images -lh lrwxrwxrwx 1 root root 7 Dec 15 16:52 /dev/VolGroup/lv_images - ../dm-2 I see /dev/VolGroup/lv_images are still root:root. Please chown 36:36 as well. Please state the all the chown you tried. Possibly a starting point for automating LVM device permissions setting is https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Logical_Volume_Manager_Administration/udev_device_manager.html and in particular the possibility to add, under /lib/udev/rules, a customized file based on the one found in /usr/share/doc/device-mapper/12-dm-permissions.rules Not tried myself though... I don't think permissions for the device are the root cause of the issue. The way I see it behave when I try and mount it is: vdsm will mount the device(If I'm quick I can see this with a LS). It then tries to write some kind of test file(I'm guessing) and as the mount point is still owned by root when vdsm tries to do the touch to test it fails. Then vdsm backs out and I get the failed to add storage error. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
On 12/21/14 06:59, Nir Soffer wrote: - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: Vered Volansky ve...@redhat.com Cc: users@ovirt.org Sent: Wednesday, December 17, 2014 4:29:36 PM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 17/12/14 21:38, Vered Volansky wrote: Hi Julian, Hey Vered, IIUC the you have a self-created lvm, to which you're trying to connect as posix using ovirt. If that's the case please try to manually change the device's permissions to 36:36 under /dev/your_VG. If that doesn't work try the actual device it's mapped to (which is what vdsm actually tries to mount). If that also doesn't work please send us the output of: ls -lh /dev/your_VG . Still failed mate after a chmod 36:36. The thing is though, it _does_ mount the device for a moment before failing and unmounting it... [root@blade01 ~]# ls /dev/VolGroup/lv_images -lh lrwxrwxrwx 1 root root 7 Dec 15 16:52 /dev/VolGroup/lv_images - ../dm-2 [root@blade01 ~]# ls /dev/dm-2 -lh brw-rw 1 vdsm kvm 253, 2 Dec 15 16:52 /dev/dm-2 Hi Julian, Hey Nir, It is not clear what are you trying to do - is this lv on shared storage, and accessed by multiple hosts or use only one host? It's a local LVM mount. If the lv is shared, you cannot create a file system and mount it on multiple hosts (unless you are using cluster file system). If this local storage for one host, you should create a file system and mount it, and then you can use the mountpoint as local storage. If I proceed this way then the ovirt node needs to be in it's own local cluster, correct? Please describe in details what are you trying to do and how did you create the storage domain in the engine side. I first did a default centos install which created the LVM stuff. I then lvrename the home LV to images LV. My end goal is to use the posix compliant mount option to have each of my ovirt nodes the option to use local storage for VMs for which I'm not fussed if they can migrate between the cluster or not. Does this make more sense? --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
On 17/12/14 21:38, Vered Volansky wrote: Hi Julian, Hey Vered, IIUC the you have a self-created lvm, to which you're trying to connect as posix using ovirt. If that's the case please try to manually change the device's permissions to 36:36 under /dev/your_VG. If that doesn't work try the actual device it's mapped to (which is what vdsm actually tries to mount). If that also doesn't work please send us the output of: ls -lh /dev/your_VG . Still failed mate after a chmod 36:36. The thing is though, it _does_ mount the device for a moment before failing and unmounting it... [root@blade01 ~]# ls /dev/VolGroup/lv_images -lh lrwxrwxrwx 1 root root 7 Dec 15 16:52 /dev/VolGroup/lv_images - ../dm-2 [root@blade01 ~]# ls /dev/dm-2 -lh brw-rw 1 vdsm kvm 253, 2 Dec 15 16:52 /dev/dm-2 Regards, Vered - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Wednesday, December 17, 2014 3:35:34 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS Think I found some more clues. Thread-21910::DEBUG::2014-12-17 11:26:07,277::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = [^/dev/mapper/] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 3ba06bee-861e-4868-8e89-f29f785bab65 (cwd None) Thread-21910::DEBUG::2014-12-17 11:26:07,348::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: err = ' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found\n Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65\n'; rc = 5 Thread-21910::WARNING::2014-12-17 11:26:07,350::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found', ' Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65'] Thread-21910::DEBUG::2014-12-17 11:26:07,351::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex But I still don't understand what it's trying to do. Just to recap, I do see it create the dir and mount the device. But when it fails it umounts everything. I tried to manually create the DIR it is expecting, but ovirt seems to remove it and re-create it which then ends up with root:root. I can see this as when I add the storage I run watch ls -lh and can see it all occur. Any help would still be greatly appreciated! On 12/16/14 19:46, Julian De Marchi wrote: On 16/12/14 17:20, Aharon Canan wrote: Did you chown 36:36 the folder to get the right permissions for adding to ovirt? That's the thing. Ovirt actually creates that dir when I go and try to add the storage. It mounts the LVM device to that dir then fails. In the logs I posted at http://pastebin.com/fzN9ktAX you can see it is failing with a permission denied error. The command that is above the error is touch. I think it is trying to touch a file to ensure all is well and when that fails it gives the error. If I knew where in the code to prefix the touch command with sudo and add a line to the sudoers entry I can test this idea. [...] - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Tuesday, December 16, 2014 4:40:04 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 12/16/14 08:57, Julian De Marchi wrote: Heya-- I'm using ovirt 3.5 and trying to add a posix compliant FS to a node in my cluster. The storage I'm trying to add is contained within LVM. Below is a link to my log files on the node where I'm trying to attach the storage. http://pastebin.com/fzN9ktAX I've read the ovirt manual for adding posix compliant storage and believe I'm doing everything correct. Any help to get this storage added would be great thanks and if I forgot to include any info please ask. More info to add. I was doing an ls on the dir it does the mount in and saw the dir was owned by root:root with different perms to the ones mounted via NFS. [root@blade01 libvirt]# ls /rhev/data-center/mnt/ -lh total 20K drwxrwxrwx 4 root root 4.0K Dec 11 09:00 10.106.200.100:_VM__IMAGES drwxrwxrwx 3 root root 4.0K Oct 17 09:42 10.106.200.22:_opt_vmexport drwxrwxrwx 4 root root 4.0K Oct 17 09:39 10.106.200.22:_var_lib_libvirt_images drwxr-xr-x 3 root root 4.0K Dec 15 16:52 _dev_mapper_VolGroup-lv__images This could explain why the touch command fails. Still at a loss over the issue though. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
On 16/12/14 17:20, Aharon Canan wrote: Did you chown 36:36 the folder to get the right permissions for adding to ovirt? That's the thing. Ovirt actually creates that dir when I go and try to add the storage. It mounts the LVM device to that dir then fails. In the logs I posted at http://pastebin.com/fzN9ktAX you can see it is failing with a permission denied error. The command that is above the error is touch. I think it is trying to touch a file to ensure all is well and when that fails it gives the error. If I knew where in the code to prefix the touch command with sudo and add a line to the sudoers entry I can test this idea. [...] - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Tuesday, December 16, 2014 4:40:04 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 12/16/14 08:57, Julian De Marchi wrote: Heya-- I'm using ovirt 3.5 and trying to add a posix compliant FS to a node in my cluster. The storage I'm trying to add is contained within LVM. Below is a link to my log files on the node where I'm trying to attach the storage. http://pastebin.com/fzN9ktAX I've read the ovirt manual for adding posix compliant storage and believe I'm doing everything correct. Any help to get this storage added would be great thanks and if I forgot to include any info please ask. More info to add. I was doing an ls on the dir it does the mount in and saw the dir was owned by root:root with different perms to the ones mounted via NFS. [root@blade01 libvirt]# ls /rhev/data-center/mnt/ -lh total 20K drwxrwxrwx 4 root root 4.0K Dec 11 09:00 10.106.200.100:_VM__IMAGES drwxrwxrwx 3 root root 4.0K Oct 17 09:42 10.106.200.22:_opt_vmexport drwxrwxrwx 4 root root 4.0K Oct 17 09:39 10.106.200.22:_var_lib_libvirt_images drwxr-xr-x 3 root root 4.0K Dec 15 16:52 _dev_mapper_VolGroup-lv__images This could explain why the touch command fails. Still at a loss over the issue though. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Re: [ovirt-users] [STORAGE] Adding posix compliant FS
Think I found some more clues. Thread-21910::DEBUG::2014-12-17 11:26:07,277::lvm::288::Storage.Misc.excCmd::(cmd) /usr/bin/sudo -n /sbin/lvm vgs --config ' devices { preferred_names = [^/dev/mapper/] ignore_suspended_devices=1 write_cache_state=0 disable_after_error_count=3 obtain_device_list_from_udev=0 filter = [ '\''r|.*|'\'' ] } global { locking_type=1 prioritise_write_locks=1 wait_for_locks=1 use_lvmetad=0 } backup { retain_min = 50 retain_days = 0 } ' --noheadings --units b --nosuffix --separator '|' --ignoreskippedcluster -o uuid,name,attr,size,free,extent_size,extent_count,free_count,tags,vg_mda_size,vg_mda_free,lv_count,pv_count,pv_name 3ba06bee-861e-4868-8e89-f29f785bab65 (cwd None) Thread-21910::DEBUG::2014-12-17 11:26:07,348::lvm::288::Storage.Misc.excCmd::(cmd) FAILED: err = ' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found\n Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65\n'; rc = 5 Thread-21910::WARNING::2014-12-17 11:26:07,350::lvm::370::Storage.LVM::(_reloadvgs) lvm vgs failed: 5 [] [' Volume group 3ba06bee-861e-4868-8e89-f29f785bab65 not found', ' Skipping volume group 3ba06bee-861e-4868-8e89-f29f785bab65'] Thread-21910::DEBUG::2014-12-17 11:26:07,351::lvm::407::Storage.OperationMutex::(_reloadvgs) Operation 'lvm reload operation' released the operation mutex But I still don't understand what it's trying to do. Just to recap, I do see it create the dir and mount the device. But when it fails it umounts everything. I tried to manually create the DIR it is expecting, but ovirt seems to remove it and re-create it which then ends up with root:root. I can see this as when I add the storage I run watch ls -lh and can see it all occur. Any help would still be greatly appreciated! On 12/16/14 19:46, Julian De Marchi wrote: On 16/12/14 17:20, Aharon Canan wrote: Did you chown 36:36 the folder to get the right permissions for adding to ovirt? That's the thing. Ovirt actually creates that dir when I go and try to add the storage. It mounts the LVM device to that dir then fails. In the logs I posted at http://pastebin.com/fzN9ktAX you can see it is failing with a permission denied error. The command that is above the error is touch. I think it is trying to touch a file to ensure all is well and when that fails it gives the error. If I knew where in the code to prefix the touch command with sudo and add a line to the sudoers entry I can test this idea. [...] - Original Message - From: Julian De Marchi jul...@jdcomputers.com.au To: users@ovirt.org Sent: Tuesday, December 16, 2014 4:40:04 AM Subject: Re: [ovirt-users] [STORAGE] Adding posix compliant FS On 12/16/14 08:57, Julian De Marchi wrote: Heya-- I'm using ovirt 3.5 and trying to add a posix compliant FS to a node in my cluster. The storage I'm trying to add is contained within LVM. Below is a link to my log files on the node where I'm trying to attach the storage. http://pastebin.com/fzN9ktAX I've read the ovirt manual for adding posix compliant storage and believe I'm doing everything correct. Any help to get this storage added would be great thanks and if I forgot to include any info please ask. More info to add. I was doing an ls on the dir it does the mount in and saw the dir was owned by root:root with different perms to the ones mounted via NFS. [root@blade01 libvirt]# ls /rhev/data-center/mnt/ -lh total 20K drwxrwxrwx 4 root root 4.0K Dec 11 09:00 10.106.200.100:_VM__IMAGES drwxrwxrwx 3 root root 4.0K Oct 17 09:42 10.106.200.22:_opt_vmexport drwxrwxrwx 4 root root 4.0K Oct 17 09:39 10.106.200.22:_var_lib_libvirt_images drwxr-xr-x 3 root root 4.0K Dec 15 16:52 _dev_mapper_VolGroup-lv__images This could explain why the touch command fails. Still at a loss over the issue though. ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
[ovirt-users] [STORAGE] Adding posix compliant FS
Heya-- I'm using ovirt 3.5 and trying to add a posix compliant FS to a node in my cluster. The storage I'm trying to add is contained within LVM. Below is a link to my log files on the node where I'm trying to attach the storage. http://pastebin.com/fzN9ktAX I've read the ovirt manual for adding posix compliant storage and believe I'm doing everything correct. Any help to get this storage added would be great thanks and if I forgot to include any info please ask. --julian ___ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users