[one-users] Second host has no datastores
Hello, I have added a second host to my opennebula cluster following official guide. I use ceph datastore in my cluster. Now the host is added correctly using sunstone (no errors). I then try to live migrate or migrate a vm and it fails with a datastore error. Infact I can see there is no datastore folder in my new host. Can you help me? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] Windows on opennebula
Hello, thanks but infact I started using web gui but now I am using spice protocol that works only with remote-viewer software. Mario 2013/12/20 Kenneth kenn...@apolloglobal.net You are using the web GUI for your windows VM right? Mine too is very unstable so I installed a VNC server (tightVNC) on the windows vm and then use a vnc client to control it. I don't use nebula to control the windows vm. --- Thanks, Kenneth Apollo Global Corp. On 12/20/2013 03:28 AM, Mario Giammarco wrote: Hello, I was finally able to install a windows xp machine on my ceph/kvm/opennebula. I am using now spice protocol and adding some rawdata now windows uses qxl driver. Unfortunately mouse movement is jerky/unstable. It was not good with vnc but it has not improved enough with spice. Can you help me? Thanks, Mario ___ Users mailing listUsers@lists.opennebula.orghttp://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] No system datastore with enough capacity form the VM
Thank you for your explanation. Infact I have already found it by trial and error. I usually read documentation (and I have read the big opennebula documentation). But, as I have already said in an other post, probably because I am new to cloud virtualization systems (I am used to standard virtualization like vmware), even reading documentation I cannot understand easily several concepts: - difference among persistent/non persistent/volatile; - why I need to create a template and I cannot create virtual machines directly; So I wonder if there is a tutorial on using cloud systems or something similar. Thanks again, Mario 2013/12/16 Carlos Martín Sánchez cmar...@opennebula.org Hi, On Fri, Dec 13, 2013 at 7:04 PM, Mario Giammarco mgiamma...@gmail.com wrote: I have done other tests. If I use a premade image from marketplace all works. The problem is that I have tried to install an so from scratch (windows) and I have created a volatile disk. Probably it is my fault but I still do not understand how to put all my vm in ceph filesystem. That's the problem. Volatile disks are created in the system datastore. To install a new OS you need to create an empty datablock persistent image [1], because volatile disks are always disposed when the VM is deleted. Regards [1] http://opennebula.org/documentation:rel4.4:img_guide#making_images_persistent [2] http://opennebula.org/documentation:rel4.4:template#disks_section -- Carlos Martín, MSc Project Engineer OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | cmar...@opennebula.org | @OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org On Fri, Dec 13, 2013 at 7:04 PM, Mario Giammarco mgiamma...@gmail.comwrote: I have done other tests. If I use a premade image from marketplace all works. The problem is that I have tried to install an so from scratch (windows) and I have created a volatile disk. Probably it is my fault but I still do not understand how to put all my vm in ceph filesystem. 2013/12/12 Carlos Martín Sánchez cmar...@opennebula.org So the scheduler thinks that the VM needs 100 GB in the system DS instead of the ceph image DS. Could you please paste the output of onedatastore show 100 104 ? Regards -- Carlos Martín, MSc Project Engineer OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | cmar...@opennebula.org | @OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org On Wed, Dec 11, 2013 at 8:53 PM, Mario Giammarco mgiamma...@gmail.comwrote: Here are some parts of the log, please note that I tried two things: - clean some requirements of the vm (datastore rank stripping); - adding another system datastore (I have one shared and one ssh); - please also note that system datastore with id 0 was never used because it was not part of the cluster or public; - I have also deleted and recreated VM; Wed Dec 11 10:02:06 2013 [SCHED][I]: Init Scheduler Log system Wed Dec 11 10:02:06 2013 [SCHED][I]: Starting Scheduler Daemon Scheduler Configuration File DEFAULT_DS_SCHED=POLICY=1 DEFAULT_SCHED=POLICY=1 HYPERVISOR_MEM=0.1 LIVE_RESCHEDS=0 LOG=DEBUG_LEVEL=3,SYSTEM=file MAX_DISPATCH=30 MAX_HOST=1 MAX_VM=5000 ONED_PORT=2633 SCHED_INTERVAL=30 Wed Dec 11 10:02:06 2013 [SCHED][I]: Starting scheduler loop... Wed Dec 11 10:02:06 2013 [SCHED][I]: Scheduler loop started. Wed Dec 11 10:08:36 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 4 100 524288 0 DS 100: 0 Wed Dec 11 10:08:36 2013 [HOST][D]: Discovered Hosts (enabled): 0 Wed Dec 11 10:08:36 2013 [SCHED][D]: VM 4: Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS. Wed Dec 11 10:08:36 2013 [SCHED][I]: Scheduling Results: Virtual Machine: 4 PRI ID - HOSTS 0 0 PRI ID - DATASTORES 1 104 Wed Dec 11 10:08:36 2013 [VM][I]: Dispatching VM 4 to host 0 and datastore 104 Wed Dec 11 10:10:35 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 5 100 524288 0 DS 100: 0 Wed Dec 11 10:10:35 2013 [HOST][D]: Discovered Hosts (enabled): 0 Wed Dec 11 10:10:35 2013 [SCHED][D]: VM 5: Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS. Wed Dec 11 10:10:35 2013 [SCHED][I]: Scheduling Results: Virtual Machine: 5 PRI ID - HOSTS 0 0 PRI ID - DATASTORES 1 104 Wed Dec 11 10:10:35 2013
Re: [one-users] No system datastore with enough capacity form the VM
I have done other tests. If I use a premade image from marketplace all works. The problem is that I have tried to install an so from scratch (windows) and I have created a volatile disk. Probably it is my fault but I still do not understand how to put all my vm in ceph filesystem. 2013/12/12 Carlos Martín Sánchez cmar...@opennebula.org So the scheduler thinks that the VM needs 100 GB in the system DS instead of the ceph image DS. Could you please paste the output of onedatastore show 100 104 ? Regards -- Carlos Martín, MSc Project Engineer OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | cmar...@opennebula.org | @OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org On Wed, Dec 11, 2013 at 8:53 PM, Mario Giammarco mgiamma...@gmail.comwrote: Here are some parts of the log, please note that I tried two things: - clean some requirements of the vm (datastore rank stripping); - adding another system datastore (I have one shared and one ssh); - please also note that system datastore with id 0 was never used because it was not part of the cluster or public; - I have also deleted and recreated VM; Wed Dec 11 10:02:06 2013 [SCHED][I]: Init Scheduler Log system Wed Dec 11 10:02:06 2013 [SCHED][I]: Starting Scheduler Daemon Scheduler Configuration File DEFAULT_DS_SCHED=POLICY=1 DEFAULT_SCHED=POLICY=1 HYPERVISOR_MEM=0.1 LIVE_RESCHEDS=0 LOG=DEBUG_LEVEL=3,SYSTEM=file MAX_DISPATCH=30 MAX_HOST=1 MAX_VM=5000 ONED_PORT=2633 SCHED_INTERVAL=30 Wed Dec 11 10:02:06 2013 [SCHED][I]: Starting scheduler loop... Wed Dec 11 10:02:06 2013 [SCHED][I]: Scheduler loop started. Wed Dec 11 10:08:36 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 4 100 524288 0 DS 100: 0 Wed Dec 11 10:08:36 2013 [HOST][D]: Discovered Hosts (enabled): 0 Wed Dec 11 10:08:36 2013 [SCHED][D]: VM 4: Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS. Wed Dec 11 10:08:36 2013 [SCHED][I]: Scheduling Results: Virtual Machine: 4 PRI ID - HOSTS 0 0 PRI ID - DATASTORES 1 104 Wed Dec 11 10:08:36 2013 [VM][I]: Dispatching VM 4 to host 0 and datastore 104 Wed Dec 11 10:10:35 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 5 100 524288 0 DS 100: 0 Wed Dec 11 10:10:35 2013 [HOST][D]: Discovered Hosts (enabled): 0 Wed Dec 11 10:10:35 2013 [SCHED][D]: VM 5: Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS. Wed Dec 11 10:10:35 2013 [SCHED][I]: Scheduling Results: Virtual Machine: 5 PRI ID - HOSTS 0 0 PRI ID - DATASTORES 1 104 Wed Dec 11 10:10:35 2013 [VM][I]: Dispatching VM 5 to host 0 and datastore 104 Wed Dec 11 11:24:20 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 6 100 1048576 102400 DS 100: 0 Wed Dec 11 11:24:20 2013 [HOST][D]: Discovered Hosts (enabled): 0 Wed Dec 11 11:24:20 2013 [SCHED][D]: VM 6: Datastore 0 filtered out. It does not fulfill SCHED_DS_REQUIREMENTS. Wed Dec 11 11:24:20 2013 [SCHED][D]: VM 6: Datastore 104 filtered out. Not enough capacity. Wed Dec 11 11:24:20 2013 [SCHED][I]: Scheduling Results: Wed Dec 11 11:24:50 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 6 100 1048576 102400 DS 100: 0 Wed Dec 11 11:24:50 2013 [HOST][D]: Discovered Hosts (enabled): ... ... ed Dec 11 20:51:20 2013 [SCHED][I]: Scheduling Results: Virtual Machine: 7 PRI ID - HOSTS 0 0 PRI ID - DATASTORES 0 105 Wed Dec 11 20:51:20 2013 [SCHED][D]: VM 7: Local Datastore 105 in Host 0 filtered out. Not enough capacity. Wed Dec 11 20:51:20 2013 [SCHED][I]: VM 7: No suitable System DS found for Host: 0. Filtering out host. Wed Dec 11 20:51:50 2013 [VM][D]: Pending/rescheduling VM and capacity requirements: VM CPU Memory System DS Image DS 7 100 1048576 102400 DS 100: 0 Wed Dec 11 20:51:50 2013 [HOST][D]: Discovered
Re: [one-users] Ceph and thin provision
In several virtualization systems you can have a virtual disk drive: -thick, so a thick disk of 100gb uses 100gb of space; -thin, so a thin disk of 100gb uses 0gb when empty and starts using space when the virtual machine fills it. So I can have a real hdd of 250gb with inside ten virtual thin disks of 1000gb each, if they are almost empty. I have checked again and ceph rbd are thin. BTW: I thank you for you explanation of persistent/not persistent, I was not able to find it in docs. Can you explain me also what a volatile disk is? A not persistent image is writeable? When you reboot a vm with a not persistent image you lose all datda written to it? Thanks again, Mario 2013/12/12 Kenneth kenn...@apolloglobal.net Hi, Can you elaborate more on what you want to achieve? If you have a 100GB image and it is set to persistent, you can instantiate that image immediately and deploy/live migrate it to any nebula node. Only one running instance of VM of this image is allowed. If it is a 100GB non persistent image, you'll have to wait for ceph to create a copy of it once you deploy it. But you can use this image multiple times simutaneously. --- Thanks, Kenneth Apollo Global Corp. On 12/11/2013 07:28 PM, Mario Giammarco wrote: Hello, I am using ceph with opennebula. I have created a 100gb disk image and I do not understand if it is thin or thick. I hope I can have thin provision. Thanks, Mario ___ Users mailing listUsers@lists.opennebula.orghttp://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] Ceph and thin provision
Hello, I am using ceph with opennebula. I have created a 100gb disk image and I do not understand if it is thin or thick. I hope I can have thin provision. Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] No system datastore with enough capacity form the VM
Hello, I have created a 100gb image on ceph. My system datastore have few gb free. But image is on ceph so it should not check system datastore free space! I will never have a lot of space on system datastore! Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] No system datastore with enough capacity form the VM
. Regards. -- Carlos Martín, MSc Project Engineer OpenNebula - Flexible Enterprise Cloud Made Simple www.OpenNebula.org | cmar...@opennebula.org | @OpenNebulahttp://twitter.com/opennebulacmar...@opennebula.org On Wed, Dec 11, 2013 at 12:31 PM, Mario Giammarco mgiamma...@gmail.comwrote: Hello, I have created a 100gb image on ceph. My system datastore have few gb free. But image is on ceph so it should not check system datastore free space! I will never have a lot of space on system datastore! Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] How to use ceph filesystem
I have checked the frontend node as oneadmin user. I have tried ceph -w ceph status ceph rbd ls and these commands work. I have also added user oneadmin to disk group. All these checks are ok but I am not able to add nothing to ceph one rbd. With previous installation of 4.2 and same ceph it was all ok. 2013/12/1 kenneth samonte kenn...@apolloglobal.net The first requirement is that the front end node is able to communicate with the ceph cluster. Veriy it by loggin in as the oneadmin user and issue the command ceph -w. The ceph cluster shoul respond HEALTH_OK. Then define it as a datastore in openebula as an image datastore. No further confiuration needed and when you uplaod images to he front end, you should choose the ceph image to save the omages in rbd format. Mario Giammarco mgiamma...@gmail.com wrote: Hello, I am a newbie but I would like to try opennebula with ceph filesystem. I start with default opennebula installation with three datastores: system, default and files. Now, even if they are configured as shared they are not an nfs mount, simply directories on the disk. Now I have installed ceph, I have created a ceph rbd and datastore but then? Should I delete existing repositories? How can I replace them with ceph? Do I need to replace them? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] How to use ceph filesystem
Sorry I this is my fault. I have created an rbd called one and not a pool. Now I created a pool called one and it works. Please note that I have found it only looking in logs for an error of qemu-img command. The gui gave me the correct size of the filesystem even without pool one created so I supposed that all was ok. 2013/12/10 Mario Giammarco mgiamma...@gmail.com I have checked the frontend node as oneadmin user. I have tried ceph -w ceph status ceph rbd ls and these commands work. I have also added user oneadmin to disk group. All these checks are ok but I am not able to add nothing to ceph one rbd. With previous installation of 4.2 and same ceph it was all ok. 2013/12/1 kenneth samonte kenn...@apolloglobal.net The first requirement is that the front end node is able to communicate with the ceph cluster. Veriy it by loggin in as the oneadmin user and issue the command ceph -w. The ceph cluster shoul respond HEALTH_OK. Then define it as a datastore in openebula as an image datastore. No further confiuration needed and when you uplaod images to he front end, you should choose the ceph image to save the omages in rbd format. Mario Giammarco mgiamma...@gmail.com wrote: Hello, I am a newbie but I would like to try opennebula with ceph filesystem. I start with default opennebula installation with three datastores: system, default and files. Now, even if they are configured as shared they are not an nfs mount, simply directories on the disk. Now I have installed ceph, I have created a ceph rbd and datastore but then? Should I delete existing repositories? How can I replace them with ceph? Do I need to replace them? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] Cannot install images in ceph
Hello, I have just installed again from scratch ceph filesystem and open nebula 4.4. I have added a ceph rbd (one) as images datastore. It seems all ok because it shows correct free space. Now I try to add an image from marketplace or from iso and at the end I get always the same error: Error copying image in the datastore: Error registering one/one-11 in cloud1.mio What am I doing wrong? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] Ubuntu/debian repositories for 4.4
Hello, I am trying to install 4.4 but as far I can see official ubuntu repositories are stuck at 4.2. And also there is no ubuntu 13.10 version but I can use 13.04 or 12.04 without problems. Where can I find updated repo? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] Ubuntu/debian repositories for 4.4
I am shocked I continue to see 4.2. Tomorrow I try to add the repository to another server. Thanks, Mario 2013/12/5 Gareth Bult gar...@linux.co.uk Hi Mario, I've just upgraded from 4.3 (raw packages) to 4.4 (from the repo's) ... seemed to work Ok .. (I'm on Ubuntu Server 13.10, as far as I can see the 13.04 version works just fine with 13.10 ..) -- *Gareth Bult* “The odds of hitting your target go up dramatically when you aim at it.” -- *From: *Mario Giammarco mgiamma...@gmail.com *To: *users@lists.opennebula.org *Sent: *Thursday, 5 December, 2013 5:26:23 PM *Subject: *[one-users] Ubuntu/debian repositories for 4.4 Hello, I am trying to install 4.4 but as far I can see official ubuntu repositories are stuck at 4.2. And also there is no ubuntu 13.10 version but I can use 13.04 or 12.04 without problems. Where can I find updated repo? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] Ubuntu/debian repositories for 4.4
Incredible! At http://opennebula.org/ there is an ubuntu repo with old packages at http://DOWNLOADS.opennebula.org/ there is right repository with updated packages 2013/12/5 Gareth Bult gar...@linux.co.uk http://downloads.opennebula.org/repo/Ubuntu/13.04/dists/stable/opennebula/binary-amd64/Packages echo deb http://downloads.opennebula.org/repo/Ubuntu/13.04 stable opennebula /etc/apt/sources.list.d/opennebula.list apt-get update -- *Gareth Bult* “The odds of hitting your target go up dramatically when you aim at it.” -- *From: *Mario Giammarco mgiamma...@gmail.com *To: *Gareth Bult gar...@linux.co.uk *Cc: *users@lists.opennebula.org *Sent: *Thursday, 5 December, 2013 7:10:43 PM *Subject: *Re: [one-users] Ubuntu/debian repositories for 4.4 I have checked again, here I can see only 4.2 packages: http://opennebula.org/repo/Ubuntu/13.04/dists/stable/opennebula/binary-amd64/Packages 2013/12/5 Mario Giammarco mgiamma...@gmail.com I am shocked I continue to see 4.2. Tomorrow I try to add the repository to another server. Thanks, Mario 2013/12/5 Gareth Bult gar...@linux.co.uk Hi Mario, I've just upgraded from 4.3 (raw packages) to 4.4 (from the repo's) ... seemed to work Ok .. (I'm on Ubuntu Server 13.10, as far as I can see the 13.04 version works just fine with 13.10 ..) -- *Gareth Bult* “The odds of hitting your target go up dramatically when you aim at it.” -- *From: *Mario Giammarco mgiamma...@gmail.com *To: *users@lists.opennebula.org *Sent: *Thursday, 5 December, 2013 5:26:23 PM *Subject: *[one-users] Ubuntu/debian repositories for 4.4 Hello, I am trying to install 4.4 but as far I can see official ubuntu repositories are stuck at 4.2. And also there is no ubuntu 13.10 version but I can use 13.04 or 12.04 without problems. Where can I find updated repo? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] How to use ceph filesystem
I have read all posts of this interesting thread. You suggest to use ceph as a shared filesystem and it is a good idea I agree. But I supposed that, because kvm supports ceph rbd and because opennebula supports ceph, there is a direct way to use it. I mean not using ceph DFS layer and going directly to rbd layer (also for system datastore) I do not understand what advantages has opennebula actual ceph support, can you explain to me? Thanks, Mario 2013/12/3 Jaime Melis jme...@c12g.com Hi Mario, Cephfs CAN be used a shared filesystem datastore. I don't completely agree with Kenneth's recommendation of using 'ssh' as the TM for the system datastore. I think you can go for 'shared' as long as you have the /var/lib/one/datastores/... shared via Cephfs. OpenNebula doesn't care about what DFS solution you're using, it will simply assume files are already there. Another thing worth mentioning, from 4.4 onwards the HOST attribute of the datastore should be renamed as BRIDGE_LIST. cheers, Jaime On Tue, Dec 3, 2013 at 11:28 AM, Kenneth kenn...@apolloglobal.net wrote: Actually, I'm using ceph as the system datastore. I used the cephfs (CEPH FUSE) and mounted it on all nodes on /var/lib/one/datastores/0/ Regarding ssh for trasfer driver, I haven't really used it since I'm all on ceph, both system and image datastore. I may be wrong but that is how I understand it from the docs. --- Thanks, Kenneth Apollo Global Corp. On 12/03/2013 06:11 PM, Mario Giammarco wrote: My problem was that because ceph is a distributed filesystem (and so it can be used as an alternative to nfs) I supposed I can use as a shared system datastore. Reading your reply I can see it is not true. Probably official documentation should clarify this. Infact I hoped to use ceph as system datastore because ceph is fault tolerant and nfs is not. Thanks for help, Mario 2013/12/3 Kenneth kenn...@apolloglobal.net Ceph won't be the default image datastore, but you can always choose it whenever you create an image. You said you don't have an NFS disk and your just use plain disk on your system datastore so you *should* use ssh in order to have live migrations. Mine uses shared as datastore since I mounted a shared folder on each nebula node. --- Thanks, Kenneth Apollo Global Corp. On 12/03/2013 03:01 PM, Mario Giammarco wrote: First, thanks you for your very detailed reply! 2013/12/3 Kenneth kenn...@apolloglobal.net You don't need to replace existing datastores, the important is you edit the system datastore as ssh because you still need to transfer files in each node when you deploy a VM. So I lose live migration, right? If I understand correctly ceph cannot be default datastore also. Next, you should make sure that all your node are able to communicate with the ceph cluster. Issue the command ceph -s on all nodes including the front end to be sure that they are connected to ceph. ... will check... oneadmin@cloud-node1:~$ onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system - - - 0 sys - shared 1 default 7.3G 71% - 1 img fs shared 2 files 7.3G 71% - 0 fil fs ssh * 100 cephds 5.5T 59% - 3 img ceph ceph* Once you add the you have verified that the ceph datastore is active you can upload images on the sunstone GUI. Be aware that conversion of images to RBD format of ceph may take quite some time. I see in your configuration that system datastore is shared! Thanks again, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Jaime Melis C12G Labs - Flexible Enterprise Cloud Made Simple http://www.c12g.com | jme...@c12g.com -- Confidentiality Warning: The information contained in this e-mail and any accompanying documents, unless otherwise expressly indicated, is confidential and privileged, and is intended solely for the person and/or entity to whom it is addressed (i.e. those identified in the To and cc box). They are the property of C12G Labs S.L.. Unauthorized distribution, review, use, disclosure, or copying of this communication, or any part thereof, is strictly prohibited and may be unlawful. If you have received this e-mail in error, please notify us immediately by e-mail at ab...@c12g.com and delete the e-mail and attachments and any copy from your system. C12G's thanks you for your cooperation. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] Reset installation and start with 4.4 from scratch
Hello, I have installed an opennebula 4.2 for tests on Ubuntu. I would like to upgrade to 4.4 resetting all configuration because I start from scratch. What should I do? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] How to use ceph filesystem
My problem was that because ceph is a distributed filesystem (and so it can be used as an alternative to nfs) I supposed I can use as a shared system datastore. Reading your reply I can see it is not true. Probably official documentation should clarify this. Infact I hoped to use ceph as system datastore because ceph is fault tolerant and nfs is not. Thanks for help, Mario 2013/12/3 Kenneth kenn...@apolloglobal.net Ceph won't be the default image datastore, but you can always choose it whenever you create an image. You said you don't have an NFS disk and your just use plain disk on your system datastore so you *should* use ssh in order to have live migrations. Mine uses shared as datastore since I mounted a shared folder on each nebula node. --- Thanks, Kenneth Apollo Global Corp. On 12/03/2013 03:01 PM, Mario Giammarco wrote: First, thanks you for your very detailed reply! 2013/12/3 Kenneth kenn...@apolloglobal.net You don't need to replace existing datastores, the important is you edit the system datastore as ssh because you still need to transfer files in each node when you deploy a VM. So I lose live migration, right? If I understand correctly ceph cannot be default datastore also. Next, you should make sure that all your node are able to communicate with the ceph cluster. Issue the command ceph -s on all nodes including the front end to be sure that they are connected to ceph. ... will check... oneadmin@cloud-node1:~$ onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system - - - 0 sys - shared 1 default 7.3G 71% - 1 img fs shared 2 files 7.3G 71% - 0 fil fs ssh * 100 cephds 5.5T 59% - 3 img ceph ceph* Once you add the you have verified that the ceph datastore is active you can upload images on the sunstone GUI. Be aware that conversion of images to RBD format of ceph may take quite some time. I see in your configuration that system datastore is shared! Thanks again, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] How to use ceph filesystem
First, thanks you for your very detailed reply! 2013/12/3 Kenneth kenn...@apolloglobal.net You don't need to replace existing datastores, the important is you edit the system datastore as ssh because you still need to transfer files in each node when you deploy a VM. So I lose live migration, right? If I understand correctly ceph cannot be default datastore also. Next, you should make sure that all your node are able to communicate with the ceph cluster. Issue the command ceph -s on all nodes including the front end to be sure that they are connected to ceph. ... will check... oneadmin@cloud-node1:~$ onedatastore list ID NAMESIZE AVAIL CLUSTER IMAGES TYPE DS TM 0 system - - - 0 sys - shared 1 default 7.3G 71% - 1 img fs shared 2 files 7.3G 71% - 0 fil fs ssh * 100 cephds 5.5T 59% - 3 img ceph ceph* Once you add the you have verified that the ceph datastore is active you can upload images on the sunstone GUI. Be aware that conversion of images to RBD format of ceph may take quite some time. I see in your configuration that system datastore is shared! Thanks again, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
[one-users] How to use ceph filesystem
Hello, I am a newbie but I would like to try opennebula with ceph filesystem. I start with default opennebula installation with three datastores: system, default and files. Now, even if they are configured as shared they are not an nfs mount, simply directories on the disk. Now I have installed ceph, I have created a ceph rbd and datastore but then? Should I delete existing repositories? How can I replace them with ceph? Do I need to replace them? Thanks, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
Re: [one-users] could not open disk image : Permission denied
I have just started a similar thread because I have the same error, but I have already set correctly: user = oneadmin group = oneadmin dynamic_ownership = 0 Have you solved the problem? What else can I try? Thanks, Mario 2013/11/19 Javier Fontan jfon...@opennebula.org The images of the VM have mixed permissions (oneadmin and root). * Make sure that oned is running as oneadmin, not root. * qemu.conf is correct. Leave it like this and reboot kpkvm1. It may be that even that the configuration is OK libvirt/kvm modules are still trying to run as root and can not use files owned by oneadmin user. Cheers On Tue, Nov 19, 2013 at 9:59 AM, Geeta Gulabani geeta.gulab...@kpoint.com wrote: Hi, My Environment : Frontend and host : centos 6.4 Opennebula version : 4.2 Tue Nov 19 13:58:16 2013 [VMM][I]: Command execution fail: cat EOT | /var/tmp/one/vmm/kvm/deploy '/var/lib/one//datastores/0/58/deployment.0' 'kpkvm1.gslab.com' 58 kpkvm1.gslab.com Tue Nov 19 13:58:16 2013 [VMM][I]: error: Failed to create domain from /var/lib/one//datastores/0/58/deployment.0 Tue Nov 19 13:58:16 2013 [VMM][I]: error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=/var/lib/one//datastores/0/58/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image /var/lib/one//datastores/0/58/disk.0: Permission denied Tue Nov 19 13:58:16 2013 [VMM][I]: Tue Nov 19 13:58:16 2013 [VMM][E]: Could not create domain from /var/lib/one//datastores/0/58/deployment.0 Tue Nov 19 13:58:16 2013 [VMM][I]: ExitCode: 255 Tue Nov 19 13:58:16 2013 [VMM][I]: Failed to execute virtualization driver operation: deploy. Tue Nov 19 13:58:16 2013 [VMM][E]: Error deploying virtual machine: Could not create domain from /var/lib/one//datastores/0/58/deployment.0 Tue Nov 19 13:58:16 2013 [DiM][I]: New VM state is FAILED Here are some other details : [root@kpkvm1 56]# grep -vE '^($|#)' /etc/libvirt/qemu.conf user = oneadmin group = oneadmin dynamic_ownership = 0 [root@kpkvm1 58]# grep -vE '^($|#)' /etc/libvirt/libvirtd.conf [root@kpkvm1 58]# [root@kpkvm1 58]# cat /etc/polkit-1/localauthority/50-local.d/50-org.libvirt.unix.manage-opennebula.pkla [Allow oneadmin user to manage virtual machines] Identity=unix-user:oneadmin Action=org.libvirt.unix.manage #Action=org.libvirt.unix.monitor ResultAny=yes ResultInactive=yes ResultActive=yes [root@kpkvm1 58]# id oneadmin uid=9869(oneadmin) gid=9869(oneadmin) groups=9869(oneadmin) [root@kpkvm1 58]# cat /etc/libvirt/qemu.conf user = oneadmin group = oneadmin dynamic_ownership = 0 I tried changing dynamic_ownership to 1 , started libvirtd and oned and again tried creating the vm sudo -u oneadmin virsh -c qemu:///system create deployment.0 it gives the same error error: Failed to create domain from deployment.0 error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=/var/lib/one//datastores/0/58/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image /var/lib/one//datastores/0/58/disk.0: Permission denied Here are the libvirtd logs : 2013-11-19 08:52:21.246+: 8915: info : libvirt version: 0.10.2, package: 18.el6_4.14 (CentOS BuildSystem http://bugs.centos.org, 2013-09-19-19:15:27, c6b8.bsys.dev.centos.org) 2013-11-19 08:52:21.246+: 8915: error : qemuMonitorOpenUnix:293 : failed to connect to monitor socket: No such process 2013-11-19 08:52:21.246+: 8915: error : qemuProcessWaitForMonitor:1768 : internal error process exited while connecting to monitor: qemu-kvm: -drive file=/var/lib/one//datastores/0/58/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image /var/lib/one//datastores/0/58/disk.0: Permission denied [root@kpkvm1 58]# ls -lrt total 6171016 -rw-r--r-- 1 oneadmin oneadmin 6318739456 Nov 19 13:58 disk.0 -rw-r--r-- 1 root root 372736 Nov 19 13:58 disk.1 lrwxrwxrwx 1 root root 35 Nov 19 13:58 disk.1.iso - /var/lib/one/datastores/0/58/disk.1 -rw-r--r-- 1 root root912 Nov 19 13:58 deployment.0 [root@kpkvm1 58]# sudo -u oneadmin virsh -c qemu:///system create deployment.0 error: Failed to create domain from deployment.0 error: internal error process exited while connecting to monitor: qemu-kvm: -drive file=/var/lib/one//datastores/0/58/disk.0,if=none,id=drive-ide0-0-0,format=raw,cache=none: could not open disk image /var/lib/one//datastores/0/58/disk.0: Permission denied Can anybody help? Regards, Geeta. ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org -- Javier Fontán Muiños Developer OpenNebula - The Open Source Toolkit for Data Center
Re: [one-users] [newbie] disk not found and need tutorial
2013/11/20 Daniel Molina dmol...@opennebula.org Could you send us the template you are using (onetemplate show ID -x) Sure, here it is (please note that dev_prefix vd was initially empty): VMTEMPLATE ID3/ID UID0/UID GID0/GID UNAMEoneadmin/UNAME GNAMEoneadmin/GNAME NAMEubuntu1/NAME PERMISSIONS OWNER_U1/OWNER_U OWNER_M1/OWNER_M OWNER_A0/OWNER_A GROUP_U0/GROUP_U GROUP_M0/GROUP_M GROUP_A0/GROUP_A OTHER_U0/OTHER_U OTHER_M0/OTHER_M OTHER_A0/OTHER_A /PERMISSIONS REGTIME1384702881/REGTIME TEMPLATE CONTEXT NETWORK![CDATA[YES]]/NETWORK SSH_PUBLIC_KEY![CDATA[$USER[SSH_PUBLIC_KEY]]]/SSH_PUBLIC_KEY /CONTEXT CPU![CDATA[1]]/CPU DISK DEV_PREFIX![CDATA[vd]]/DEV_PREFIX IMAGE_ID![CDATA[6]]/IMAGE_ID /DISK GRAPHICS LISTEN![CDATA[0.0.0.0]]/LISTEN TYPE![CDATA[VNC]]/TYPE /GRAPHICS MEMORY![CDATA[512]]/MEMORY OS ARCH![CDATA[x86_64]]/ARCH BOOT![CDATA[hd]]/BOOT GUESTOS![CDATA[ubuntu64Guest]]/GUESTOS /OS RANK![CDATA[FREECPU]]/RANK /TEMPLATE /VMTEMPLATE You can use one of the Tutorial slides and images from past events that you can find in this webpage (i.e: Cloud Interoperability Week, Madrid, Spain. 16-20 september, 2013) http://opennebula.org/community:outreach#past_cloud_events_with_participation_of_opennebula Thanks, infact, correct me if I am wrong, but in that tutorial he creates an empty disk for vm just for demo purpose. I suppose it does not use a prebuilt image, nor provide a cdrom to install an os from. Correct? Thanks you very much for your interest, Mario ___ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org
