What linux distribution are you using? You need to be sure to have a libvirt that supports librbd. the stock ones from redhat/centos 6 do not, for instance. Can you do rbd commands successfully from the node? Can you rbd export and do a remote mount outside of opennebula?
Also ceph is fussy about the secrets. I had to define a special user in ceph just for the libvirt stuff. Here for comparison is my ceph datastore template. [root@one4dev ~]# onedatastore show 103 DATASTORE 103 INFORMATION ID : 103 NAME : ceph_datastore USER : oneadmin GROUP : oneadmin CLUSTER : cephtest TYPE : IMAGE DS_MAD : ceph TM_MAD : ceph BASE PATH : /var/lib/one//datastores/103 DISK_TYPE : RBD DATASTORE CAPACITY TOTAL: : 0M FREE: : 0M USED: : 0M LIMIT: : - PERMISSIONS OWNER : um- GROUP : u-- OTHER : --- DATASTORE TEMPLATE BASE_PATH="/var/lib/one//datastores/" BRIDGE_LIST="one4dev" CEPH_HOST="stkendca01a:6789 stkendca04a:6789 stkendca02a:6789" CEPH_SECRET="3bd5a6a5-6b2a-44b2-a075-ec9da47ae3f4" CEPH_USER="libvirt2" CLONE_TARGET="SELF" DATASTORE_CAPACITY_CHECK="yes" DISK_TYPE="RBD" DS_MAD="ceph" LN_TARGET="NONE" POOL_NAME="one" STAGING_DIR="/var/lib/one/ceph-tmp" TM_MAD="ceph" TYPE="IMAGE_DS" On Wed, 31 Dec 2014, ramanadh ravinuthala wrote:
Hi Steven, The DISK_TYPE is RBD DS_MAD is ceph TM_MAD is ceph. pasting the result for reference. onedatastore show 100 DATASTORE 100 INFORMATION ID : 100 NAME : cephds USER : oneadmin GROUP : oneadmin CLUSTER : production TYPE : IMAGE DS_MAD : ceph TM_MAD : ceph BASE PATH : /var/lib/one//datastores/100 DISK_TYPE : RBD DATASTORE CAPACITY TOTAL: : 2.3T FREE: : 1.9T USED: : 399G LIMIT: : - PERMISSIONS
?? ?
OWNER : um- GROUP : u-- OTHER : --- DATASTORE TEMPLATE BASE_PATH="/var/lib/one//datastores/" BRIDGE_LIST="192.168.0.251" CLONE_TARGET="SELF" DISK_TYPE="RBD" DS_MAD="ceph" LN_TARGET="NONE" POOL_NAME="one" TM_MAD="ceph" Thanks On Tuesday, 30 December 2014 8:11 PM, Steven Timm <t...@fnal.gov> wrote: What's the output of onedatastore show, particularly the DISK_TYPE and DS_MAD and TM_MAD settings? Steve Timm On Tue, 30 Dec 2014, ramanadh ravinuthala wrote: > Hi all, > > I am trying to integrate ceph as the data store for open nebula and i am > successfull able to do so.But when i do a virtualize of an image which is > the ceph data store i couldn't see any rbd snapshot's or clones as i > strongly belive it is still using the default transfer scripts, can one > please help me as any setting to be enabled for the rbd to work properly. > > Thanks > > > ------------------------------------------------------------------ Steven C. Timm, Ph.D (630) 840-8525 t...@fnal.gov http://home.fnal.gov/~timm/ Office: Wilson Hall room 804 Fermilab Scientific Computing Division, Currently transitioning from: Scientific Computing Services Quadrant Grid and Cloud Services Dept., Associate Dept. Head for Cloud Computing To: Scientific Computing Facilities Quadrant., Experimental Computing Facilities Dept., Project Lead for Virtual Facility Project.
------------------------------------------------------------------ Steven C. Timm, Ph.D (630) 840-8525 t...@fnal.gov http://home.fnal.gov/~timm/ Office: Wilson Hall room 804 Fermilab Scientific Computing Division, Scientific Computing Facilities Quadrant., Experimental Computing Facilities Dept., Project Lead for Virtual Facility Project.
_______________________________________________ Users mailing list Users@lists.opennebula.org http://lists.opennebula.org/listinfo.cgi/users-opennebula.org