Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-07-06 Thread Mike Jacobacci 
So just to update, I decided to ditch XenServer and go with Openstack… Thanks 
for everyone’s help with this!

Cheers,
Mike
> On Jul 1, 2016, at 1:29 PM, Mike Jacobacci <mi...@flowjo.com> wrote:
> 
> Yes, I would like to know too… I decided nott to update the kernel as it 
> could possibly affect xenserver’s stability and/or performance.
> 
> Cheers,
> Mike
>> On Jun 30, 2016, at 11:54 PM, Josef Johansson <jose...@gmail.com 
>> <mailto:jose...@gmail.com>> wrote:
>> 
>> Also, is it possible to recompile the rbd kernel module in XenServer? I am 
>> under the impression that it's open source as well.
>> 
>> Regards,
>> Josef
>> 
>> 
>> On Fri, 1 Jul 2016, 04:52 Mike Jacobacci, <mi...@flowjo.com 
>> <mailto:mi...@flowjo.com>> wrote:
>> Thanks Somnath and Christian,
>> 
>> Yes, it looks like the latest version of XenServer still runs on an old 
>> kernel (3.10).  I know the method Christian linked, but it doesn’t work if 
>> XenServer is installed from iso.  It is really annoying there has been no 
>> movement on this for 3 years… I really like XenServer and am excited to use 
>> Ceph, I want this to work.  
>> 
>> Since there are no VM’s on it yet, I think I will upgrade the kernel and see 
>> what happens.
>> 
>> Cheers,
>> Mike
>> 
>> 
>>> On Jun 30, 2016, at 7:40 PM, Somnath Roy <somnath@sandisk.com 
>>> <mailto:somnath@sandisk.com>> wrote:
>>> 
>>> It seems your client kernel is pretty old ?
>>> Either upgrade your kernel to 3.15 or later or you need to disable 
>>> CRUSH_TUNABLES3.
>>> ceph osd crush tunables bobtail or ceph osd crush tunables legacy should 
>>> help. This will start rebalancing and also you will lose improvement added 
>>> in Firefly. So, better to upgrade client kernel IMO.
>>>  
>>> Thanks & Regards
>>> Somnath
>>>  
>>> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com 
>>> <mailto:ceph-users-boun...@lists.ceph.com>] On Behalf Of Mike Jacobacci
>>> Sent: Thursday, June 30, 2016 7:27 PM
>>> To: Jake Young
>>> Cc: ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
>>> Subject: Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR
>>>  
>>> Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common 
>>> installed.  Here is what happens when I try to map the drive:
>>>  
>>> rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k 
>>> /etc/ceph/ceph.client.admin.keyring 
>>> rbd: sysfs write failed
>>> In some cases useful info is found in syslog - try "dmesg | tail" or so.
>>> rbd: map failed: (5) Input/output error
>>>  
>>> dmesg | tail:
>>>  
>>> [35034.469236] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> socket error on read
>>> [35044.469183] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>>> 2004a042a42, missing 200
>>> [35044.469199] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> socket error on read
>>> [35054.469076] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>>> 2004a042a42, missing 200
>>> [35054.469083] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> socket error on read
>>> [35064.469287] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>>> 2004a042a42, missing 200
>>> [35064.469302] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> socket error on read
>>> [35074.469162] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>>> 2004a042a42, missing 200
>>> [35074.469178] libceph: mon0 192.168.10.187:6789 
>>> <http://192.168.10.187:6789/> socket error on read
>>>  
>>>  
>>>  
>>>  
>>> On Jun 30, 2016, at 6:15 PM, Jake Young <jak3...@gmail.com 
>>> <mailto:jak3...@gmail.com>> wrote:
>>>  
>>> See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html 
>>> <https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html>
>>> 
>>> 
&

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-07-01 Thread Mike Jacobacci 
Yes, I would like to know too… I decided nott to update the kernel as it could 
possibly affect xenserver’s stability and/or performance.

Cheers,
Mike
> On Jun 30, 2016, at 11:54 PM, Josef Johansson <jose...@gmail.com> wrote:
> 
> Also, is it possible to recompile the rbd kernel module in XenServer? I am 
> under the impression that it's open source as well.
> 
> Regards,
> Josef
> 
> 
> On Fri, 1 Jul 2016, 04:52 Mike Jacobacci, <mi...@flowjo.com 
> <mailto:mi...@flowjo.com>> wrote:
> Thanks Somnath and Christian,
> 
> Yes, it looks like the latest version of XenServer still runs on an old 
> kernel (3.10).  I know the method Christian linked, but it doesn’t work if 
> XenServer is installed from iso.  It is really annoying there has been no 
> movement on this for 3 years… I really like XenServer and am excited to use 
> Ceph, I want this to work.  
> 
> Since there are no VM’s on it yet, I think I will upgrade the kernel and see 
> what happens.
> 
> Cheers,
> Mike
> 
> 
>> On Jun 30, 2016, at 7:40 PM, Somnath Roy <somnath@sandisk.com 
>> <mailto:somnath@sandisk.com>> wrote:
>> 
>> It seems your client kernel is pretty old ?
>> Either upgrade your kernel to 3.15 or later or you need to disable 
>> CRUSH_TUNABLES3.
>> ceph osd crush tunables bobtail or ceph osd crush tunables legacy should 
>> help. This will start rebalancing and also you will lose improvement added 
>> in Firefly. So, better to upgrade client kernel IMO.
>>  
>> Thanks & Regards
>> Somnath
>>  
>> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com 
>> <mailto:ceph-users-boun...@lists.ceph.com>] On Behalf Of Mike Jacobacci
>> Sent: Thursday, June 30, 2016 7:27 PM
>> To: Jake Young
>> Cc: ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com>
>> Subject: Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR
>>  
>> Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common 
>> installed.  Here is what happens when I try to map the drive:
>>  
>> rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k 
>> /etc/ceph/ceph.client.admin.keyring 
>> rbd: sysfs write failed
>> In some cases useful info is found in syslog - try "dmesg | tail" or so.
>> rbd: map failed: (5) Input/output error
>>  
>> dmesg | tail:
>>  
>> [35034.469236] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> socket error on read
>> [35044.469183] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>> 2004a042a42, missing 200
>> [35044.469199] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> socket error on read
>> [35054.469076] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>> 2004a042a42, missing 200
>> [35054.469083] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> socket error on read
>> [35064.469287] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>> 2004a042a42, missing 200
>> [35064.469302] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> socket error on read
>> [35074.469162] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> feature set mismatch, my 4a042a42 < server's 
>> 2004a042a42, missing 200
>> [35074.469178] libceph: mon0 192.168.10.187:6789 
>> <http://192.168.10.187:6789/> socket error on read
>>  
>>  
>>  
>>  
>> On Jun 30, 2016, at 6:15 PM, Jake Young <jak3...@gmail.com 
>> <mailto:jak3...@gmail.com>> wrote:
>>  
>> See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html 
>> <https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html>
>> 
>> 
>> On Thursday, June 30, 2016, Mike Jacobacci <mi...@flowjo.com 
>> <mailto:mi...@flowjo.com>> wrote:
>> So after adding the ceph repo and enabling the cents-7 repo… It fails trying 
>> to install ceph-common:
>>  
>> Loaded plugins: fastestmirror
>> Loading mirror speeds from cached hostfile
>>  * base: mirror.web-ster.com <http://mirror.web-ster.com/>
>> Resolving Dependencies
>> --> Running transaction check
>> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
>> --> Processing Dependency: python-cephfs = 1:10

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-07-01 Thread Josef Johansson 
Also, is it possible to recompile the rbd kernel module in XenServer? I am
under the impression that it's open source as well.

Regards,
Josef

On Fri, 1 Jul 2016, 04:52 Mike Jacobacci, <mi...@flowjo.com> wrote:

> Thanks Somnath and Christian,
>
> Yes, it looks like the latest version of XenServer still runs on an old
> kernel (3.10).  I know the method Christian linked, but it doesn’t work if
> XenServer is installed from iso.  It is really annoying there has been no
> movement on this for 3 years… I really like XenServer and am excited to use
> Ceph, I want this to work.
>
> Since there are no VM’s on it yet, I think I will upgrade the kernel and
> see what happens.
>
> Cheers,
> Mike
>
>
> On Jun 30, 2016, at 7:40 PM, Somnath Roy <somnath@sandisk.com> wrote:
>
> It seems your client kernel is pretty old ?
> Either upgrade your kernel to 3.15 or later or you need to disable
> CRUSH_TUNABLES3.
> ceph osd crush tunables bobtail or ceph osd crush tunables legacy should
> help. This will start rebalancing and also you will lose improvement added
> in Firefly. So, better to upgrade client kernel IMO.
>
> Thanks & Regards
> Somnath
>
> *From:* ceph-users [mailto:ceph-users-boun...@lists.ceph.com
> <ceph-users-boun...@lists.ceph.com>] *On Behalf Of *Mike Jacobacci
> *Sent:* Thursday, June 30, 2016 7:27 PM
> *To:* Jake Young
> *Cc:* ceph-users@lists.ceph.com
> *Subject:* Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR
>
> Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common
> installed.  Here is what happens when I try to map the drive:
>
> rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k
> /etc/ceph/ceph.client.admin.keyring
> rbd: sysfs write failed
> In some cases useful info is found in syslog - try "dmesg | tail" or so.
> rbd: map failed: (5) Input/output error
>
> dmesg | tail:
>
> [35034.469236] libceph: mon0 192.168.10.187:6789 socket error on read
> [35044.469183] libceph: mon0 192.168.10.187:6789 feature set mismatch, my
> 4a042a42 < server's 2004a042a42, missing 200
> [35044.469199] libceph: mon0 192.168.10.187:6789 socket error on read
> [35054.469076] libceph: mon0 192.168.10.187:6789 feature set mismatch, my
> 4a042a42 < server's 2004a042a42, missing 200
> [35054.469083] libceph: mon0 192.168.10.187:6789 socket error on read
> [35064.469287] libceph: mon0 192.168.10.187:6789 feature set mismatch, my
> 4a042a42 < server's 2004a042a42, missing 200
> [35064.469302] libceph: mon0 192.168.10.187:6789 socket error on read
> [35074.469162] libceph: mon0 192.168.10.187:6789 feature set mismatch, my
> 4a042a42 < server's 2004a042a42, missing 200
> [35074.469178] libceph: mon0 192.168.10.187:6789 socket error on read
>
>
>
>
>
> On Jun 30, 2016, at 6:15 PM, Jake Young <jak3...@gmail.com> wrote:
>
> See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html
>
>
> On Thursday, June 30, 2016, Mike Jacobacci <mi...@flowjo.com> wrote:
> So after adding the ceph repo and enabling the cents-7 repo… It fails
> trying to install ceph-common:
>
> Loaded plugins: fastestmirror
> Loading mirror speeds from cached hostfile
>  * base: mirror.web-ster.com
> Resolving Dependencies
> --> Running transaction check
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-requests for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit)
> for package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librgw.so.2()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libradosstriper.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for
> package: 1:ceph-common-10.2.2-0.el

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
Thanks Somnath and Christian,

Yes, it looks like the latest version of XenServer still runs on an old kernel 
(3.10).  I know the method Christian linked, but it doesn’t work if XenServer 
is installed from iso.  It is really annoying there has been no movement on 
this for 3 years… I really like XenServer and am excited to use Ceph, I want 
this to work.  

Since there are no VM’s on it yet, I think I will upgrade the kernel and see 
what happens.

Cheers,
Mike


> On Jun 30, 2016, at 7:40 PM, Somnath Roy <somnath@sandisk.com> wrote:
> 
> It seems your client kernel is pretty old ?
> Either upgrade your kernel to 3.15 or later or you need to disable 
> CRUSH_TUNABLES3.
> ceph osd crush tunables bobtail or ceph osd crush tunables legacy should 
> help. This will start rebalancing and also you will lose improvement added in 
> Firefly. So, better to upgrade client kernel IMO.
>  
> Thanks & Regards
> Somnath
>  
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Mike 
> Jacobacci
> Sent: Thursday, June 30, 2016 7:27 PM
> To: Jake Young
> Cc: ceph-users@lists.ceph.com
> Subject: Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR
>  
> Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common 
> installed.  Here is what happens when I try to map the drive:
>  
> rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k 
> /etc/ceph/ceph.client.admin.keyring 
> rbd: sysfs write failed
> In some cases useful info is found in syslog - try "dmesg | tail" or so.
> rbd: map failed: (5) Input/output error
>  
> dmesg | tail:
>  
> [35034.469236] libceph: mon0 192.168.10.187:6789 socket error on read
> [35044.469183] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
> 4a042a42 < server's 2004a042a42, missing 200
> [35044.469199] libceph: mon0 192.168.10.187:6789 socket error on read
> [35054.469076] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
> 4a042a42 < server's 2004a042a42, missing 200
> [35054.469083] libceph: mon0 192.168.10.187:6789 socket error on read
> [35064.469287] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
> 4a042a42 < server's 2004a042a42, missing 200
> [35064.469302] libceph: mon0 192.168.10.187:6789 socket error on read
> [35074.469162] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
> 4a042a42 < server's 2004a042a42, missing 200
> [35074.469178] libceph: mon0 192.168.10.187:6789 socket error on read
>  
>  
>  
>  
> On Jun 30, 2016, at 6:15 PM, Jake Young <jak3...@gmail.com 
> <mailto:jak3...@gmail.com>> wrote:
>  
> See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html 
> <https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html>
> 
> 
> On Thursday, June 30, 2016, Mike Jacobacci <mi...@flowjo.com 
> <mailto:mi...@flowjo.com>> wrote:
> So after adding the ceph repo and enabling the cents-7 repo… It fails trying 
> to install ceph-common:
>  
> Loaded plugins: fastestmirror
> Loading mirror speeds from cached hostfile
>  * base: mirror.web-ster.com <http://mirror.web-ster.com/>
> Resolving Dependencies
> --> Running transaction check
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-requests for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for 
> package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librgw.so.2()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libradosstriper.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_iostreams-mt.so.1.53.0()(64bit) f

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Somnath Roy 
It seems your client kernel is pretty old ?
Either upgrade your kernel to 3.15 or later or you need to disable 
CRUSH_TUNABLES3.
ceph osd crush tunables bobtail or ceph osd crush tunables legacy should help. 
This will start rebalancing and also you will lose improvement added in 
Firefly. So, better to upgrade client kernel IMO.

Thanks & Regards
Somnath

From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of Mike 
Jacobacci
Sent: Thursday, June 30, 2016 7:27 PM
To: Jake Young
Cc: ceph-users@lists.ceph.com
Subject: Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common 
installed.  Here is what happens when I try to map the drive:

rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k 
/etc/ceph/ceph.client.admin.keyring
rbd: sysfs write failed
In some cases useful info is found in syslog - try "dmesg | tail" or so.
rbd: map failed: (5) Input/output error

dmesg | tail:

[35034.469236] libceph: mon0 192.168.10.187:6789 socket error on read
[35044.469183] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35044.469199] libceph: mon0 192.168.10.187:6789 socket error on read
[35054.469076] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35054.469083] libceph: mon0 192.168.10.187:6789 socket error on read
[35064.469287] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35064.469302] libceph: mon0 192.168.10.187:6789 socket error on read
[35074.469162] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35074.469178] libceph: mon0 192.168.10.187:6789 socket error on read




On Jun 30, 2016, at 6:15 PM, Jake Young 
<jak3...@gmail.com<mailto:jak3...@gmail.com>> wrote:

See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html


On Thursday, June 30, 2016, Mike Jacobacci 
<mi...@flowjo.com<mailto:mi...@flowjo.com>> wrote:
So after adding the ceph repo and enabling the cents-7 repo… It fails trying to 
install ceph-common:

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.web-ster.com<http://mirror.web-ster.com/>
Resolving Dependencies
--> Running transaction check
---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-requests for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for 
package: 1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librgw.so.2()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_iostreams-mt.so.1.53.0()(64bit) for 
package: 1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librbd.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libtcmalloc.so.4()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librados.so.2()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Running transaction check
---> Package boost-iostreams.x86_64 0:1.53.0-25.el7 will be installed
---> Package boost-program-options.x86_64 0:1.53.0-25.el7 will be installed
---> Package boost-regex.x86_64 0:1.53.0-25.el7 will be installed
---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
---> Package gperftools-libs.x86_64 0:2.4-7.el7 will be installed
--> Processing Dependency: libunwind

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Christian Balzer 

Hello,

On Thu, 30 Jun 2016 19:27:05 -0700 Mike Jacobacci wrote:

> Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common
> installed.  Here is what happens when I try to map the drive:
> 
> rbd map rbd/enterprise-vm0 --name client.admin -m mon0
> -k /etc/ceph/ceph.client.admin.keyring rbd: sysfs write failed
> In some cases useful info is found in syslog - try "dmesg | tail" or so.
> rbd: map failed: (5) Input/output error
> 
> dmesg | tail:
> 
> [35034.469236] libceph: mon0 192.168.10.187:6789 socket error on read
> [35044.469183] libceph: mon0 192.168.10.187:6789 feature set mismatch,
> my 4a042a42 < server's 2004a042a42, missing 200 [35044.469199]
> libceph: mon0 192.168.10.187:6789 socket error on read [35054.469076]
> libceph: mon0 192.168.10.187:6789 feature set mismatch, my 4a042a42 <
> server's 2004a042a42, missing 200 [35054.469083] libceph: mon0
> 192.168.10.187:6789 socket error on read [35064.469287] libceph: mon0
> 192.168.10.187:6789 feature set mismatch, my 4a042a42 < server's
> 2004a042a42, missing 200 [35064.469302] libceph: mon0
> 192.168.10.187:6789 socket error on read [35074.469162] libceph: mon0
> 192.168.10.187:6789 feature set mismatch, my 4a042a42 < server's
> 2004a042a42, missing 200 [35074.469178] libceph: mon0
> 192.168.10.187:6789 socket error on read
>

The answer to that problem was of course only one google search (feature
set mismatch) away:

http://cephnotes.ksperis.com/blog/2014/01/21/feature-set-mismatch-error-on-ceph-kernel-client
 
Give that this:
http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html
is 3 years old and all the movement since then has been outside "hacks", I
don't think Xenserver is taking Ceph seriously and/or the other way around.

Which is a pity, as the people 4 meters behind run a large cloud on
Xenserver and of course no Ceph to be found there.

Christian
> 
> 
> 
> > On Jun 30, 2016, at 6:15 PM, Jake Young  wrote:
> > 
> > See
> > https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html
> > 
> > 
> > 
> > On Thursday, June 30, 2016, Mike Jacobacci  > > wrote: So after adding the ceph repo and
> > enabling the cents-7 repo… It fails trying to install ceph-common:
> > 
> > Loaded plugins: fastestmirror
> > Loading mirror speeds from cached hostfile
> >  * base: mirror.web-ster.com 
> > Resolving Dependencies
> > --> Running transaction check
> > ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> > --> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > python-rados = 1:10.2.2-0.el7 for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency: librbd1 =
> > 1:10.2.2-0.el7 for package: 1:ceph-common-10.2.2-0.el7.x86_64 -->
> > Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > python-rbd = 1:10.2.2-0.el7 for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency: librados2
> > = 1:10.2.2-0.el7 for package: 1:ceph-common-10.2.2-0.el7.x86_64 -->
> > Processing Dependency: python-requests for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > libboost_program_options-mt.so.1.53.0()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > librgw.so.2()(64bit) for package: 1:ceph-common-10.2.2-0.el7.x86_64
> > --> Processing Dependency: libradosstriper.so.1()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > libbabeltrace-ctf.so.1()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > libboost_regex-mt.so.1.53.0()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > libboost_iostreams-mt.so.1.53.0()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > librbd.so.1()(64bit) for package: 1:ceph-common-10.2.2-0.el7.x86_64
> > --> Processing Dependency: libtcmalloc.so.4()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> > librados.so.2()(64bit) for package: 1:ceph-common-10.2.2-0.el7.x86_64
> > --> Processing Dependency: libbabeltrace.so.1()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Running transaction check --->
> > Package boost-iostreams.x86_64 0:1.53.0-25.el7 will be installed --->
> > Package boost-program-options.x86_64 0:1.53.0-25.el7 will be installed
> > ---> Package boost-regex.x86_64 0:1.53.0-25.el7 will be installed --->
> > Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed -->
> > Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package:
> > 1:ceph-common-10.2.2-0.el7.x86_64 --> Processing Dependency:
> >

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
Thanks Jake!  I enabled the epel 7 repo and was able to get ceph-common 
installed.  Here is what happens when I try to map the drive:

rbd map rbd/enterprise-vm0 --name client.admin -m mon0 -k 
/etc/ceph/ceph.client.admin.keyring 
rbd: sysfs write failed
In some cases useful info is found in syslog - try "dmesg | tail" or so.
rbd: map failed: (5) Input/output error

dmesg | tail:

[35034.469236] libceph: mon0 192.168.10.187:6789 socket error on read
[35044.469183] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35044.469199] libceph: mon0 192.168.10.187:6789 socket error on read
[35054.469076] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35054.469083] libceph: mon0 192.168.10.187:6789 socket error on read
[35064.469287] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35064.469302] libceph: mon0 192.168.10.187:6789 socket error on read
[35074.469162] libceph: mon0 192.168.10.187:6789 feature set mismatch, my 
4a042a42 < server's 2004a042a42, missing 200
[35074.469178] libceph: mon0 192.168.10.187:6789 socket error on read




> On Jun 30, 2016, at 6:15 PM, Jake Young  wrote:
> 
> See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html 
> 
> 
> 
> On Thursday, June 30, 2016, Mike Jacobacci  > wrote:
> So after adding the ceph repo and enabling the cents-7 repo… It fails trying 
> to install ceph-common:
> 
> Loaded plugins: fastestmirror
> Loading mirror speeds from cached hostfile
>  * base: mirror.web-ster.com 
> Resolving Dependencies
> --> Running transaction check
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-requests for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for 
> package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librgw.so.2()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libradosstriper.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_iostreams-mt.so.1.53.0()(64bit) for 
> package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libtcmalloc.so.4()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados.so.2()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Running transaction check
> ---> Package boost-iostreams.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package boost-program-options.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package boost-regex.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
> 1:ceph-common-10.2.2-0.el7.x86_64
> ---> Package gperftools-libs.x86_64 0:2.4-7.el7 will be installed
> --> Processing Dependency: libunwind.so.8()(64bit) for package: 
> gperftools-libs-2.4-7.el7.x86_64
> ---> Package libcephfs1.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 
> 1:libcephfs1-10.2.2-0.el7.x86_64
> ---> Package librados2.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 
> 1:librados2-10.2.2-0.el7.x86_64
> ---> Package libradosstriper1.x86_64 1:10.2.2-0.el7 will be installed
> ---> Package librbd1.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Jake Young 
See https://www.mail-archive.com/ceph-users@lists.ceph.com/msg17112.html


On Thursday, June 30, 2016, Mike Jacobacci  wrote:

> So after adding the ceph repo and enabling the cents-7 repo… It fails
> trying to install ceph-common:
>
> Loaded plugins: fastestmirror
> Loading mirror speeds from cached hostfile
>  * base: mirror.web-ster.com
> Resolving Dependencies
> --> Running transaction check
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: python-requests for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit)
> for package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librgw.so.2()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libradosstriper.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for
> package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libboost_iostreams-mt.so.1.53.0()(64bit) for
> package: 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librbd.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libtcmalloc.so.4()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: librados.so.2()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Running transaction check
> ---> Package boost-iostreams.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package boost-program-options.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package boost-regex.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> ---> Package gperftools-libs.x86_64 0:2.4-7.el7 will be installed
> --> Processing Dependency: libunwind.so.8()(64bit) for package:
> gperftools-libs-2.4-7.el7.x86_64
> ---> Package libcephfs1.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for
> package: 1:libcephfs1-10.2.2-0.el7.x86_64
> ---> Package librados2.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: liblttng-ust.so.0()(64bit) for package:
> 1:librados2-10.2.2-0.el7.x86_64
> ---> Package libradosstriper1.x86_64 1:10.2.2-0.el7 will be installed
> ---> Package librbd1.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: liblttng-ust.so.0()(64bit) for package:
> 1:librbd1-10.2.2-0.el7.x86_64
> ---> Package librgw2.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libfcgi.so.0()(64bit) for package:
> 1:librgw2-10.2.2-0.el7.x86_64
> ---> Package python-cephfs.x86_64 1:10.2.2-0.el7 will be installed
> ---> Package python-rados.x86_64 1:10.2.2-0.el7 will be installed
> ---> Package python-rbd.x86_64 1:10.2.2-0.el7 will be installed
> ---> Package python-requests.noarch 0:2.6.0-1.el7_1 will be installed
> --> Processing Dependency: python-urllib3 >= 1.10.2-1 for package:
> python-requests-2.6.0-1.el7_1.noarch
> --> Processing Dependency: python-chardet >= 2.2.1-1 for package:
> python-requests-2.6.0-1.el7_1.noarch
> --> Running transaction check
> ---> Package boost-random.x86_64 0:1.53.0-25.el7 will be installed
> ---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> --> Processing Dependency: libbabeltrace.so.1()(64bit) for package:
> 1:ceph-common-10.2.2-0.el7.x86_64
> ---> Package librados2.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: liblttng-ust.so.0()(64bit) for package:
> 1:librados2-10.2.2-0.el7.x86_64
> ---> Package librbd1.x86_64 1:10.2.2-0.el7 will be installed
> --> Processing Dependency: liblttng-ust.so.0()(64bit) for package:
> 1:librbd1-10.2.2-0.el7.x86_64
> ---> Package librgw2.x86_64 1:10.2.2-0.el7

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
So after adding the ceph repo and enabling the cents-7 repo… It fails trying to 
install ceph-common:

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirror.web-ster.com
Resolving Dependencies
--> Running transaction check
---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: python-cephfs = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-rados = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librbd1 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libcephfs1 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-rbd = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librados2 = 1:10.2.2-0.el7 for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: python-requests for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_program_options-mt.so.1.53.0()(64bit) for 
package: 1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librgw.so.2()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_regex-mt.so.1.53.0()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libboost_iostreams-mt.so.1.53.0()(64bit) for 
package: 1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librbd.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libtcmalloc.so.4()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: librados.so.2()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Running transaction check
---> Package boost-iostreams.x86_64 0:1.53.0-25.el7 will be installed
---> Package boost-program-options.x86_64 0:1.53.0-25.el7 will be installed
---> Package boost-regex.x86_64 0:1.53.0-25.el7 will be installed
---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
---> Package gperftools-libs.x86_64 0:2.4-7.el7 will be installed
--> Processing Dependency: libunwind.so.8()(64bit) for package: 
gperftools-libs-2.4-7.el7.x86_64
---> Package libcephfs1.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 
1:libcephfs1-10.2.2-0.el7.x86_64
---> Package librados2.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 
1:librados2-10.2.2-0.el7.x86_64
---> Package libradosstriper1.x86_64 1:10.2.2-0.el7 will be installed
---> Package librbd1.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 
1:librbd1-10.2.2-0.el7.x86_64
---> Package librgw2.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libfcgi.so.0()(64bit) for package: 
1:librgw2-10.2.2-0.el7.x86_64
---> Package python-cephfs.x86_64 1:10.2.2-0.el7 will be installed
---> Package python-rados.x86_64 1:10.2.2-0.el7 will be installed
---> Package python-rbd.x86_64 1:10.2.2-0.el7 will be installed
---> Package python-requests.noarch 0:2.6.0-1.el7_1 will be installed
--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: 
python-requests-2.6.0-1.el7_1.noarch
--> Processing Dependency: python-chardet >= 2.2.1-1 for package: 
python-requests-2.6.0-1.el7_1.noarch
--> Running transaction check
---> Package boost-random.x86_64 0:1.53.0-25.el7 will be installed
---> Package ceph-common.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 
1:ceph-common-10.2.2-0.el7.x86_64
---> Package librados2.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 
1:librados2-10.2.2-0.el7.x86_64
---> Package librbd1.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 
1:librbd1-10.2.2-0.el7.x86_64
---> Package librgw2.x86_64 1:10.2.2-0.el7 will be installed
--> Processing Dependency: libfcgi.so.0()(64bit) for package: 
1:librgw2-10.2.2-0.el7.x86_64
---> Package libunwind.x86_64 0:1.1-5.el7 will be installed
---> Package python-chardet.noarch 0:2.2.1-1.el7_1 will be installed
---> Package python-urllib3.noarch 0:1.10.2-2.el7_1

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
Hi Jake,

I will give that a try and see if that helps, thank you!

Yes I have that open in a browser tab, it gave me the idea of using ceph-deploy 
to install on the xenserver.

I will update with the results.

Cheers,
Mike
> On Jun 30, 2016, at 12:42 PM, Jake Young  wrote:
> 
> Can you install the ceph client tools on your server?  They may give you a 
> more obvious error. Try to install the package and config/keys manually 
> instead of with ceph-deploy. 
> 
> Also see this: 
> http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html 
> 
> 
> Jake
> 
> 
> On Thursday, June 30, 2016, Mike Jacobacci  > wrote:
> Hi Jake,
> 
> Interesting… XenServer 7 does has rbd installed but trying to map the rbd 
> image with this command:
> 
> # echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool} 
> {ceph_image} >/sys/bus/rbd/add
> 
>  It fails with just an i/o error… I am looking into now.  My cluster health 
> is OK, so I am hoping I didn’t miss a configuration or something.
> 
> 
>> On Jun 29, 2016, at 3:28 PM, Jake Young > > wrote:
>> 
>> 
>> 
>> On Wednesday, June 29, 2016, Mike Jacobacci > > wrote:
>> Hi all,
>> 
>> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7 and 
>> the latest Ceph, I am looking for the the best way to mount the rbd volume 
>> under XenServer.  There is not much recent info out there I have found 
>> except for this:
>> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>>  
>> 
>> 
>> and this plugin (which looks nice):
>> https://github.com/mstarikov/rbdsr 
>> 
>> I am looking for a way that doesn’t involve too much command line so other 
>> admins that don’t know Ceph or XenServer very well can work with it.  I am 
>> just curious what others are doing… Any help is greatly appreciated!
>> 
>> Cheers,
>> Mike
>> 
>> I'm not a XenServer user, so I can't help you there; but I feel your pain 
>> using Ceph for VMware storage. 
>> 
>> I'm surprised that any major Linux distributions haven't considered enabling 
>> rbd modules in initrd.
>> 
>> I can see having a tiny OS image containing not much more than grub and the 
>> boot kernel. The trick would be to find a way to manage the boot string in 
>> the grub conf on a large scale. 
>> 
>> Jake 
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Jake Young 
Can you install the ceph client tools on your server?  They may give you a
more obvious error. Try to install the package and config/keys manually
instead of with ceph-deploy.

Also see this:
http://xenserver.org/blog/entry/tech-preview-of-xenserver-libvirt-ceph.html

Jake


On Thursday, June 30, 2016, Mike Jacobacci  wrote:

> Hi Jake,
>
> Interesting… XenServer 7 does has rbd installed but trying to map the rbd
> image with this command:
>
> # echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool}
> {ceph_image} >/sys/bus/rbd/add
>
>  It fails with just an i/o error… I am looking into now.  My cluster
> health is OK, so I am hoping I didn’t miss a configuration or something.
>
>
> On Jun 29, 2016, at 3:28 PM, Jake Young  > wrote:
>
>
>
> On Wednesday, June 29, 2016, Mike Jacobacci  > wrote:
>
>> Hi all,
>>
>> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7
>> and the latest Ceph, I am looking for the the best way to mount the rbd
>> volume under XenServer.  There is not much recent info out there I have
>> found except for this:
>>
>> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>>
>> and this plugin (which looks nice):
>> https://github.com/mstarikov/rbdsr
>>
>> I am looking for a way that doesn’t involve too much command line so
>> other admins that don’t know Ceph or XenServer very well can work with it.
>> I am just curious what others are doing… Any help is greatly appreciated!
>>
>> Cheers,
>> Mike
>>
>
> I'm not a XenServer user, so I can't help you there; but I feel your pain
> using Ceph for VMware storage.
>
> I'm surprised that any major Linux distributions haven't considered
> enabling rbd modules in initrd.
>
> I can see having a tiny OS image containing not much more than grub and
> the boot kernel. The trick would be to find a way to manage the boot string
> in the grub conf on a large scale.
>
> Jake
>
>
>
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
Just adding some more info in case it helps… looking at the ceph-osd.admin.log 
and I see this on every disk:

2016-06-30 09:47:03.326176 7f15353aa800 1 journal _open /dev/sdb1 fd 4: 
24006098944 bytes, block size 4096 bytes, directio = 0, aio = 0 2016-06-30 
09:47:03.326472 7f15353aa800 1 journal close /dev/sdb1
2016-06-30 09:47:03.326554 7f15353aa800 0 probe_block_device_fsid /dev/sdb1 is 
filestore, cff08772-4b94-4411-ba03-1e25fa1b567e 
2016-06-30 09:47:08.096126 7f8adecbd800 0 ceph version 10.2.2 
(45107e21c568dd033c2f0a3107dec8f0b0e58374), process ceph-osd, pid 8515
2016-06-30 09:47:08.096381 7f8adecbd800 -1 bluestore(/dev/sdc4) 
_read_bdev_label unable to decode label at offset 66: buffer::malformed_input: 
void bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past 
end of struct encoding


Does this line indicate a problem?
"bluestore(/dev/sdc4) _read_bdev_label unable to decode label at offset 66: 
buffer::malformed_input: void 
bluestore_bdev_label_t::decode(ceph::buffer::list::iterator&) decode past end 
of struct encoding”

Cheers,
Mike


> On Jun 30, 2016, at 10:55 AM, Mike Jacobacci  wrote:
> 
> I am not sure why the mapping is failing, so I tried to install ceph on 
> XenServer with ceph-deploy but got the following error:
> 
> [ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: 
> XenServer xenenterprise 7.0.0
> fddf
> 
> I feel like I am close but I am not sure where to go from here…
> 
> Cheers,
> Mike
> 
>> On Jun 30, 2016, at 10:23 AM, Mike Jacobacci > > wrote:
>> 
>> Hi Jake,
>> 
>> Interesting… XenServer 7 does has rbd installed but trying to map the rbd 
>> image with this command:
>> 
>> # echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool} 
>> {ceph_image} >/sys/bus/rbd/add
>> 
>>  It fails with just an i/o error… I am looking into now.  My cluster health 
>> is OK, so I am hoping I didn’t miss a configuration or something.
>> 
>> 
>>> On Jun 29, 2016, at 3:28 PM, Jake Young >> > wrote:
>>> 
>>> 
>>> 
>>> On Wednesday, June 29, 2016, Mike Jacobacci >> > wrote:
>>> Hi all,
>>> 
>>> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7 and 
>>> the latest Ceph, I am looking for the the best way to mount the rbd volume 
>>> under XenServer.  There is not much recent info out there I have found 
>>> except for this:
>>> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>>>  
>>> 
>>> 
>>> and this plugin (which looks nice):
>>> https://github.com/mstarikov/rbdsr 
>>> 
>>> I am looking for a way that doesn’t involve too much command line so other 
>>> admins that don’t know Ceph or XenServer very well can work with it.  I am 
>>> just curious what others are doing… Any help is greatly appreciated!
>>> 
>>> Cheers,
>>> Mike
>>> 
>>> I'm not a XenServer user, so I can't help you there; but I feel your pain 
>>> using Ceph for VMware storage. 
>>> 
>>> I'm surprised that any major Linux distributions haven't considered 
>>> enabling rbd modules in initrd.
>>> 
>>> I can see having a tiny OS image containing not much more than grub and the 
>>> boot kernel. The trick would be to find a way to manage the boot string in 
>>> the grub conf on a large scale. 
>>> 
>>> Jake 
>> 
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
I am not sure why the mapping is failing, so I tried to install ceph on 
XenServer with ceph-deploy but got the following error:

[ceph_deploy][ERROR ] UnsupportedPlatform: Platform is not supported: XenServer 
xenenterprise 7.0.0
fddf

I feel like I am close but I am not sure where to go from here…

Cheers,
Mike

> On Jun 30, 2016, at 10:23 AM, Mike Jacobacci  wrote:
> 
> Hi Jake,
> 
> Interesting… XenServer 7 does has rbd installed but trying to map the rbd 
> image with this command:
> 
> # echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool} 
> {ceph_image} >/sys/bus/rbd/add
> 
>  It fails with just an i/o error… I am looking into now.  My cluster health 
> is OK, so I am hoping I didn’t miss a configuration or something.
> 
> 
>> On Jun 29, 2016, at 3:28 PM, Jake Young > > wrote:
>> 
>> 
>> 
>> On Wednesday, June 29, 2016, Mike Jacobacci > > wrote:
>> Hi all,
>> 
>> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7 and 
>> the latest Ceph, I am looking for the the best way to mount the rbd volume 
>> under XenServer.  There is not much recent info out there I have found 
>> except for this:
>> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>>  
>> 
>> 
>> and this plugin (which looks nice):
>> https://github.com/mstarikov/rbdsr 
>> 
>> I am looking for a way that doesn’t involve too much command line so other 
>> admins that don’t know Ceph or XenServer very well can work with it.  I am 
>> just curious what others are doing… Any help is greatly appreciated!
>> 
>> Cheers,
>> Mike
>> 
>> I'm not a XenServer user, so I can't help you there; but I feel your pain 
>> using Ceph for VMware storage. 
>> 
>> I'm surprised that any major Linux distributions haven't considered enabling 
>> rbd modules in initrd.
>> 
>> I can see having a tiny OS image containing not much more than grub and the 
>> boot kernel. The trick would be to find a way to manage the boot string in 
>> the grub conf on a large scale. 
>> 
>> Jake 
> 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-30 Thread Mike Jacobacci 
Hi Jake,

Interesting… XenServer 7 does has rbd installed but trying to map the rbd image 
with this command:

# echo {ceph_monitor_ip} name={ceph_admin},secret={ceph_key} {ceph_pool} 
{ceph_image} >/sys/bus/rbd/add

 It fails with just an i/o error… I am looking into now.  My cluster health is 
OK, so I am hoping I didn’t miss a configuration or something.


> On Jun 29, 2016, at 3:28 PM, Jake Young  wrote:
> 
> 
> 
> On Wednesday, June 29, 2016, Mike Jacobacci  > wrote:
> Hi all,
> 
> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7 and 
> the latest Ceph, I am looking for the the best way to mount the rbd volume 
> under XenServer.  There is not much recent info out there I have found except 
> for this:
> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>  
> 
> 
> and this plugin (which looks nice):
> https://github.com/mstarikov/rbdsr 
> 
> I am looking for a way that doesn’t involve too much command line so other 
> admins that don’t know Ceph or XenServer very well can work with it.  I am 
> just curious what others are doing… Any help is greatly appreciated!
> 
> Cheers,
> Mike
> 
> I'm not a XenServer user, so I can't help you there; but I feel your pain 
> using Ceph for VMware storage. 
> 
> I'm surprised that any major Linux distributions haven't considered enabling 
> rbd modules in initrd.
> 
> I can see having a tiny OS image containing not much more than grub and the 
> boot kernel. The trick would be to find a way to manage the boot string in 
> the grub conf on a large scale. 
> 
> Jake 

___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

Re: [ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-29 Thread Jake Young 
On Wednesday, June 29, 2016, Mike Jacobacci  wrote:

> Hi all,
>
> Is there anyone using rbd for xenserver vm storage?  I have XenServer 7
> and the latest Ceph, I am looking for the the best way to mount the rbd
> volume under XenServer.  There is not much recent info out there I have
> found except for this:
>
> http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
>
> and this plugin (which looks nice):
> https://github.com/mstarikov/rbdsr
>
> I am looking for a way that doesn’t involve too much command line so other
> admins that don’t know Ceph or XenServer very well can work with it.  I am
> just curious what others are doing… Any help is greatly appreciated!
>
> Cheers,
> Mike
>

I'm not a XenServer user, so I can't help you there; but I feel your pain
using Ceph for VMware storage.

I'm surprised that any major Linux distributions haven't considered
enabling rbd modules in initrd.

I can see having a tiny OS image containing not much more than grub and the
boot kernel. The trick would be to find a way to manage the boot string in
the grub conf on a large scale.

Jake
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com

[ceph-users] Mounting Ceph RBD image to XenServer 7 as SR

2016-06-29 Thread Mike Jacobacci 
Hi all,

Is there anyone using rbd for xenserver vm storage?  I have XenServer 7 and the 
latest Ceph, I am looking for the the best way to mount the rbd volume under 
XenServer.  There is not much recent info out there I have found except for 
this:
http://www.mad-hacking.net/documentation/linux/ha-cluster/storage-area-network/ceph-xen-domu.xml
 


and this plugin (which looks nice):
https://github.com/mstarikov/rbdsr 

I am looking for a way that doesn’t involve too much command line so other 
admins that don’t know Ceph or XenServer very well can work with it.  I am just 
curious what others are doing… Any help is greatly appreciated!

Cheers,
Mike___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com