Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[Phil Regnauld]

Lucas, Sascha (Sascha.Lucas) writes:
> Hi Phil,
> 
> > ... and I've followed 
> > https://groups.google.com/forum/#!topic/ganeti/kApy2vclbmg - but th patch 
> > referenced at https://code.google.com/p/ganeti/issues/detail?id=1180  is 
> > 404.
> 
> This is https://github.com/ganeti/ganeti/pull/27 now.

Ok, so I'd already patched 
/usr/share/ganeti/2.15/ganeti/storage/bdev.py -
what fixed it for me was mentioned in 
https://groups.google.com/forum/#!topic/ganeti/kApy2vclbmg
but I'd missed it the first time around:

[client]
rbd_default_format = 2
rbd_default_features = 3

... adding this to ceph.conf on the Ganeti node made things work.

Just in case someone else runs into this issue again :)

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[Lucas, Sascha]

Hi Phil,

> ... and I've followed 
> https://groups.google.com/forum/#!topic/ganeti/kApy2vclbmg - but th patch 
> referenced at https://code.google.com/p/ganeti/issues/detail?id=1180  is 404.

This is https://github.com/ganeti/ganeti/pull/27 now.

HTH, Sascha.

Treffen Sie GISA auf folgenden Veranstaltungen! 
06.-08.02.2018 E-world energy and water 2018, Essen 
23.02.2018   Ihr Weg zu S/4HANA - Webinar zur einer erfolgreichen Roadmap 
13.-14.03.2018 7. VKU-Vertriebstagung 2018, Halle (Saale) 
26.04.2018 10. Mitteldeutsche Personaltagung, Halle (Saale) 



Aufsichtsratsvorsitzender: Norbert Rotter
Geschäftsführung: Michael Krüger
Sitz der Gesellschaft: Halle/Saale
Registergericht: Amtsgericht Stendal | Handelsregister-Nr. HRB 208414
UST-ID-Nr. DE 158253683

Diese E-Mail enthält vertrauliche und/oder rechtlich geschützte Informationen. 
Wenn Sie nicht der richtige Empfänger sind oder diese E-Mail irrtümlich 
erhalten haben, informieren Sie bitte sofort den Absender und vernichten Sie 
diese Mail. Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail 
oder des Inhalts dieser Mail sind nicht gestattet. Diese Kommunikation per 
E-Mail ist nicht gegen den Zugriff durch Dritte geschützt. Die GISA GmbH haftet 
ausdrücklich nicht für den Inhalt und die Vollständigkeit von E-Mails und den 
gegebenenfalls daraus entstehenden Schaden. Sollte trotz der bestehenden 
Viren-Schutzprogramme durch diese E-Mail ein Virus in Ihr System gelangen, so 
haftet die GISA GmbH - soweit gesetzlich zulässig - nicht für die hieraus 
entstehenden Schäden.



 

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[Phil Regnauld]

Just out of curiosity - what's the status on this - is there a patch than 
can be applied that fixes the mapping issue ?

This is on 2.15.2-3 Ganeti on Ubuntu 16.04, with a Jewel test cluster

I applied the fix 
from 
https://github.com/ganeti/ganeti/commit/27a999616efefcff96b14688208c93c6a76d8813
(originally referenced 
from https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=850823) -- but now 
running into the next issue with instance creation:

Can't create block device  on node vm1 for instance cephvm.testcluster: 
Can't create block device: rbd map failed (exited with exit code 6): RBD 
image feature set mismatch. Try disabling features unsupported by the 
kernel with "rbd feature disable".
In some cases useful info is found in syslog - try "dmesg | tail".
rbd: sysfs write failed
rbd: map failed: (6) No such device or address

... and I've 
followed https://groups.google.com/forum/#!topic/ganeti/kApy2vclbmg - but 
th patch referenced at 
https://code.google.com/p/ganeti/issues/detail?id=1180  is 404.

Any input appreciated :)


On Tuesday, 31 January 2017 22:07:12 UTC+5:45, gan...@googlecode.com wrote:
>
>
> Comment #8 on issue 1180 by a.jazdze...@googlemail.com: Ceph/RBD support 
> is   
> broken with Ceph 'Jewel' due to incorrect showmapped command 
> https://code.google.com/p/ganeti/issues/detail?id=1180 
>
> as far as i had a look the other sub-commands still have the -p flag 
>
> -- 
> You received this message because this project is configured to send all   
> issue notifications to this address. 
> You may adjust your notification preferences at: 
> https://code.google.com/hosting/settings 
>

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #8 on issue 1180 by a.jazdze...@googlemail.com: Ceph/RBD support is  
broken with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

as far as i had a look the other sub-commands still have the -p flag

--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #7 on issue 1180 by sup...@gmail.com: Ceph/RBD support is broken  
with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

Yes, I recently upgraded some servers and now all of the instances on CEPH  
are broken.  I'm trying to complete the patch.


--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #6 on issue 1180 by bpfo...@google.com: Ceph/RBD support is broken  
with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

Thanks. This patch looks good as far as it goes, but as I mentioned in #3  
it doesn't fix the same with all the other rbd subcommands used by  
RADOSBlockDevice.


eg Create uses create -p  ; Remove uses rm -p  ;  
Grow uses resize -p  , etc.


--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #5 on issue 1180 by a.jazdze...@googlemail.com: Ceph/RBD support is  
broken with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

i put the patch on github
https://github.com/ganeti/ganeti/pull/27

--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #4 on issue 1180 by a.jazdze...@googlemail.com: Ceph/RBD support is  
broken with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

i had a look into the json output of "rbd showmapped" and i thik i can be  
done more secure if we also lookup the pool in the  
jeson-ouput "_ParseRbdShowmappedJson(output, volume_name)"


i will add it to my patch

--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Updates:
Cc: da...@mcbf.net

Comment #3 on issue 1180 by bpfo...@google.com: Ceph/RBD support is broken  
with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

I know almost nothing about ceph, but just looking at the sources for  
hammer and jewel, it does appear that the rbd command line tool in jewel  
lost the --pool/-p option that hammer had.


I think your fix isn't going to work entirely properly though. What happens  
if you have two mappings in different pools that happen to have the same  
name? I think you're going to have to change _ParseRbdShowmappedJson to  
filter out mappings from the specified pool.


Also, it looks like the rbd subcommands create, rm, map, resize, import and  
export also have the same problem. In hammer you can do rbd $SUB_CMD -p  
mypool mymap or rbd $SUB_CMD mypool/mymap (the parsing of the second is  
implemented by set_pool_image_name(...) in src/rbd.cc).


In jewel only the second syntax appears to be supported (again, just by  
eyeballing the source code).


I think that  you're going to need to update Create, Remove,  
_MapVolumeToBlockdev, Close, Import and Export in RADOSBlockDevice to use  
the mypool/mymap syntax.


David, do you have any input on this?

--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #2 on issue 1180 by a.jazdze...@googlemail.com: Ceph/RBD support is  
broken with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

this will fix it since the "-p option" no loger exists in "rbd showmapped"

--- a/lib/storage/bdev.py
+++ b/lib/storage/bdev.py
@@ -1020,8 +1020,6 @@ class RADOSBlockDevice(base.BlockDev):
   showmap_cmd = [
 constants.RBD_CMD,
 "showmapped",
-"-p",
-pool,
 "--format",
 "json"
 ]


--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings

Re: Issue 1180 in ganeti: Ceph/RBD support is broken with Ceph 'Jewel' due to incorrect showmapped command

[ganeti]

Comment #1 on issue 1180 by snn...@gmail.com: Ceph/RBD support is broken  
with Ceph 'Jewel' due to incorrect showmapped command

https://code.google.com/p/ganeti/issues/detail?id=1180

I've the same issue with debain 8.5 using ganeti Version: 2.12.4-1+deb8u3  
and ceph 10.x from ceph repository. resolved by using ceph Version:  
9.2.1-1~bpo80+1 on the clients. Is this production ready?


--
You received this message because this project is configured to send all  
issue notifications to this address.

You may adjust your notification preferences at:
https://code.google.com/hosting/settings