Jerasure 1.2A plugin for Ceph

2013-08-30 Thread Loic Dachary
Hi James, The first version of the jerasure 1.2A plugin for Ceph is complete at https://github.com/ceph/ceph/pull/538#commits-pushed-763275e This commit introduces the main part: ErasureCodeJerasure: base class for jerasure ErasureCodeInterface

Re: radosgw 0.67.2 update - ERROR: failed to initialize watch

2013-08-30 Thread Sylvain Munaut
Hi, I just pushed a fix to wip-6161, can you verify that it fixes the issue for you? Thanks, I'll give it a shot on monday, I'm out of the office at the moment. Cheers, Sylvain -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to

libvirt: Using rbd_create3 to create format 2 images

2013-08-30 Thread Wido den Hollander
Hi, I created the attached patch to have libvirt create images with format 2 by default, this would simplify the CloudStack code and could also help other projects. The problem with libvirt is that there is no mechanism to supply information like order, features, stripe unit and count to

RE: debugging librbd async - valgrind memtest hit

2013-08-30 Thread James Harper
I finally got a valgrind memtest hit... output attached below email. I recompiled all of tapdisk and ceph without any -O options (thought I had already...) and it seems to have done the trick Basically it looks like an instance of AioRead is being accessed after being free'd. I need some hints

collectd plugin with cuttlefish

2013-08-30 Thread Damien Churchill
Hi, Has anything changed with the admin socket that would prevent the collectd plugin (compiled against 5.3.1 using the patches submitted to the collectd ML) from gathering stats? I've recompiled collectd with --enable-debug and receive the following output in the log: ceph_init name=mon_ceph1,

ceph s3 allowed characters

2013-08-30 Thread Dominik Mostowiec
Hi, I got err (400) from radosgw on request: 2013-08-30 08:09:19.396812 7f3b307c0700 2 req 3070:0.000150::POST

Re: [ceph-users] ceph s3 allowed characters

2013-08-30 Thread Dominik Mostowiec
(echo -n 'GET /dysk/files/test.test%40op.pl/DOMIWENT%202013/Damian%20DW/dw/Specyfikacja%20istotnych%20warunk%F3w%20zam%F3wienia.doc HTTP/1.0'; printf \r\n\r\n) | nc localhost 88 HTTP/1.1 400 Bad Request Date: Fri, 30 Aug 2013 14:10:07 GMT Server: Apache/2.2.22 (Ubuntu) Accept-Ranges: bytes

Re: [ceph-users] ceph s3 allowed characters

2013-08-30 Thread Yehuda Sadeh
On Fri, Aug 30, 2013 at 7:44 AM, Dominik Mostowiec dominikmostow...@gmail.com wrote: (echo -n 'GET /dysk/files/test.test%40op.pl/DOMIWENT%202013/Damian%20DW/dw/Specyfikacja%20istotnych%20warunk%F3w%20zam%F3wienia.doc HTTP/1.0'; printf \r\n\r\n) | nc localhost 88 HTTP/1.1 400 Bad Request

RE: debugging librbd async - valgrind memtest hit

2013-08-30 Thread Sage Weil
On Fri, 30 Aug 2013, James Harper wrote: I finally got a valgrind memtest hit... output attached below email. I recompiled all of tapdisk and ceph without any -O options (thought I had already...) and it seems to have done the trick What version is this? The line numbers don't seem to match

Re: libvirt: Using rbd_create3 to create format 2 images

2013-08-30 Thread Josh Durgin
On 08/30/2013 02:42 AM, Wido den Hollander wrote: Hi, I created the attached patch to have libvirt create images with format 2 by default, this would simplify the CloudStack code and could also help other projects. The problem with libvirt is that there is no mechanism to supply information

Deep-Scrub and High Read Latency with QEMU/RBD

2013-08-30 Thread Mike Dawson
We've been struggling with an issue of spikes of high i/o latency with qemu/rbd guests. As we've been chasing this bug, we've greatly improved the methods we use to monitor our infrastructure. It appears that our RBD performance chokes in two situations: - Deep-Scrub - Backfill/recovery In

Re: Deep-Scrub and High Read Latency with QEMU/RBD

2013-08-30 Thread Andrey Korolyov
You may want to reduce scrubbing pgs per osd to 1 using config option and check the results. On Fri, Aug 30, 2013 at 8:03 PM, Mike Dawson mike.daw...@cloudapt.com wrote: We've been struggling with an issue of spikes of high i/o latency with qemu/rbd guests. As we've been chasing this bug, we've

Re: Deep-Scrub and High Read Latency with QEMU/RBD

2013-08-30 Thread Mike Dawson
Andrey, I use all the defaults: # ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config show | grep scrub osd_scrub_thread_timeout: 60, osd_scrub_finalize_thread_timeout: 600, osd_max_scrubs: 1, osd_scrub_load_threshold: 0.5, osd_scrub_min_interval: 86400, osd_scrub_max_interval:

Re: Deep-Scrub and High Read Latency with QEMU/RBD

2013-08-30 Thread Andrey Korolyov
On Fri, Aug 30, 2013 at 9:44 PM, Mike Dawson mike.daw...@cloudapt.com wrote: Andrey, I use all the defaults: # ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config show | grep scrub osd_scrub_thread_timeout: 60, osd_scrub_finalize_thread_timeout: 600, osd_max_scrubs: 1, This

Re: libvirt: Using rbd_create3 to create format 2 images

2013-08-30 Thread Wido den Hollander
On 08/30/2013 05:26 PM, Josh Durgin wrote: On 08/30/2013 02:42 AM, Wido den Hollander wrote: Hi, I created the attached patch to have libvirt create images with format 2 by default, this would simplify the CloudStack code and could also help other projects. The problem with libvirt is that

[ceph-users] ceph install

2013-08-30 Thread Jimmy Lu [ Storage ]
Hello ceph-users, I am new to Ceph and would like to bring up a 5-node cluster for my PoC. I am doing an installation from below link and ran into a problem. I am not so sure how to deal with it. Can someone please shed some light? http://ceph.com/docs/master/install/rpm/ [root@cleverloadgen16

RE: debugging librbd async - valgrind memtest hit

2013-08-30 Thread James Harper
On Fri, 30 Aug 2013, James Harper wrote: I finally got a valgrind memtest hit... output attached below email. I recompiled all of tapdisk and ceph without any -O options (thought I had already...) and it seems to have done the trick What version is this? The line numbers don't seem to

Re: collectd plugin with cuttlefish

2013-08-30 Thread Dan Mick
It's a bit surprising that it broke with cuttlefish; something might have happened in dumpling, but we wouldn't expect changes in cuttlefish. It looks like collectd just couldn't talk to the monitor properly. Maybe look at the mon's log and see what it thinks it saw? On 08/30/2013 05:04 AM,