Re: rbd STDIN import does not work / wip-rbd-export-stdout

Am 27.11.2012 23:50, schrieb Josh Durgin: On 11/27/2012 01:16 AM, Stefan Priebe - Profihost AG wrote: Am 26.11.2012 21:00, schrieb Dan Mick: As for fstrim: on the rbd image?sure, if it's a filesystem, it ought to work (modulo some bugs I've heard about with 32-bit vs. 64-bit offsets in

Upgrade a running cluster to bobtail ? (when it will be out :p)

Hi, I'd like to know the recommended upgrade procedure when bobtail is out ? I've read in the past in the list that rolling upgrade between stable release was going to be possible, but exactly what is the way to do this ? Upgrade OSD host by host, then upgrade MON one by one ? Or do the MON

[PATCH 04/30] ceph_mon.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/ceph_mon.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/ceph_mon.cc b/src/ceph_mon.cc index da4529f..f82be18 100644 --- a/src/ceph_mon.cc +++ b/src/ceph_mon.cc @@ -16,7 +16,6 @@

[PATCH 03/30] ceph_mds.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/ceph_mds.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/ceph_mds.cc b/src/ceph_mds.cc index 6187948..e6928fb 100644 --- a/src/ceph_mds.cc +++ b/src/ceph_mds.cc @@ -16,7 +16,6 @@

[PATCH 07/30] client/Client.cc: remove twice included headers

Fix includes: remove twice included common/config.h. Remove include of sys/param.h in special __FreeBSD__ section, since this file is included in general anyway Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/client/Client.cc | 6 -- 1 file changed, 6 deletions(-) diff --git

[PATCH 02/30] ceph_fuse.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/ceph_fuse.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/ceph_fuse.cc b/src/ceph_fuse.cc index e645777..09aadb4 100644 --- a/src/ceph_fuse.cc +++ b/src/ceph_fuse.cc @@ -37,7

[PATCH 08/30] client/MetaRequest.cc: remove twice included client/Dentry.h

Fix includes: remove twice included client/Dentry.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/client/MetaRequest.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/client/MetaRequest.cc b/src/client/MetaRequest.cc index 205e201..2c50f06 100644 ---

[PATCH 09/30] client/SyntheticClient.cc: remove twice included headers

Fix includes: remove twice included common/config.h and sys/types.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/client/SyntheticClient.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/client/SyntheticClient.cc b/src/client/SyntheticClient.cc index f081244..b2a936f

[PATCH 05/30] ceph_osd.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/ceph_osd.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/ceph_osd.cc b/src/ceph_osd.cc index 0652089..8fbeb75 100644 --- a/src/ceph_osd.cc +++ b/src/ceph_osd.cc @@ -17,7 +17,6 @@

[PATCH 06/30] ceph_syn.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/ceph_syn.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/ceph_syn.cc b/src/ceph_syn.cc index a087e9f..8ffe40a 100644 --- a/src/ceph_syn.cc +++ b/src/ceph_syn.cc @@ -36,7 +36,6 @@

[PATCH 01/30] fusetrace_ll.cc: remove twice included sys/time.h

Fix includes: remove twice included sys/time.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- fusetrace/fusetrace_ll.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/fusetrace/fusetrace_ll.cc b/fusetrace/fusetrace_ll.cc index 9a0a076..1b0d45f 100644 --- a/fusetrace/fusetrace_ll.cc

[PATCH 12/30] monmaptool.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/monmaptool.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/monmaptool.cc b/src/monmaptool.cc index 4c99fdd..5870e5f 100644 --- a/src/monmaptool.cc +++ b/src/monmaptool.cc @@

[PATCH 13/30] include/buffer.h: remove twice included stdio.h

Fix includes: remove twice included stdio.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/include/buffer.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/include/buffer.h b/src/include/buffer.h index 4a9e96c..9a635bd 100644 --- a/src/include/buffer.h +++

[PATCH 14/30] librados/RadosClient.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/librados/RadosClient.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/librados/RadosClient.cc b/src/librados/RadosClient.cc index ae56c76..7e76b65 100644 ---

[PATCH 15/30] mds/Dumper.h: remove twice included msg/Messenger.h

Fix includes: remove twice included msg/Messenger.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mds/Dumper.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/mds/Dumper.h b/src/mds/Dumper.h index d9af3aa..066ba5c 100644 --- a/src/mds/Dumper.h +++ b/src/mds/Dumper.h @@

[PATCH 16/30] mds/Migrator.cc: remove twice included Migrator.h

Fix includes: remove twice included Migrator.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mds/Migrator.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/mds/Migrator.cc b/src/mds/Migrator.cc index 9829d68..b66b54c 100644 --- a/src/mds/Migrator.cc +++

[PATCH 17/30] mds/Resetter.h: remove twice included msg/Messenger.h

Fix includes: remove twice included msg/Messenger.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mds/Resetter.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/mds/Resetter.h b/src/mds/Resetter.h index 663dde1..b3bc067 100644 --- a/src/mds/Resetter.h +++

[PATCH 30/30] tools/common.cc: remove twice included headers

Cleanup includes: Remove twice included sys/stat.h and osd/OSDMap.h. Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/tools/common.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/tools/common.cc b/src/tools/common.cc index c500568..9a454f7 100644 ---

[PATCH 25/30] osd/OSD.h: remove twice included OpRequest.h

Fix includes: remove twice included OpRequest.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/osd/OSD.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/osd/OSD.h b/src/osd/OSD.h index ff277e1..ab6e3ac 100644 --- a/src/osd/OSD.h +++ b/src/osd/OSD.h @@ -49,7 +49,6 @@ using

[PATCH 24/30] os/IndexManager.cc: remove twice included FlatIndex.h

Fix includes: remove twice included FlatIndex.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/os/IndexManager.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/os/IndexManager.cc b/src/os/IndexManager.cc index 2165036..85281c4 100644 --- a/src/os/IndexManager.cc +++

[PATCH 26/30] osdmaptool.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/osdmaptool.cc | 1 - 1 file changed, 1 deletion(-) diff --git a/src/osdmaptool.cc b/src/osdmaptool.cc index c28926b..d367c36 100644 --- a/src/osdmaptool.cc +++ b/src/osdmaptool.cc @@

[PATCH 27/30] rados.cc: remove twice included headers

Fix includes: remove twice included common/obj_bencher.h and common/errno.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/rados.cc | 4 1 file changed, 4 deletions(-) diff --git a/src/rados.cc b/src/rados.cc index b06f703..a870255 100644 --- a/src/rados.cc +++ b/src/rados.cc

[PATCH 28/30] remove twice included linux/types.h

Cleanup includes: remove twice included linux/types.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- qa/workunits/direct_io/test_sync_io.c | 1 - 1 file changed, 1 deletion(-) diff --git a/qa/workunits/direct_io/test_sync_io.c b/qa/workunits/direct_io/test_sync_io.c index

[PATCH 22/30] os/DBObjectMap.cc: remove twice included headers

Fix includes: remove twice included string and tr1/memory Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/os/DBObjectMap.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/os/DBObjectMap.cc b/src/os/DBObjectMap.cc index 83b746d..10b7b70 100644 --- a/src/os/DBObjectMap.cc

[PATCH 29/30] rgw/rgw_rest.cc: remove twice included rgw_formats.h

Cleanup includes: Remove twice included rgw_formats.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/rgw/rgw_rest.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/rgw/rgw_rest.cc b/src/rgw/rgw_rest.cc index 99eb090..9d978d1 100644 --- a/src/rgw/rgw_rest.cc +++

[PATCH 11/30] crushtool.cc: remove twice included sys/stat.h

Fix includes: remove twice included sys/stat.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/crushtool.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/crushtool.cc b/src/crushtool.cc index 271cd15..0f54852 100644 --- a/src/crushtool.cc +++ b/src/crushtool.cc @@ -17,8

[PATCH 10/30] common/pipe.c: remove twice included unistd.h

Fix includes: remove twice included unistd.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/common/pipe.c | 1 - 1 file changed, 1 deletion(-) diff --git a/src/common/pipe.c b/src/common/pipe.c index e35b6fe..9c01b32 100644 --- a/src/common/pipe.c +++ b/src/common/pipe.c @@ -17,7

[PATCH 21/30] mount/canonicalize.c: remove twice included string.h

Fix includes: remove twice included string.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mount/canonicalize.c | 1 - 1 file changed, 1 deletion(-) diff --git a/src/mount/canonicalize.c b/src/mount/canonicalize.c index c3bdb38..7561e41 100644 --- a/src/mount/canonicalize.c +++

[PATCH 19/30] messages/MClientRequest.h: remove twice included sys/types.h

Fix includes: remove twice included sys/types.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/messages/MClientRequest.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/messages/MClientRequest.h b/src/messages/MClientRequest.h index e8ce763..9dc9383 100644 ---

[PATCH 18/30] mds/journal.cc: remove twice included common/config.h

Fix includes: remove twice included common/config.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mds/journal.cc | 3 --- 1 file changed, 3 deletions(-) diff --git a/src/mds/journal.cc b/src/mds/journal.cc index 04b1a92..46adbf2 100644 --- a/src/mds/journal.cc +++

[PATCH 20/30] mon/Monitor.cc: remove twice included osd/OSDMap.h

Fix includes: remove twice included osd/OSDMap.h Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/mon/Monitor.cc | 2 -- 1 file changed, 2 deletions(-) diff --git a/src/mon/Monitor.cc b/src/mon/Monitor.cc index 79f2577..b819fce 100644 --- a/src/mon/Monitor.cc +++

[PATCH 23/30] os/DBObjectMap.h: remove twice included string

Fix includes: remove twice included string Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/os/DBObjectMap.h | 1 - 1 file changed, 1 deletion(-) diff --git a/src/os/DBObjectMap.h b/src/os/DBObjectMap.h index 331..18c6ce4 100644 --- a/src/os/DBObjectMap.h +++

Re: rbd STDIN import does not work / wip-rbd-export-stdout

Hi Dan, thanks for your update / new import-export branch. The import seems to work now. What i'm wondering is that it is really slow. I see around 10% CPU Usage on importing host (host where rbd import is started) and just 4MB every 2s raising Data on ceph. This means 40GB took around 5-6

[PATCH] fix build of unittest_formatter

Add CRYPTO_CXXFLAGS to unittest_formatter_CXXFLAGS to find pk11pub.h to be included in src/common/ceph_crypto.h. Signed-off-by: Danny Al-Gaaf danny.al-g...@bisect.de --- src/Makefile.am | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/Makefile.am b/src/Makefile.am index

Re: chooseleaf_descend_once

Hey Jim, Running the third test with tunable chooseleaf_descend_once 0 with no devices marked out yields the following result (999.827397, 0.48667056652539997) so chi squared value is 999 with a corresponding p value of 0.487 so that the placement distribution seems to be drawn from the

Re: chooseleaf_descend_once

On 11/28/2012 09:11 AM, Caleb Miles wrote: Hey Jim, Running the third test with tunable chooseleaf_descend_once 0 with no devices marked out yields the following result (999.827397, 0.48667056652539997) so chi squared value is 999 with a corresponding p value of 0.487 so that the

Re: rbd STDIN import does not work / wip-rbd-export-stdout

On 11/28/2012 12:09 AM, Stefan Priebe - Profihost AG wrote: Am 27.11.2012 23:50, schrieb Josh Durgin: On 11/27/2012 01:16 AM, Stefan Priebe - Profihost AG wrote: Am 26.11.2012 21:00, schrieb Dan Mick: As for fstrim: on the rbd image?sure, if it's a filesystem, it ought to work (modulo

Multiple CEPH roles on single platform

Another rookie question: What's the thinking on having the same server perform multiple CEPH roles (e.g. osd(s), and monitor roles)? I think this would mainly be a facto for smaller/cost sensitive environments. Tim -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the

Re: [PATCH 00/30] cleanup includes

Merged, thanks! sage On Wed, 28 Nov 2012, Danny Al-Gaaf wrote: This patch series removes several twice included header files from the source files. Danny Al-Gaaf (30): fusetrace_ll.cc: remove twice included sys/time.h ceph_fuse.cc: remove twice included sys/stat.h ceph_mds.cc:

Re: OSD and MON memory usage

What replication level are you using? -Sam On Tue, Nov 27, 2012 at 9:23 AM, Cláudio Martins c...@ist.utl.pt wrote: On Fri, 23 Nov 2012 16:46:00 + Joao Eduardo Luis joao.l...@inktank.com wrote: On 11/16/2012 05:24 PM, Cláudio Martins wrote: As for the monitor daemon on this cluster

Re: OSD and MON memory usage

On Wed, 28 Nov 2012 13:00:17 -0800 Samuel Just sam.j...@inktank.com wrote: What replication level are you using? Hi, The replication level is 3. Thanks Cláudio -- To unsubscribe from this list: send the line unsubscribe ceph-devel in the body of a message to majord...@vger.kernel.org More

Re: OSD and MON memory usage

Can you post the output of ceph -s? -Sam On Wed, Nov 28, 2012 at 1:05 PM, Cláudio Martins c...@ist.utl.pt wrote: On Wed, 28 Nov 2012 13:00:17 -0800 Samuel Just sam.j...@inktank.com wrote: What replication level are you using? Hi, The replication level is 3. Thanks Cláudio -- To

Re: endless flying slow requests

Did you observe hung io along with that error? Both sub_op_commit and sub_op_applied have happened, so the sub_op_reply should have been sent back to the primary. This looks more like a leak. If you also observed hung io, then it's possible that the problem is occurring between the

Re: endless flying slow requests

Also, these clusters aren't mixed argonaut and next, are they? (Not that that shouldn't work, but it would be a useful data point.) -Sam On Wed, Nov 28, 2012 at 1:11 PM, Samuel Just sam.j...@inktank.com wrote: Did you observe hung io along with that error? Both sub_op_commit and

Re: Multiple CEPH roles on single platform

Hi Tim, It's all up to you whether you assign more roles to a system or not. What actually happens is that you need to start a daemon for each of the ceph services. Each of the systems in your ceph cluster will most likely run at least one of those daemons, but it is not required that all system

Re: OSD and MON memory usage

On Wed, 28 Nov 2012 13:08:08 -0800 Samuel Just sam.j...@inktank.com wrote: Can you post the output of ceph -s? 'ceph -s' right now gives health HEALTH_WARN 923 pgs degraded; 8666 pgs down; 9606 pgs peering; 7 pgs recovering; 406 pgs recovery_wait; 3769 pgs stale; 9606 pgs stuck inactive;

RE: endless flying slow requests

I actually have this exact issue with hung io during these slow requests. The odd thing is when I restarted the osd that was being mentioned via ceph -w it didn't resume io. A bit later (unsure on exact time) another one started being listed in ceph -w and when I restarted that different osd

Re: endless flying slow requests

On Thu, Nov 29, 2012 at 1:12 AM, Samuel Just sam.j...@inktank.com wrote: Also, these clusters aren't mixed argonaut and next, are they? (Not that that shouldn't work, but it would be a useful data point.) -Sam On Wed, Nov 28, 2012 at 1:11 PM, Samuel Just sam.j...@inktank.com wrote: Did you

Re: OSD and MON memory usage

Hi, If you want, I can try to restart the whole thing tomorrow and collect fresh log output from the dying OSDs, or any other action or debug info that you might find useful. Is the clock synchronized on all machines ? What you describe (growing mem, recovery that doesn't seem to end) seems

Re: OSD and MON memory usage

On Thu, 29 Nov 2012 00:13:25 +0100 Sylvain Munaut s.mun...@whatever-company.com wrote: Hi, If you want, I can try to restart the whole thing tomorrow and collect fresh log output from the dying OSDs, or any other action or debug info that you might find useful. Is the clock

Re: parsing in the ceph osd subsystem

On Wednesday, November 28, 2012 at 11:45 PM, Andrey Korolyov wrote: $ ceph osd down - osd.0 is already down $ ceph osd down --- osd.0 is already down the same for ``+'', ``/'', ``%'' and so - I think that for osd subsys ceph cli should explicitly work only with positive integers plus zero,