Re: [ceph-users] IO wait spike in VM

2014-09-28 Thread Bécholey Alexandre
Hello Quenten, Thanks for your reply. We have a 5GB journal for each OSD on the same disk. Right now, we are migrating our OSD to XFS and we'll add a 5th monitor. We will perform the benchmarks afterwards. Cheers, Alexandre -Original Message- From: Quenten Grasso [mailto:qgra...@onq.c

Re: [ceph-users] what does osd's ms_objecter do? and who will connect it?

2014-09-28 Thread Sage Weil
On Mon, 29 Sep 2014, yuelongguang wrote: > hi, sage will1. > you mean if i use cache tiering, client's objecter can know how to connect > to osd daemon's objecter? > if i can see it  throught osdmap? > 2. > i know if rbd use cache, it use objecter, so i thought objecter is a cache > for IO scatter/

Re: [ceph-users] what does osd's ms_objecter do? and who will connect it?

2014-09-28 Thread yuelongguang
hi, sage will 1. you mean if i use cache tiering, client's objecter can know how to connect to osd daemon's objecter? if i can see it throught osdmap? 2. i know if rbd use cache, it use objecter, so i thought objecter is a cache for IO scatter/gather. i do not know 'COPYFROM operation ', you men

Re: [ceph-users] what does osd's ms_objecter do? and who will connect it?

2014-09-28 Thread Sage Weil
On Mon, 29 Sep 2014, yuelongguang wrote: > hi,all > 1. >   > and who will connect it? as for osd, this ms_objecter is listen socket. > it  is not included in osdmap. so how to know ms_objecter's  listen address > and connect it. Ah, that's a mistake. It is only used to connect to other OSDs as a

[ceph-users] what does osd's ms_objecter do? and who will connect it?

2014-09-28 Thread yuelongguang
hi,all 1. and who will connect it? as for osd, this ms_objecter is listen socket. it is not included in osdmap. so how to know ms_objecter's listen address and connect it. thanks___ ceph-users mailing list ceph-users@lists.ceph.com http://lists.c

Re: [ceph-users] IO wait spike in VM

2014-09-28 Thread Quenten Grasso
G'day Alexandre I'm not sure if this is causing your issues, however it could be contributing to them. I noticed you have 4 Mon's, this could contributing to your problems as its recommended due to paxos algorithm which ceph uses for achieving quorum of mon's, you should be running an odd num