Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-11 Thread Nick Fisk
om: Alex Gorbachev [mailto:a...@iss-integration.com] > > Sent: 04 September 2016 04:45 > > To: Nick Fisk <n...@fisk.me.uk> > > Cc: Wilhelm Redbrake <w...@globe.de>; Horace Ng <hor...@hkisl.net>; > > ceph-users <ceph-users@lists.ceph.com> > > Subject: R

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-11 Thread Alex Gorbachev
edbrake <w...@globe.de>; Horace Ng <hor...@hkisl.net>; > ceph-users <ceph-users@lists.ceph.com> > *Subject:* Re: [ceph-users] Ceph + VMware + Single Thread Performance > > > > > > On Sun, Sep 4, 2016 at 4:48 PM, Nick Fisk <n...@fisk.me.uk> wrote: > >

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-11 Thread Nick Fisk
n...@fisk.me.uk <mailto:n...@fisk.me.uk> > Cc: Wilhelm Redbrake <w...@globe.de <mailto:w...@globe.de> >; Horace Ng <hor...@hkisl.net <mailto:hor...@hkisl.net> >; ceph-users <ceph-users@lists.ceph.com <mailto:ceph-users@lists.ceph.com> > Subject: Re: [ceph-use

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-11 Thread Alex Gorbachev
Ng <hor...@hkisl.net>; > ceph-users <ceph-users@lists.ceph.com> > *Subject:* Re: [ceph-users] Ceph + VMware + Single Thread Performance > > > > > > On Saturday, September 3, 2016, Alex Gorbachev <a...@iss-integration.com> > wrote: > > HI Nick, >

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-10 Thread Alex Gorbachev
e: > > From: Alex Gorbachev [mailto:a...@iss-integration.com] > Sent: 21 August 2016 15:27 > To: Wilhelm Redbrake <w...@globe.de> > Cc: n...@fisk.me.uk; Horace Ng <hor...@hkisl.net>; ceph-users > <ceph-users@lists.ceph.com> > Subject: Re: [ceph-users] Ceph + VM

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-04 Thread Nick Fisk
cvml','n...@fisk.me.uk');> ; Horace Ng <hor...@hkisl.net <javascript:_e(%7B%7D,'cvml','hor...@hkisl.net');> >; ceph-users <ceph-users@lists.ceph.com <javascript:_e(%7B%7D,'cvml','ceph-users@lists.ceph.com');> > Subject: Re: [ceph-users] Ceph + VMware + Single Thread P

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-03 Thread Alex Gorbachev
7B%7D,'cvml','n...@fisk.me.uk');>; >> Horace Ng <hor...@hkisl.net >> <javascript:_e(%7B%7D,'cvml','hor...@hkisl.net');>>; ceph-users < >> ceph-users@lists.ceph.com >> <javascript:_e(%7B%7D,'cvml','ceph-users@lists.ceph.com');>> >>

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-09-03 Thread Alex Gorbachev
gt;; ceph-users < > ceph-users@lists.ceph.com> > *Subject:* Re: [ceph-users] Ceph + VMware + Single Thread Performance > > > > > > On Sunday, August 21, 2016, Wilhelm Redbrake <w...@globe.de> wrote: > > Hi Nick, > i understand all of your technical improvements.

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-31 Thread Nick Fisk
From: w...@globe.de [mailto:w...@globe.de] Sent: 31 August 2016 08:56 To: n...@fisk.me.uk; 'Alex Gorbachev' <a...@iss-integration.com>; 'Horace Ng' <hor...@hkisl.net> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Nick, what do you think about Infiniband?

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-31 Thread Nick Fisk
From: w...@globe.de [mailto:w...@globe.de] Sent: 30 August 2016 18:40 To: n...@fisk.me.uk; 'Alex Gorbachev' <a...@iss-integration.com> Cc: 'Horace Ng' <hor...@hkisl.net> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Hi Nick, here are my answers a

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-22 Thread Christian Balzer
> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On > > > > Behalf Of Christian Balzer > > > > Sent: 21 August 2016 09:32 > > > > To: ceph-users <ceph-users@lists.ceph.com> > > > > Subject: Re: [ceph-users] Ceph + VMware +

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-22 Thread Nick Fisk
From: Alex Gorbachev [mailto:a...@iss-integration.com] Sent: 22 August 2016 20:30 To: Nick Fisk <n...@fisk.me.uk> Cc: Wilhelm Redbrake <w...@globe.de>; Horace Ng <hor...@hkisl.net>; ceph-users <ceph-users@lists.ceph.com> Subject: Re: [ceph-users] Ceph + VMware + S

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-22 Thread Nick Fisk
> -Original Message- > From: Christian Balzer [mailto:ch...@gol.com] > Sent: 22 August 2016 03:00 > To: 'ceph-users' <ceph-users@lists.ceph.com> > Cc: Nick Fisk <n...@fisk.me.uk> > Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance > >

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-22 Thread Alex Gorbachev
t; > Thanks for your very valuable info on analysis and hw build. > > > > Alex > > > > > > > Am 21.08.2016 um 09:31 schrieb Nick Fisk <n...@fisk.me.uk>: > > >> -Original Message- > >> From: Alex Gorbachev [mailto:a...

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Christian Balzer
that the "powersave" governor would default to. Christian > > > > Christian > > > > > Thanks - B > > > > > > On Sun, Aug 21, 2016 at 8:31 AM, Nick Fisk <n...@fisk.me.uk> wrote: > > > >> -Original Message- > >

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Nick Fisk
From: Alex Gorbachev [mailto:a...@iss-integration.com] Sent: 21 August 2016 15:27 To: Wilhelm Redbrake <w...@globe.de> Cc: n...@fisk.me.uk; Horace Ng <hor...@hkisl.net>; ceph-users <ceph-users@lists.ceph.com> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performan

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Alex Gorbachev
o:a...@iss-integration.com <javascript:;>] > >> Sent: 21 August 2016 04:15 > >> To: Nick Fisk <n...@fisk.me.uk <javascript:;>> > >> Cc: w...@globe.de <javascript:;>; Horace Ng <hor...@hkisl.net > <javascript:;>>; ceph-users <c

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Nick Fisk
schrieb Nick Fisk <n...@fisk.me.uk>: > > >> -Original Message- > >> From: Alex Gorbachev [mailto:a...@iss-integration.com] > >> Sent: 21 August 2016 04:15 > >> To: Nick Fisk <n...@fisk.me.uk> > >> Cc: w...@globe.de; Horace

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Christian Balzer
integration.com] > >> Sent: 21 August 2016 04:15 > >> To: Nick Fisk <n...@fisk.me.uk> > >> Cc: w...@globe.de; Horace Ng <hor...@hkisl.net>; ceph-users > >> <ceph-users@lists.ceph.com> > >> Subject: Re: [ceph-users] Ceph + VMware + Singl

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Brian ::
gt;> From: Alex Gorbachev [mailto:a...@iss-integration.com] >> Sent: 21 August 2016 04:15 >> To: Nick Fisk <n...@fisk.me.uk> >> Cc: w...@globe.de; Horace Ng <hor...@hkisl.net>; ceph-users >> <ceph-users@lists.ceph.com> >> Subject: Re: [ceph-users] C

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-21 Thread Nick Fisk
6 13:23 > >> To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> > >> Cc: ceph-users@lists.ceph.com > >> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance > >> > >> Okay and what is your plan now to speed up ? > > > > Now I

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-08-20 Thread Alex Gorbachev
14:17 schrieb Nick Fisk: >> >> -Original Message- >> >> From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf >> >> Of w...@globe.de >> >> Sent: 21 July 2016 13:04 >> >> To: n...@fisk.me.uk; 'Horace Ng' <hor

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
...@fisk.me.uk; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Okay that should be the answer... I think it would be great to use Intel P3700 1.6TB as bcache in the iscsi rbd client gateway nodes. caching device: Intel P3700 1.6TB backing device

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
: 21 July 2016 14:05 To: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance That can not be correct. Check it at your cluster with dstat as i said... You will see at every node parallel IO on every OSD and journal Am 21.07.16 um 15:02 schrieb

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
'Horace Ng' <hor...@hkisl.net> <javascript:_e(%7B%7D,'cvml','hor...@hkisl.net');> Cc: ceph-users@lists.ceph.com <javascript:_e(%7B%7D,'cvml','ceph-users@lists.ceph.com');> Subject: Re: [ceph-users] C

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
');>; 'Horace Ng' <hor...@hkisl.net> <javascript:_e(%7B%7D,'cvml','hor...@hkisl.net');> Cc: ceph-users@lists.ceph.com <javascript:_e(%7B%7D,'cvml','ceph-users@lists.ceph.com');> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Okay

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Jake Young
D,'cvml','w...@globe.de');>] > Sent: 21 July 2016 13:23 > To: n...@fisk.me.uk <javascript:_e(%7B%7D,'cvml','n...@fisk.me.uk');>; > 'Horace Ng' <hor...@hkisl.net> > <javascript:_e(%7B%7D,'cvml','hor...@hkisl.net');> > Cc: ceph-users@lists.ceph.com > <javascr

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
ge- > >> From: w...@globe.de [mailto:w...@globe.de] > >> Sent: 21 July 2016 13:23 > >> To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> > >> Cc: ceph-users@lists.ceph.com > >> Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance &g

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
: w...@globe.de [mailto:w...@globe.de] Sent: 21 July 2016 13:23 To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Okay and what is your plan now to speed up ? Now I have come up with a lower l

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
' <hor...@hkisl.net> Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Okay and what is your plan now to speed up ? Now I have come up with a lower latency hardware design, there is not much further improvement until persistent RBD c

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
From: Jake Young [mailto:jak3...@gmail.com] Sent: 21 July 2016 13:24 To: n...@fisk.me.uk; w...@globe.de Cc: Horace Ng <hor...@hkisl.net>; ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance My workaround to your single threaded performance

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
> -Original Message- > From: w...@globe.de [mailto:w...@globe.de] > Sent: 21 July 2016 13:23 > To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance > >

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Jake Young
gt; From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com > <javascript:;>] On Behalf Of Horace > > Sent: 21 July 2016 10:26 > > To: w...@globe.de <javascript:;> > > Cc: ceph-users@lists.ceph.com <javascript:;> > > Subject: Re: [ceph-users] Ceph + VMware + Sin

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
...@lists.ceph.com] On Behalf Of w...@globe.de Sent: 21 July 2016 13:04 To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Hi, hmm i think 200 MByte/s is really bad. Is your Cluster in production rig

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
> -Original Message- > From: ceph-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > w...@globe.de > Sent: 21 July 2016 13:04 > To: n...@fisk.me.uk; 'Horace Ng' <hor...@hkisl.net> > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Ce

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread w...@globe.de
Sent: 21 July 2016 10:26 To: w...@globe.de Cc: ceph-users@lists.ceph.com Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance Hi, Same here, I've read some blog saying that vmware will frequently verify the locking on VMFS over iSCSI, hence it will have much slower performance than

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Nick Fisk
-users [mailto:ceph-users-boun...@lists.ceph.com] On Behalf Of > Horace > Sent: 21 July 2016 10:26 > To: w...@globe.de > Cc: ceph-users@lists.ceph.com > Subject: Re: [ceph-users] Ceph + VMware + Single Thread Performance > > Hi, > > Same here, I've read some blog saying t

Re: [ceph-users] Ceph + VMware + Single Thread Performance

2016-07-21 Thread Horace
Hi, Same here, I've read some blog saying that vmware will frequently verify the locking on VMFS over iSCSI, hence it will have much slower performance than NFS (with different locking mechanism). Regards, Horace Ng - Original Message - From: w...@globe.de To: