4-769-8938
cel. 734-216-5309
- Original Message -
> From: "Daniel Gryniewicz"
> To: "Ceph Development"
> Sent: Thursday, September 3, 2015 9:06:47 AM
> Subject: Re: Ceph Hackathon: More Memory Allocator Testing
>
> I believe preloading should work
-
> From: "Somnath Roy"
> To: "Alexandre DERUMIER"
> Cc: "Sage Weil" , "Milosz Tanski" ,
> "Shishir Gowda" , "Stefan Priebe"
> , "Mark Nelson" , "ceph-devel"
>
> Sent: Sunday, August 23, 2015 2
quot;
, "Mark Nelson" , "ceph-devel"
Sent: Sunday, August 23, 2015 2:03:41 AM
Subject: RE: Ceph Hackathon: More Memory Allocator Testing
Need to see if client is overriding the libraries built with different malloc
libraries I guess..
I am not sure in your case the benefit
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256
Probably possible. The question is if it would it be worth the extra
logic. It seems a lot more complicated than an include line. I don't
know if you would have to use introspection or if you could assume
that functions exist.
https://en.m.wikipedia
y
Cc: Sage Weil; Milosz Tanski; Shishir Gowda; Stefan Priebe; Mark Nelson;
ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
>>I am not sure in your case the benefit you are seeing is because of qemu is
>>more efficient with tcmalloc/jemalloc or the entire client s
"Stefan Priebe"
, "Mark Nelson" , "ceph-devel"
Envoyé: Samedi 22 Août 2015 19:03:41
Objet: RE: Ceph Hackathon: More Memory Allocator Testing
Need to see if client is overriding the libraries built with different malloc
libraries I guess..
I am not sure in your
[mailto:aderum...@odiso.com]
Sent: Saturday, August 22, 2015 9:57 AM
To: Somnath Roy
Cc: Sage Weil; Milosz Tanski; Shishir Gowda; Stefan Priebe; Mark Nelson;
ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
>>Wanted to know is there any reason we didn't link clien
-
De: "Somnath Roy"
À: "Sage Weil" , "Milosz Tanski"
Cc: "Shishir Gowda" , "Stefan Priebe"
, "aderumier" , "Mark Nelson"
, "ceph-devel"
Envoyé: Samedi 22 Août 2015 18:15:36
Objet: RE: Ceph Hackathon: More Memory
& Regards
Somnath
-Original Message-
From: Sage Weil [mailto:s...@newdream.net]
Sent: Saturday, August 22, 2015 6:56 AM
To: Milosz Tanski
Cc: Shishir Gowda; Somnath Roy; Stefan Priebe; Alexandre DERUMIER; Mark Nelson;
ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
On Fri, 21 Aug 2015, Milosz Tanski wrote:
> On Fri, Aug 21, 2015 at 12:22 AM, Shishir Gowda
> wrote:
> > Hi All,
> >
> > Have sent out a pull request which enables building librados/librbd with
> > either tcmalloc(as default) or jemalloc.
> >
> > Please find the pull request @ https://github.com
s that will be linked in by other external applications should
> > not have a 3rd party malloc linked in there. That seams like an
> > application choice. At the very least the default should not be to
> > link in a 3rd party malloc.
> >
> >>
> >>> -Orig
d not be to
> link in a 3rd party malloc.
>
>>
>>> -Original Message-
>>> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
>>> ow...@vger.kernel.org] On Behalf Of Somnath Roy
>>> Sent: Thursday, August 20, 2015 2:14 AM
>>> To:
be [mailto:s.pri...@profihost.ag]
>> Sent: Wednesday, August 19, 2015 1:41 PM
>> To: Somnath Roy; Alexandre DERUMIER; Mark Nelson
>> Cc: ceph-devel
>> Subject: Re: Ceph Hackathon: More Memory Allocator Testing
>>
>>
>> Am 19.08.2015 um 22:34 schrieb Somnath Roy:
el.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Somnath Roy
> Sent: Thursday, August 20, 2015 2:14 AM
> To: Stefan Priebe; Alexandre DERUMIER; Mark Nelson
> Cc: ceph-devel
> Subject: RE: Ceph Hackathon: More Memory Allocator Testing
>
> Yeah , I can see ceph-osd/c
el.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Somnath Roy
> Sent: Thursday, August 20, 2015 2:14 AM
> To: Stefan Priebe; Alexandre DERUMIER; Mark Nelson
> Cc: ceph-devel
> Subject: RE: Ceph Hackathon: More Memory Allocator Testing
>
> Yeah , I can see ceph-osd/c
-
> From: "Shinobu Kinjo"
> To: "Alexandre DERUMIER"
> Cc: "Stephen L Blinick" , "Somnath Roy"
> , "Mark Nelson"
> , "ceph-devel"
> Sent: Thursday, August 20, 2015 8:54:59 AM
> Subject: Re: Ceph Hackathon: More Mem
; , "ceph-devel"
Sent: Thursday, August 20, 2015 5:17:46 PM
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
memory results of osd daemon under load,
jemalloc use always more memory than tcmalloc,
jemalloc 4.0 seem to reduce memory usage but still a littl
À: "Stephen L Blinick"
Cc: "aderumier" , "Somnath Roy" ,
"Mark Nelson" , "ceph-devel"
Envoyé: Jeudi 20 Août 2015 04:00:15
Objet: Re: Ceph Hackathon: More Memory Allocator Testing
How about making any sheet for testing patter?
Shinobu
- Or
> -Original Message-
> From: Haomai Wang [mailto:haomaiw...@gmail.com]
> Sent: Thursday, August 20, 2015 9:09 AM
>
> > And it takes me just a few minutes with rados bench to reproduce this
> issue on mixed-storage node (SSDs, SAS disks, high-capacity SATA disks, etc).
> > See here: http://c
On Thu, Aug 20, 2015 at 2:35 PM, Dałek, Piotr
wrote:
>> -Original Message-
>> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
>> ow...@vger.kernel.org] On Behalf Of Blinick, Stephen L
>> Sent: Wednesday, August 19, 2015 6:58 PM
>>
>> [..
>> Regarding the all-HDD or high density
> -Original Message-
> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Blinick, Stephen L
> Sent: Wednesday, August 19, 2015 6:58 PM
>
> [..
> Regarding the all-HDD or high density HDD nodes, is it certain these issues
> with tcmalloc don't
> -Original Message-
> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Allen Samuels
> Sent: Wednesday, August 19, 2015 8:20 PM
> It was a surprising result that the memory allocator is making such a large
> difference in performance. All of
nath Roy" ,
"Mark Nelson" , "ceph-devel"
Envoyé: Jeudi 20 Août 2015 04:00:15
Objet: Re: Ceph Hackathon: More Memory Allocator Testing
How about making any sheet for testing patter?
Shinobu
- Original Message -
From: "Stephen L Blinick"
To: "Alexandre
How about making any sheet for testing patter?
Shinobu
- Original Message -
From: "Stephen L Blinick"
To: "Alexandre DERUMIER" , "Somnath Roy"
Cc: "Mark Nelson" , "ceph-devel"
Sent: Thursday, August 20, 2015 10:09:36 AM
Subject:
Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Alexandre DERUMIER
Sent: Wednesday, August 19, 2015 11:47 AM
To: Somnath Roy
Cc: Mark Nelson; ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
Just have do
-devel
Subject: Ceph Hackathon: More Memory Allocator Testing
Hi Everyone,
One of the goals at the Ceph Hackathon last week was to examine how to improve
Ceph Small IO performance. Jian Zhang presented findings showing a dramatic
improvement in small random IO performance when Ceph is used with
inst libjemalloc for me.
Stefan
> -Original Message-
> From: Stefan Priebe [mailto:s.pri...@profihost.ag]
> Sent: Wednesday, August 19, 2015 1:31 PM
> To: Somnath Roy; Alexandre DERUMIER; Mark Nelson
> Cc: ceph-devel
> Subject: Re: Ceph Hackathon: More Memory Allocator Te
nal Message-
From: Stefan Priebe [mailto:s.pri...@profihost.ag]
Sent: Wednesday, August 19, 2015 1:31 PM
To: Somnath Roy; Alexandre DERUMIER; Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
Am 19.08.2015 um 22:29 schrieb Somnath Roy:
Hmm...We need to fix
: Wednesday, August 19, 2015 1:31 PM
To: Somnath Roy; Alexandre DERUMIER; Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
Am 19.08.2015 um 22:29 schrieb Somnath Roy:
> Hmm...We need to fix that as part of configure/Makefile I guess (?)..
> Since we hav
brbd/librados with jemalloc ?
Thanks & Regards
Somnath
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Alexandre
DERUMIER
Sent: Wednesday, August 19, 2015 7:01 AM
To: Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackatho
Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
Am 19.08.2015 um 22:16 schrieb Somnath Roy:
> Alexandre,
> I am not able to build librados/librbd by using the following config option.
>
> ./configure –without-tcmalloc –with-jemalloc
Same issu
omnath
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Alexandre DERUMIER
Sent: Wednesday, August 19, 2015 7:01 AM
To: Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
Thanks Marc,
Results ar
ctly same behaviour client librbd side, with
qemu and multiple iothreads.
Switching both server and client to jemalloc give me best performance on small
read currently.
- Mail original -
De: "Mark Nelson"
À: "ceph-devel"
Envoyé: Mercredi 19 Août 2015 06:45:36
Obj
e Memory Allocator Testing
>>
>> Yes, it should be 1 per OSD...
>> There is no doubt that TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES is relative
>> to the number of threads running..
>> But, I don't know if number of threads is a factor for jema
under load.
- Mail original -
De: "Somnath Roy"
À: "aderumier"
Cc: "Mark Nelson" , "ceph-devel"
Envoyé: Mercredi 19 Août 2015 19:29:56
Objet: RE: Ceph Hackathon: More Memory Allocator Testing
Yes, it should be 1 per OSD...
There is no doubt
nel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Somnath Roy
Sent: Wednesday, August 19, 2015 10:30 AM
To: Alexandre DERUMIER
Cc: Mark Nelson; ceph-devel
Subject: RE: Ceph Hackathon: More Memory Allocator Testing
Yes, it should be 1 per OSD...
There is no doubt that TCMALLOC_MAX_TOTAL_THR
th Roy
Sent: Wednesday, August 19, 2015 10:30 AM
To: Alexandre DERUMIER
Cc: Mark Nelson; ceph-devel
Subject: RE: Ceph Hackathon: More Memory Allocator Testing
Yes, it should be 1 per OSD...
There is no doubt that TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES is relative to the
number of threads running..
DERUMIER [mailto:aderum...@odiso.com]
Sent: Wednesday, August 19, 2015 9:55 AM
To: Somnath Roy
Cc: Mark Nelson; ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
<< I think that tcmalloc have a fixed size
(TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES), and share it between all process.
Alexandre DERUMIER
Sent: Wednesday, August 19, 2015 9:55 AM
To: Somnath Roy
Cc: Mark Nelson; ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
<< I think that tcmalloc have a fixed size
(TCMALLOC_MAX_TOTAL_THREAD_CACHE_BYTES), and share it between all process.
>>I thin
irectly. (can
reproduce 100%).
Like the thread_cache size is divide by number of threads?
- Mail original -
De: "Somnath Roy"
À: "aderumier" , "Mark Nelson"
Cc: "ceph-devel"
Envoyé: Mercredi 19 Août 2015 18:27:30
Objet: RE: Ceph Hackathon: More
Thanks & Regards
Somnath
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Alexandre DERUMIER
Sent: Wednesday, August 19, 2015 9:06 AM
To: Mark Nelson
Cc: ceph-devel
Subject: Re: Ceph Hackathon: More Memory Allocator Test
side, with
qemu and multiple iothreads.
Switching both server and client to jemalloc give me best performance on small
read currently.
- Mail original -
De: "Mark Nelson"
À: "ceph-devel"
Envoyé: Mercredi 19 Août 2015 06:45:36
Objet: Ceph Hackathon: Mor
server and client to jemalloc give me best performance on small
read currently.
- Mail original -
De: "Mark Nelson"
À: "ceph-devel"
Envoyé: Mercredi 19 Août 2015 06:45:36
Objet: Ceph Hackathon: More Memory Allocator Testing
Hi Everyone,
One of the goals at the
> -Original Message-
> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Mark Nelson
> Sent: Wednesday, August 19, 2015 2:45 PM
>
> > Have you tried running these tests again with TCMalloc after applying
> patches from https://github.com/ceph/c
On 08/19/2015 07:36 AM, Dałek, Piotr wrote:
-Original Message-
From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
ow...@vger.kernel.org] On Behalf Of Mark Nelson
Sent: Wednesday, August 19, 2015 2:17 PM
The RSS memory usage in the report is per OSD I guess(really?). It
can't be
> -Original Message-
> From: ceph-devel-ow...@vger.kernel.org [mailto:ceph-devel-
> ow...@vger.kernel.org] On Behalf Of Mark Nelson
> Sent: Wednesday, August 19, 2015 2:17 PM
>
> > The RSS memory usage in the report is per OSD I guess(really?). It
> > can't be ignored since it's really a g
Nope! So in this case it's just server side.
On 08/19/2015 01:33 AM, Stefan Priebe - Profihost AG wrote:
Thanks for sharing. Do those tests use jemalloc for fio too? Otherwise
librbd on client side is running with tcmalloc again.
Stefan
Am 19.08.2015 um 06:45 schrieb Mark Nelson:
Hi Everyon
k we
probably need to run the tests.
Thanks & Regards
Somnath
-Original Message-
From: ceph-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Mark Nelson
Sent: Tuesday, August 18, 2015 9:46 PM
To: ceph-devel
Subject: Ceph Hackathon: More Memory Alloc
-devel-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Mark Nelson
Sent: Tuesday, August 18, 2015 9:46 PM
To: ceph-devel
Subject: Ceph Hackathon: More Memory Allocator Testing
Hi Everyone,
One of the goals at the Ceph Hackathon last week was to examine how to improve
C
yes, that's true.
- Original Message -
From: "Haomai Wang"
To: "Somnath Roy"
Cc: "Mark Nelson" , "ceph-devel"
Sent: Wednesday, August 19, 2015 5:07:53 PM
Subject: Re: Ceph Hackathon: More Memory Allocator Testing
On Wed, Aug 19, 2015 at
el-ow...@vger.kernel.org] On Behalf Of Mark Nelson
> Sent: Tuesday, August 18, 2015 9:46 PM
> To: ceph-devel
> Subject: Ceph Hackathon: More Memory Allocator Testing
>
> Hi Everyone,
>
> One of the goals at the Ceph Hackathon last week was to examine how to
> improve Ceph
Thanks for sharing. Do those tests use jemalloc for fio too? Otherwise
librbd on client side is running with tcmalloc again.
Stefan
Am 19.08.2015 um 06:45 schrieb Mark Nelson:
> Hi Everyone,
>
> One of the goals at the Ceph Hackathon last week was to examine how to
> improve Ceph Small IO perfo
l-ow...@vger.kernel.org
[mailto:ceph-devel-ow...@vger.kernel.org] On Behalf Of Mark Nelson
Sent: Tuesday, August 18, 2015 9:46 PM
To: ceph-devel
Subject: Ceph Hackathon: More Memory Allocator Testing
Hi Everyone,
One of the goals at the Ceph Hackathon last week was to examine how to improve
Ceph Smal
Thank you.
That's pretty interesting to me.
Shinobu
- Original Message -
From: "Mark Nelson"
To: "ceph-devel"
Sent: Wednesday, August 19, 2015 1:45:36 PM
Subject: Ceph Hackathon: More Memory Allocator Testing
Hi Everyone,
One of the goals at the Ceph H
Hi Everyone,
One of the goals at the Ceph Hackathon last week was to examine how to
improve Ceph Small IO performance. Jian Zhang presented findings
showing a dramatic improvement in small random IO performance when Ceph
is used with jemalloc. His results build upon Sandisk's original
findi
55 matches
Mail list logo
