Re: [lustre-discuss] Frequency vs Cores for OSS/MDS processors

2019-07-05 Thread Simon Legrand
Thanks a lot for your advice. Beyond the fact that ZFS requires more 
ressources, is it a general rule to privilege frequency over cores for a MDS 
and inverse for the OSS? 

Simon 

> De: "Jeff Johnson" 
> À: "Simon Legrand" 
> Cc: "lustre-discuss" 
> Envoyé: Jeudi 4 Juillet 2019 22:43:21
> Objet: Re: [lustre-discuss] Frequency vs Cores for OSS/MDS processors

> If you only have those two processor models to choose from I’d do the 5217 for
> MDS and 5218 for OSS. If you were using ZFS for a backend definitely the 5218
> for the OSS. With ZFS your processors are also your RAID controller so you 
> have
> the disk i/o, parity calculation, checksums and ZFS threads on top of the
> Lustre i/o and OS processes.

> —Jeff

> On Thu, Jul 4, 2019 at 13:30 Simon Legrand < [ mailto:simon.legr...@inria.fr |
> simon.legr...@inria.fr ] > wrote:

>> Hello Jeff,

>> Thanks for your quick answer. We plan to use ldiskfs, but I would be 
>> interested
>> to know what could fit for zfs.

>> Simon

>>> De: "Jeff Johnson" < [ mailto:jeff.john...@aeoncomputing.com |
>>> jeff.john...@aeoncomputing.com ] >
>>> À: "Simon Legrand" < [ mailto:simon.legr...@inria.fr | 
>>> simon.legr...@inria.fr ]
>>> >
>>> Cc: "lustre-discuss" < [ mailto:lustre-discuss@lists.lustre.org |
>>> lustre-discuss@lists.lustre.org ] >
>>> Envoyé: Jeudi 4 Juillet 2019 20:40:40
>>> Objet: Re: [lustre-discuss] Frequency vs Cores for OSS/MDS processors

>>> Simon,

>>> Which backend do you plan on using? ldiskfs or zfs?

>>> —Jeff

>>> On Thu, Jul 4, 2019 at 10:41 Simon Legrand < [ 
>>> mailto:simon.legr...@inria.fr |
>>> simon.legr...@inria.fr ] > wrote:

>>>> Dear all,

>>>> We are currently configuring a Lustre filesystem and facing a dilemma. We 
>>>> have
>>>> the choice between two types of processors for an OSS and a MDS.
>>>> - Intel Xeon Gold 5217 3GHz, 11M Cache,10.40GT/s, 2UPI, Turbo, HT,8C/16T 
>>>> (115W)
>>>> - DDR4-2666
>>>> - Intel Xeon Gold 5218 2.3GHz, 22M Cache,10.40GT/s, 2UPI, Turbo, HT,16C/32T
>>>> (105W) - DDR4-2666

>>>> Basically, we have to choose between freequency and number of cores.
>>>> Our current architecture is the following:
>>>> - 1MDS with 11To SDD
>>>> - 3 OSS/OST (~ 3*80To)
>>>> Our final target is 6 OSS/OST with a single MDS.
>>>> Do anyone of you could help us to choose and explain us the reasons?

>>>> Best regards,

>>>> Simon
>>>> ___
>>>> lustre-discuss mailing list
>>>> [ mailto:lustre-discuss@lists.lustre.org | lustre-discuss@lists.lustre.org 
>>>> ]
>>>> [ http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org |
>>>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ]

>>> --
>>> --
>>> Jeff Johnson
>>> Co-Founder
>>> Aeon Computing

>>> [ mailto:jeff.john...@aeoncomputing.com | jeff.john...@aeoncomputing.com ]
>>> [ http://www.aeoncomputing.com/ | www.aeoncomputing.com ]
>>> t: 858-412-3810 x1001 f: 858-412-3845
>>> m: 619-204-9061

>>> [
>>> https://www.google.com/maps/search/4170+Morena+Boulevard,+Suite+C+-+San+Diego,+CA+92117?entry=gmail=g
>>> | 4170 Morena Boulevard, Suite C - San Diego, CA 92117 ]
>>> High-Performance Computing / Lustre Filesystems / Scale-out Storage

> --
> --
> Jeff Johnson
> Co-Founder
> Aeon Computing

> [ mailto:jeff.john...@aeoncomputing.com | jeff.john...@aeoncomputing.com ]
> [ http://www.aeoncomputing.com/ | www.aeoncomputing.com ]
> t: 858-412-3810 x1001 f: 858-412-3845
> m: 619-204-9061

> 4170 Morena Boulevard, Suite C - San Diego, CA 92117
> High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


Re: [lustre-discuss] Frequency vs Cores for OSS/MDS processors

2019-07-04 Thread Simon Legrand
Hello Jeff, 

Thanks for your quick answer. We plan to use ldiskfs, but I would be interested 
to know what could fit for zfs. 

Simon 

> De: "Jeff Johnson" 
> À: "Simon Legrand" 
> Cc: "lustre-discuss" 
> Envoyé: Jeudi 4 Juillet 2019 20:40:40
> Objet: Re: [lustre-discuss] Frequency vs Cores for OSS/MDS processors

> Simon,

> Which backend do you plan on using? ldiskfs or zfs?

> —Jeff

> On Thu, Jul 4, 2019 at 10:41 Simon Legrand < [ mailto:simon.legr...@inria.fr |
> simon.legr...@inria.fr ] > wrote:

>> Dear all,

>> We are currently configuring a Lustre filesystem and facing a dilemma. We 
>> have
>> the choice between two types of processors for an OSS and a MDS.
>> - Intel Xeon Gold 5217 3GHz, 11M Cache,10.40GT/s, 2UPI, Turbo, HT,8C/16T 
>> (115W)
>> - DDR4-2666
>> - Intel Xeon Gold 5218 2.3GHz, 22M Cache,10.40GT/s, 2UPI, Turbo, HT,16C/32T
>> (105W) - DDR4-2666

>> Basically, we have to choose between freequency and number of cores.
>> Our current architecture is the following:
>> - 1MDS with 11To SDD
>> - 3 OSS/OST (~ 3*80To)
>> Our final target is 6 OSS/OST with a single MDS.
>> Do anyone of you could help us to choose and explain us the reasons?

>> Best regards,

>> Simon
>> ___
>> lustre-discuss mailing list
>> [ mailto:lustre-discuss@lists.lustre.org | lustre-discuss@lists.lustre.org ]
>> [ http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org |
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org ]

> --
> --
> Jeff Johnson
> Co-Founder
> Aeon Computing

> [ mailto:jeff.john...@aeoncomputing.com | jeff.john...@aeoncomputing.com ]
> [ http://www.aeoncomputing.com/ | www.aeoncomputing.com ]
> t: 858-412-3810 x1001 f: 858-412-3845
> m: 619-204-9061

> 4170 Morena Boulevard, Suite C - San Diego, CA 92117
> High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org


[lustre-discuss] Frequency vs Cores for OSS/MDS processors

2019-07-04 Thread Simon Legrand
Dear all, 

We are currently configuring a Lustre filesystem and facing a dilemma. We have 
the choice between two types of processors for an OSS and a MDS. 
- Intel Xeon Gold 5217 3GHz, 11M Cache,10.40GT/s, 2UPI, Turbo, HT,8C/16T (115W) 
- DDR4-2666 
- Intel Xeon Gold 5218 2.3GHz, 22M Cache,10.40GT/s, 2UPI, Turbo, HT,16C/32T 
(105W) - DDR4-2666 

Basically, we have to choose between freequency and number of cores. 
Our current architecture is the following: 
- 1MDS with 11To SDD 
- 3 OSS/OST (~ 3*80To) 
Our final target is 6 OSS/OST with a single MDS. 
Do anyone of you could help us to choose and explain us the reasons? 

Best regards, 

Simon 
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org