Re: [lustre-discuss] Do I need Lustre?

2018-04-30 Thread Dilger, Andreas 
On Apr 30, 2018, at 07:11, Thackeray, Neil L  wrote:
> 
> Sorry, I left out file size. We don't foresee growing tremendously. The plan 
> is for researchers to upload their data, get the results, and copy it down to 
> a mounted file system. This is going to be used by multiple researchers, and 
> we will be charging for compute time. We really don't want this cluster to be 
> used for storing data outside of the time needed for their computations. We 
> may just start with 100TB of SSD storage.

One of the major benefits of Lustre is that it can be used directly for 
large-scale computing.  Having users copy data to/from Lustre is fairly 
inefficient (though surprisingly copying files to/from a direct Lustre mount 
can be faster than FTP or SCP or other network copy tools).

You'd be better off to increase the size of your Lustre filesystem, enough that 
users can store "projects" there for some time while they compute, rather than 
needing to move the data on/off the filesystem a lot.

While using an all-SSD filesystem is appealing, you might find better 
performance with some kind of hybrid storage, like ZFS + L2ARC + Metadata 
Allocation Class (this feature is in development, target 2018-09, depending on 
your timeframe).  

You definitely want your MDT(s) to be SSDs, especially if you use the new 
Data-on-MDT feature to store small files tehre.  The OSTs can be HDDs to give 
you a lot more capacity for the same price.

Cheers, Andreas

> -Original Message-
> From: lustre-discuss  On Behalf Of 
> Philippe Weill
> Sent: Saturday, April 28, 2018 1:14 AM
> To: lustre-discuss@lists.lustre.org
> Subject: Re: [lustre-discuss] Do I need Lustre?
> 
> 
> 
> Le 27/04/2018 à 19:07, Thackeray, Neil L a écrit :
>> I’m new to the cluster realm, so I’m hoping for some good advice. We 
>> are starting up a new cluster, and I’ve noticed that lustre seems to be used 
>> widely in datacenters. The thing is I’m not sure the scale of our cluster 
>> will need it.
>> 
>> We are planning a small cluster, starting with 6 -8 nodes with 2 GPUs 
>> per node. They will be used for Deep Learning, MRI data processing, 
>> and Matlab among other things. With the size of the cluster we figure 
>> that 10Gb networking will be sufficient. We aren’t going to allow persistent 
>> storage on the cluster. Users will just upload and download data. I’m mostly 
>> concerned about I/O speeds. I don’t know if NFS would be fast enough to 
>> handle the data.
>> 
>> We are hoping that the cluster will grow over time. We are already talking 
>> about buying more nodes next fiscal year.
>> 
>> Thanks.
>> 
> 
> hello
> 
> you didn't say anything about filesystem size needed and if you are thinking 
> to grow fast we also run a small cluster ( 20 nodes ) but for climate data 
> modeling results and satellite atmospheric data analysis we are growing at 
> least 300TB per year (2PB now) and it's easier for us to grow with lustre
> 
> 
> --
> Weill Philippe -  Administrateur Systeme et Reseaux
> CNRS/UPMC/IPSL   LATMOS (UMR 8190)
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Intel Corporation







___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Dilger, Andreas 
On Apr 30, 2018, at 11:49, Michael Di Domenico  wrote:
> 
> On Mon, Apr 30, 2018 at 10:09 AM, Jeff Johnson
>  wrote:
>> RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off the
>> top of my head is to git clone and build a 2.10.4 prerelease and live on the
>> bleeding edge. I’m not sure if all of the 7.5 work is finished in the
>> current prerelease or not.
> 
> argh...  not sure i want to be that bleeding edge...  sadly, i can't
> find a release schedule for 2.10.4.  i wonder if 2.11 will work

You are free to do what you want, but I'd think 2.10.4 is far less "bleeding 
edge" than 2.11 compared to 2.10.2.  The 2.10.x branch only gets bug fixes, 
while significant new features are being added to 2.11.

Cheers, Andreas

>> On Mon, Apr 30, 2018 at 06:21 Michael Di Domenico 
>> wrote:
>>> 
>>> On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico
>>>  wrote:
 when i tried to compile 2.10.2 patchless client into rpms under rhel
 7.5 using kernel 3.10.0-862.el7.x86_64
 
 the compilation went fine as far as i can tell and the rpm creation
 seemed to work
 
 but when i went install the rpms i got
 
 Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
 (/kmod-lustre-client-2.10.2-1.el7.x86_64
 requires: kernel < 3.10.0-694
>>> 
>>> premature send...
>>> 
>>> requires: kernel < 3.10.0-694
>>> Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)
>>> 
>>> did i do something wrong in the recompile of the rpms for the target
>>> kernel or is there a workaround for this?
>>> ___
>>> lustre-discuss mailing list
>>> lustre-discuss@lists.lustre.org
>>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>> 
>> --
>> --
>> Jeff Johnson
>> Co-Founder
>> Aeon Computing
>> 
>> jeff.john...@aeoncomputing.com
>> www.aeoncomputing.com
>> t: 858-412-3810 x1001   f: 858-412-3845
>> m: 619-204-9061
>> 
>> 4170 Morena Boulevard, Suite D - San Diego, CA 92117
>> 
>> High-Performance Computing / Lustre Filesystems / Scale-out Storage
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Cheers, Andreas
--
Andreas Dilger
Lustre Principal Architect
Intel Corporation







___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Leonardo Saavedra 

On 04/30/2018 11:49 AM, Michael Di Domenico wrote:

On Mon, Apr 30, 2018 at 10:09 AM, Jeff Johnson
 wrote:

RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off the
top of my head is to git clone and build a 2.10.4 prerelease and live on the
bleeding edge. I’m not sure if all of the 7.5 work is finished in the
current prerelease or not.

argh...  not sure i want to be that bleeding edge...  sadly, i can't
find a release schedule for 2.10.4.  i wonder if 2.11 will work


It won't work, but there are two workaround, you can boot your computer 
with 7.4 kernel series (3.10.0-693.XXX) or you can run 2.11.0 client:


[lsaavedr@picard ~]$ rpm -q lustre-client
lustre-client-2.11.0-1.el7.x86_64
[lsaavedr@picard ~]$ uname -a
Linux picard 3.10.0-862.el7.x86_64 #1 SMP Wed Mar 21 18:14:51 EDT 2018 
x86_64 x86_64 x86_64 GNU/Linux

[lsaavedr@picard ~]$ cd /lustre/aoc/users/lsaavedr
[lsaavedr@picard /lustre/aoc/users/lsaavedr]$ echo lala > file
[lsaavedr@picard /lustre/aoc/users/lsaavedr]$ df -Th .
Filesystem  Type    Size  Used Avail Use% Mounted on
192.168.1.30@o2ib:/aoclst03 lustre  1.6P  1.4P  217T  87% /lustre/aoc
[lsaavedr@picard /lustre/aoc/users/lsaavedr]$ ls -l file
-rw-r- 1 lsaavedr nmstaff 5 Apr 30 13:39 file



--

Leo Saavedra
National Radio Astronomy Observatory
+1-575-8357033

___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Jeff Johnson 
The ChangeLog in 2.11.59 doesn’t mention a 7.5 server kernel. You can
reference lustre/ChangeLog in the various tags in the Lustre git repo.

The official support matrix is here:
https://wiki.hpdd.intel.com/plugins/servlet/mobile?contentId=8126580#content/view/8126580

—Jeff

On Mon, Apr 30, 2018 at 11:01 Hebenstreit, Michael <
michael.hebenstr...@intel.com> wrote:

> I have 2.11 already running on a 7.5 clone (client only)
>
> -Original Message-
> From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On
> Behalf Of Michael Di Domenico
> Sent: Monday, April 30, 2018 11:49 AM
> Cc: lustre-discuss 
> Subject: Re: [lustre-discuss] rhel 7.5
>
> On Mon, Apr 30, 2018 at 10:09 AM, Jeff Johnson <
> jeff.john...@aeoncomputing.com> wrote:
> > RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off
> > the top of my head is to git clone and build a 2.10.4 prerelease and
> > live on the bleeding edge. I’m not sure if all of the 7.5 work is
> > finished in the current prerelease or not.
>
> argh...  not sure i want to be that bleeding edge...  sadly, i can't find
> a release schedule for 2.10.4.  i wonder if 2.11 will work
>
>
>
> > —Jeff
> >
> > On Mon, Apr 30, 2018 at 06:21 Michael Di Domenico
> > 
> > wrote:
> >>
> >> On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico
> >>  wrote:
> >> > when i tried to compile 2.10.2 patchless client into rpms under
> >> > rhel
> >> > 7.5 using kernel 3.10.0-862.el7.x86_64
> >> >
> >> > the compilation went fine as far as i can tell and the rpm creation
> >> > seemed to work
> >> >
> >> > but when i went install the rpms i got
> >> >
> >> > Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
> >> > (/kmod-lustre-client-2.10.2-1.el7.x86_64
> >> > requires: kernel < 3.10.0-694
> >>
> >> premature send...
> >>
> >> requires: kernel < 3.10.0-694
> >> Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)
> >>
> >> did i do something wrong in the recompile of the rpms for the target
> >> kernel or is there a workaround for this?
> >> ___
> >> lustre-discuss mailing list
> >> lustre-discuss@lists.lustre.org
> >> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> >
> > --
> > --
> > Jeff Johnson
> > Co-Founder
> > Aeon Computing
> >
> > jeff.john...@aeoncomputing.com
> > www.aeoncomputing.com
> > t: 858-412-3810 x1001   f: 858-412-3845
> > m: 619-204-9061
> >
> > 4170 Morena Boulevard, Suite D - San Diego, CA 92117
> >
> > High-Performance Computing / Lustre Filesystems / Scale-out Storage
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
-- 
--
Jeff Johnson
Co-Founder
Aeon Computing

jeff.john...@aeoncomputing.com
www.aeoncomputing.com
t: 858-412-3810 x1001   f: 858-412-3845
m: 619-204-9061

4170 Morena Boulevard, Suite D - San Diego, CA 92117

High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Do I need Lustre?

2018-04-30 Thread Colin Faber 
The type of storage you decide on should be a factor of the workloads that
you plan on executing against, as well as the back-end storage systems.
Having all SSD based file systems can be useful in the case of small /
random IO however in many cases the controllers will not be able to take
advantage of the performance provided by the SSD array

 As a result you end up paying a whole lot more for a whole lot less space
and ending up with the same overall performance.

On Mon, Apr 30, 2018, 7:11 AM Thackeray, Neil L  wrote:

> Sorry, I left out file size. We don't foresee growing tremendously. The
> plan is for researchers to upload their data, get the results, and copy it
> down to a mounted file system. This is going to be used by multiple
> researchers, and we will be charging for compute time. We really don't want
> this cluster to be used for storing data outside of the time needed for
> their computations. We may just start with 100TB of SSD storage.
>
> -Original Message-
> From: lustre-discuss  On Behalf
> Of Philippe Weill
> Sent: Saturday, April 28, 2018 1:14 AM
> To: lustre-discuss@lists.lustre.org
> Subject: Re: [lustre-discuss] Do I need Lustre?
>
>
>
> Le 27/04/2018 à 19:07, Thackeray, Neil L a écrit :
> > I’m new to the cluster realm, so I’m hoping for some good advice. We
> > are starting up a new cluster, and I’ve noticed that lustre seems to be
> used widely in datacenters. The thing is I’m not sure the scale of our
> cluster will need it.
> >
> > We are planning a small cluster, starting with 6 -8 nodes with 2 GPUs
> > per node. They will be used for Deep Learning, MRI data processing,
> > and Matlab among other things. With the size of the cluster we figure
> > that 10Gb networking will be sufficient. We aren’t going to allow
> persistent storage on the cluster. Users will just upload and download
> data. I’m mostly concerned about I/O speeds. I don’t know if NFS would be
> fast enough to handle the data.
> >
> > We are hoping that the cluster will grow over time. We are already
> talking about buying more nodes next fiscal year.
> >
> > Thanks.
> >
>
> hello
>
> you didn't say anything about filesystem size needed and if you are
> thinking to grow fast we also run a small cluster ( 20 nodes ) but for
> climate data modeling results and satellite atmospheric data analysis we
> are growing at least 300TB per year (2PB now) and it's easier for us to
> grow with lustre
>
>
> --
> Weill Philippe -  Administrateur Systeme et Reseaux
> CNRS/UPMC/IPSL   LATMOS (UMR 8190)
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Hebenstreit, Michael 
I have 2.11 already running on a 7.5 clone (client only)

-Original Message-
From: lustre-discuss [mailto:lustre-discuss-boun...@lists.lustre.org] On Behalf 
Of Michael Di Domenico
Sent: Monday, April 30, 2018 11:49 AM
Cc: lustre-discuss 
Subject: Re: [lustre-discuss] rhel 7.5

On Mon, Apr 30, 2018 at 10:09 AM, Jeff Johnson  
wrote:
> RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off 
> the top of my head is to git clone and build a 2.10.4 prerelease and 
> live on the bleeding edge. I’m not sure if all of the 7.5 work is 
> finished in the current prerelease or not.

argh...  not sure i want to be that bleeding edge...  sadly, i can't find a 
release schedule for 2.10.4.  i wonder if 2.11 will work



> —Jeff
>
> On Mon, Apr 30, 2018 at 06:21 Michael Di Domenico 
> 
> wrote:
>>
>> On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico 
>>  wrote:
>> > when i tried to compile 2.10.2 patchless client into rpms under 
>> > rhel
>> > 7.5 using kernel 3.10.0-862.el7.x86_64
>> >
>> > the compilation went fine as far as i can tell and the rpm creation 
>> > seemed to work
>> >
>> > but when i went install the rpms i got
>> >
>> > Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
>> > (/kmod-lustre-client-2.10.2-1.el7.x86_64
>> > requires: kernel < 3.10.0-694
>>
>> premature send...
>>
>> requires: kernel < 3.10.0-694
>> Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)
>>
>> did i do something wrong in the recompile of the rpms for the target 
>> kernel or is there a workaround for this?
>> ___
>> lustre-discuss mailing list
>> lustre-discuss@lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
> --
> --
> Jeff Johnson
> Co-Founder
> Aeon Computing
>
> jeff.john...@aeoncomputing.com
> www.aeoncomputing.com
> t: 858-412-3810 x1001   f: 858-412-3845
> m: 619-204-9061
>
> 4170 Morena Boulevard, Suite D - San Diego, CA 92117
>
> High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Michael Di Domenico 
On Mon, Apr 30, 2018 at 10:09 AM, Jeff Johnson
 wrote:
> RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off the
> top of my head is to git clone and build a 2.10.4 prerelease and live on the
> bleeding edge. I’m not sure if all of the 7.5 work is finished in the
> current prerelease or not.

argh...  not sure i want to be that bleeding edge...  sadly, i can't
find a release schedule for 2.10.4.  i wonder if 2.11 will work



> —Jeff
>
> On Mon, Apr 30, 2018 at 06:21 Michael Di Domenico 
> wrote:
>>
>> On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico
>>  wrote:
>> > when i tried to compile 2.10.2 patchless client into rpms under rhel
>> > 7.5 using kernel 3.10.0-862.el7.x86_64
>> >
>> > the compilation went fine as far as i can tell and the rpm creation
>> > seemed to work
>> >
>> > but when i went install the rpms i got
>> >
>> > Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
>> > (/kmod-lustre-client-2.10.2-1.el7.x86_64
>> > requires: kernel < 3.10.0-694
>>
>> premature send...
>>
>> requires: kernel < 3.10.0-694
>> Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)
>>
>> did i do something wrong in the recompile of the rpms for the target
>> kernel or is there a workaround for this?
>> ___
>> lustre-discuss mailing list
>> lustre-discuss@lists.lustre.org
>> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
> --
> --
> Jeff Johnson
> Co-Founder
> Aeon Computing
>
> jeff.john...@aeoncomputing.com
> www.aeoncomputing.com
> t: 858-412-3810 x1001   f: 858-412-3845
> m: 619-204-9061
>
> 4170 Morena Boulevard, Suite D - San Diego, CA 92117
>
> High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Jeff Johnson 
RHEL 7.5 support comes in Lustre 2.10.4. Only path I can think of off the
top of my head is to git clone and build a 2.10.4 prerelease and live on
the bleeding edge. I’m not sure if all of the 7.5 work is finished in the
current prerelease or not.

—Jeff

On Mon, Apr 30, 2018 at 06:21 Michael Di Domenico 
wrote:

> On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico
>  wrote:
> > when i tried to compile 2.10.2 patchless client into rpms under rhel
> > 7.5 using kernel 3.10.0-862.el7.x86_64
> >
> > the compilation went fine as far as i can tell and the rpm creation
> > seemed to work
> >
> > but when i went install the rpms i got
> >
> > Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
> > (/kmod-lustre-client-2.10.2-1.el7.x86_64
> > requires: kernel < 3.10.0-694
>
> premature send...
>
> requires: kernel < 3.10.0-694
> Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)
>
> did i do something wrong in the recompile of the rpms for the target
> kernel or is there a workaround for this?
> ___
> lustre-discuss mailing list
> lustre-discuss@lists.lustre.org
> http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
>
-- 
--
Jeff Johnson
Co-Founder
Aeon Computing

jeff.john...@aeoncomputing.com
www.aeoncomputing.com
t: 858-412-3810 x1001   f: 858-412-3845
m: 619-204-9061

4170 Morena Boulevard, Suite D - San Diego, CA 92117

High-Performance Computing / Lustre Filesystems / Scale-out Storage
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] rhel 7.5

2018-04-30 Thread Michael Di Domenico 
On Mon, Apr 30, 2018 at 9:19 AM, Michael Di Domenico
 wrote:
> when i tried to compile 2.10.2 patchless client into rpms under rhel
> 7.5 using kernel 3.10.0-862.el7.x86_64
>
> the compilation went fine as far as i can tell and the rpm creation
> seemed to work
>
> but when i went install the rpms i got
>
> Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
> (/kmod-lustre-client-2.10.2-1.el7.x86_64
> requires: kernel < 3.10.0-694

premature send...

requires: kernel < 3.10.0-694
Installed: kernel-3.10.0-862.el7.x86_64 (@updates/7.5)

did i do something wrong in the recompile of the rpms for the target
kernel or is there a workaround for this?
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

[lustre-discuss] rhel 7.5

2018-04-30 Thread Michael Di Domenico 
when i tried to compile 2.10.2 patchless client into rpms under rhel
7.5 using kernel 3.10.0-862.el7.x86_64

the compilation went fine as far as i can tell and the rpm creation
seemed to work

but when i went install the rpms i got

Error: Package: kmod-lustre-client-2.10.2-1.el7.x86_64
(/kmod-lustre-client-2.10.2-1.el7.x86_64
requires: kernel < 3.10.0-694
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org

Re: [lustre-discuss] Do I need Lustre?

2018-04-30 Thread Thackeray, Neil L 
Sorry, I left out file size. We don't foresee growing tremendously. The plan is 
for researchers to upload their data, get the results, and copy it down to a 
mounted file system. This is going to be used by multiple researchers, and we 
will be charging for compute time. We really don't want this cluster to be used 
for storing data outside of the time needed for their computations. We may just 
start with 100TB of SSD storage.

-Original Message-
From: lustre-discuss  On Behalf Of 
Philippe Weill
Sent: Saturday, April 28, 2018 1:14 AM
To: lustre-discuss@lists.lustre.org
Subject: Re: [lustre-discuss] Do I need Lustre?



Le 27/04/2018 à 19:07, Thackeray, Neil L a écrit :
> I’m new to the cluster realm, so I’m hoping for some good advice. We 
> are starting up a new cluster, and I’ve noticed that lustre seems to be used 
> widely in datacenters. The thing is I’m not sure the scale of our cluster 
> will need it.
> 
> We are planning a small cluster, starting with 6 -8 nodes with 2 GPUs 
> per node. They will be used for Deep Learning, MRI data processing, 
> and Matlab among other things. With the size of the cluster we figure 
> that 10Gb networking will be sufficient. We aren’t going to allow persistent 
> storage on the cluster. Users will just upload and download data. I’m mostly 
> concerned about I/O speeds. I don’t know if NFS would be fast enough to 
> handle the data.
> 
> We are hoping that the cluster will grow over time. We are already talking 
> about buying more nodes next fiscal year.
> 
> Thanks.
> 

hello

you didn't say anything about filesystem size needed and if you are thinking to 
grow fast we also run a small cluster ( 20 nodes ) but for climate data 
modeling results and satellite atmospheric data analysis we are growing at 
least 300TB per year (2PB now) and it's easier for us to grow with lustre


--
Weill Philippe -  Administrateur Systeme et Reseaux
CNRS/UPMC/IPSL   LATMOS (UMR 8190)
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org
___
lustre-discuss mailing list
lustre-discuss@lists.lustre.org
http://lists.lustre.org/listinfo.cgi/lustre-discuss-lustre.org