On 2013/03/07 5:51 AM, "Nikolay Kvetsinski" wrote:
>Thanks mate, what you say makes sense. Anyway I`m dealing with different
>file sizes, varying from KBs to GBs. Luckily some of the files are
>grouped in folders, for example in folder /fs/X all files will be 9MB,
>which I`ll not stripe. In /fs/Y
;>
Cc: "mailto:lustre-discuss@lists.lustre.org>>"
mailto:lustre-discuss@lists.lustre.org>>
Subject: Re: [Lustre-discuss] Small files
Thanks mate, what you say makes sense. Anyway I`m dealing with different file
sizes, varying from KBs to GBs. Luckily some of the files are grouped in
Thanks mate, what you say makes sense. Anyway I`m dealing with different
file sizes, varying from KBs to GBs. Luckily some of the files are grouped
in folders, for example in folder /fs/X all files will be 9MB, which I`ll
not stripe. In /fs/Y all files will be GBs, which I`ll stripe among all
OSTs.
With a 1MB default stripe size, anything that is <1 MB is a "small" file. In
general, I would not stripe 10MB files across more than one OST (each).
Kevin
On Jul 3, 2013, at 3:11 AM, Nikolay Kvetsinski wrote:
> Hello again guys,
>
> I constantly read about that Lustre is not very good with
Hello again guys,
I constantly read about that Lustre is not very good with "small files".
However, there is no definition of small file in Lustre point of view.
Would you be able to draw some borders on what is considered to be a small
file , for example is a 10 MB considered a small file, and s
[ ... ]
> - will writing files that are smaller than the stripe_size and
> that are written to a fully striped directory create objects
> on more than 1 OST?
Let's say that in some previous discussion one of the Sun/CFS
people mentioned storing collections of small files into 'ext2'
image fil
On 2009-10-30, at 05:21, Arne Wiebalck wrote:
> We're currently experimenting with Lustre and small files (<=1MB)
> and some questions came to mind:
>
> - will writing files that are smaller than the stripe_size and that
> are written to a fully striped directory create objects on more
> than 1 O
Dear list,
We're currently experimenting with Lustre and small files (<=1MB)
and some questions came to mind:
- will writing files that are smaller than the stripe_size and that
are written to a fully striped directory create objects on more
than 1 OST?
- what would be the main options to t
