Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-15 Thread Mike Selway
alotti [mailto:kilian.cavalotti.w...@gmail.com] > Sent: Wednesday, January 14, 2015 8:56 PM > To: Dilger, Andreas > Cc: Mike Selway; lustre-discuss@lists.lustre.org > Subject: Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre > file > system > > Hi all,

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-15 Thread Mohr Jr, Richard Frank (Rick Mohr)
On Jan 15, 2015, at 10:26 AM, Mike Selway wrote: > Thank you for the explanation. So, by definition ldiskfs will in a > sense "hide" 5% of the disk capacity? That is, if the usable disk space is > 500TB, the system will hold aside 25TB? If so, will the file system report > 475TB us

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-15 Thread Mike Selway
ilto:andreas.dil...@intel.com] > Sent: Wednesday, January 14, 2015 8:27 PM > To: Mike Selway > Cc: lustre-discuss@lists.lustre.org > Subject: Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre > file > system > > Note that due to the nature of spinning disks, you will a

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-15 Thread Mike Selway
01.png@01CF36E5.85AF42A0]<http://www.cray.com/> [cid:image005.jpg@01D03099.93BD2340] From: Bob Ball [mailto:b...@umich.edu] Sent: Wednesday, January 14, 2015 1:55 PM To: Mike Selway; lustre-discuss@lists.lustre.org Subject: Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-14 Thread Kilian Cavalotti
Hi all, On Wed, Jan 14, 2015 at 7:27 PM, Dilger, Andreas wrote: > Of course, fragmentation also plays a role, which is why ldiskfs will reserve > 5% of the disk by default to avoid permanent performance loss caused by > fragmentation if the filesystem gets totally full. Ashley Pittman gave a p

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-14 Thread Dilger, Andreas
Note that due to the nature of spinning disks, you will always get a performance loss as the disk fills up, because the outside of the disk (low sector numbers) can store more data more quickly than the inside of the disk (high sector numbers). From graphs that I've seen, the low sector numbers

Re: [Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-14 Thread Bob Ball
In my memory, it is not recommended to run Lustre more than 90% full. bob On 1/14/2015 2:43 PM, Mike Selway wrote: Hello, I’m looking for experiences for what has been observed to happen (performance drop offs, severity of drops, partial/full failures, …) when an operational

[Lustre-discuss] Performance dropoff for a nearly full Lustre file system

2015-01-14 Thread Mike Selway
Hello, I'm looking for experiences for what has been observed to happen (performance drop offs, severity of drops, partial/full failures, ...) when an operational Lustre File System has been almost "filled"... percentages of interest are in the range from say 80% to 99%. Multiple