Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-28 Thread Andriy Gapon
on 27/01/2010 22:26 Tommi Lätti said the following: Seems that the performance is indeed atrocious. I recently (like 2 days ago) had to rescue my zfs pool under opensolaris to spare disks. The performance under OpenSol was what I was expecting, 70MB/s reading and writing at the same time.

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-28 Thread Boris Samorodov
On Tue, 26 Jan 2010 20:45:10 +0200 Dan Naumov wrote: This discussion made me have a look at my 2tb WD Green disks... So did I. Hm, it's a nice feature: - Model Family: Western Digital RE2-GP family Device Model: WDC WD1000FYPS-01ZKB0 Firmware Version: 02.01B01 User Capacity:1

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-27 Thread Dimitry Andric
On 2010-01-27 00:15, Dan Naumov wrote: Can anyone confirm that using the WDIDLE3 utility on the 2TB WD20EADS discs will not cause any issues if these disks are part of a ZFS mirror pool? I do have backups of data, but I would rather not spend the time rebuilding the entire system and restoring

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-27 Thread Tommi Lätti
Seems that the performance is indeed atrocious. I recently (like 2 days ago) had to rescue my zfs pool under opensolaris to spare disks. The performance under OpenSol was what I was expecting, 70MB/s reading and writing at the same time. Now that I'm restoring the stuff back under FreeBSD 8.0-p2

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-27 Thread Adrian Wontroba
On Wed, Jan 27, 2010 at 12:25:58PM +0100, Dimitry Andric wrote: On 2010-01-27 00:15, Dan Naumov wrote: Sorry to bump into this thread so late, but for some of my servers I have been using a patch for atacontrol, to turn the APM features of the disk(s) off, for a long time. This is mostly

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Gerrit Kühn
On Tue, 19 Jan 2010 03:24:49 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: JC So which drive models above are experiencing a continual increase in JC SMART attribute 193 (Load Cycle Count)? My guess

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Matthew Dillon
:I'm experiencing the same thing, except in my case it's most noticeable :when writing to a USB flash drive with a FAT32 filesystem. It slows the :entire system down, even if the data being written is coming from cache :or a memory file system. : :I don't know if it's related. I'm running

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Bruce Cran
On Tue, 19 Jan 2010 10:28:58 +0100 Morgan Wesström freebsd-questi...@pp.dyndns.biz wrote: Garrett Moore wrote: The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see

RE: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Dan Naumov
You're welcome. I just feel as bad for you as for everyone else who has bought these obviously Windoze optimized harddrives. Unfortunately neither wdidle3 nor an updated firmware is available or functioning on the latest models in the Green series. At least that's what I've read from other

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Bruce Cran
On Tue, 26 Jan 2010 20:45:10 +0200 Dan Naumov dan.nau...@gmail.com wrote: The disks are of exact same model and look to be same firmware. Should I be worried that the newer disk has, in 136 hours reached a higher Load Cycle count twice as big as on the disk thats 5253 hours old? There's a

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Tommi Lätti
 9 Power_On_Hours          0x0032   100   100   000    Old_age Always       -       136 193 Load_Cycle_Count        0x0032   199   199   000    Old_age Always       -       5908 The disks are of exact same model and look to be same firmware. Should I be worried that the newer disk has, in

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Chuck Swiger
Hi-- On Jan 26, 2010, at 10:45 AM, Dan Naumov wrote: 9 Power_On_Hours 0x0032 100 100 000Old_age Always - 136 193 Load_Cycle_Count0x0032 199 199 000Old_age Always - 5908 The disks are of exact same model and look to be same

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Gerrit Kühn
On Wed, 27 Jan 2010 03:53:20 +0900 Tommi Lätti s...@iki.fi wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: TL Well AFAIK WD certifies that there's no extra risk involved unless you TL go over 300.000 park cycles. On the other hand, my 9 month 1.5tb green

RE: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Dan Naumov
Can anyone confirm that using the WDIDLE3 utility on the 2TB WD20EADS discs will not cause any issues if these disks are part of a ZFS mirror pool? I do have backups of data, but I would rather not spend the time rebuilding the entire system and restoring enormous amounts of data over a 100mbit

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Adrian Wontroba
On Wed, Jan 27, 2010 at 01:15:17AM +0200, Dan Naumov wrote: Can anyone confirm that using the WDIDLE3 utility on the 2TB WD20EADS discs will not cause any issues if these disks are part of a ZFS mirror pool? I do have backups of data, but I would rather not spend the time rebuilding the entire

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Damian Gerow
Adrian Wontroba wrote: : How about using the write every 5 seconds python script posted earlier : in this thread by e...@tefre.com? Works nicely for me and stops the load : cycle count increase. I have a WD2003FYPS sitting in a system, to be used for testing. Bought it just before this thread

RE: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Dan Naumov
Thank you, thank you, thank you! Now I neither have to worry about premature death of my disks, nor do I have to endure the loud clicking noises (I have a NAS with these in my living room)! If either of you (or both) want me to Paypal you money for a beer, send me details offlist :) -

RE: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Dan Naumov
I have a WD2003FYPS sitting in a system, to be used for testing. Bought it just before this thread started, and here's what it looks like right now: 9 Power_On_Hours 0x0032 100 100 000Old_age Always - 508 193 Load_Cycle_Count 0x0032 200 200 000Old_age

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Damian Gerow
Dan Naumov wrote: : This drive is sitting, unused, with no filesystem, and I've performed : approximately zero writes to the disk. : : Having a script kick off and write to a disk will help so long as that : disk is writable; if it's being used as a hot spare in a raidz array, it's : not going to

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Adrian Wontroba
On Tue, Jan 26, 2010 at 07:49:05PM -0500, Damian Gerow wrote: Specific cases aside, writing to the FS is a workaround to a rather inconvenient issue. I, too, would like to see if the problem is fixed, not avoided, by using wdidle -- but I suspect I'll have to contact WD myself to get that

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Matthew Dillon
Here's what I got from one of my 2TB WD green drives. This one is Firmware 01.00A01. Load_Cycle_Count is 26... seems under control. It gets hit with a lot of activity separated by a lot of time (several minutes to several hours), depending on what is going on. The box is

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-26 Thread Gerrit Kühn
On Tue, 26 Jan 2010 19:12:01 -0500 Damian Gerow dge...@afflictions.org wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: DG Adrian Wontroba wrote: DG Having a script kick off and write to a disk will help so long as that DG disk is writable; if it's being

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-24 Thread Aragon Gouveia
On 01/18/10 22:13, O. Hartmann wrote: Symptome: All boxes have ZFS and UFS2 filesystems. Since two weeks or so, sometimes the I/O performance drops massively when doing 'svn update', 'make world' or even 'make kernel'. It doesn't matter what memory and how many cpu the box has, it get stuck for

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Gerrit Kühn
On Mon, 18 Jan 2010 21:41:53 -0500 Garrett Moore garrettmo...@gmail.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: GM The drives being discussed in my related thread (regarding poor GM performance) are all WD Green drives. I have used wdidle3 to set

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Morgan Wesström
Garrett Moore wrote: The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see what sort of difference this makes for performance. Even if it makes no difference to

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread krad
2010/1/18 Morgan Wesström freebsd-questi...@pp.dyndns.biz O. Hartmann wrote: I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Morgan Wesström
Gerrit Kühn wrote: Thanks for bringing up this topic here. I have drives showing up close to 80 load cycle counts here. Guess it's time for that fix... :-| Just note that the utility is officially for WD's Raid Edition GP drives and not for the regular consumer models although some users

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Jeremy Chadwick
On Tue, Jan 19, 2010 at 10:28:58AM +0100, Morgan Wesström wrote: Garrett Moore wrote: The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see what sort of difference this

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Gerrit Kühn
On Tue, 19 Jan 2010 01:57:36 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: JC If you want a consumer-edition drive that's better tuned for server JC work, you should really be looking at the WD Caviar Black

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Morgan Wesström
Jeremy Chadwick wrote: No offence intended by this statement, but: the Green drives are specifically intended for workstations. I don't believe in the whole segregation of drive model thing, but the fact of the matter is, the Green drives are variable-RPM and have numerous firmware-level

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Jeremy Chadwick
On Tue, Jan 19, 2010 at 11:07:24AM +0100, Gerrit Kühn wrote: On Tue, 19 Jan 2010 01:57:36 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: JC If you want a consumer-edition drive that's better tuned

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Gerrit Kühn
On Tue, 19 Jan 2010 03:24:49 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: JC JC If you want a consumer-edition drive that's better tuned for JC JC server work, you should really be looking at the WD

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Emil Mikulic
On Tue, Jan 19, 2010 at 09:16:41AM +0100, Gerrit K?hn wrote: Thanks for bringing up this topic here. I have drives showing up close to 80 load cycle counts here. Guess it's time for that fix... :-| Device Model: WDC WD10EACS-00ZJB0 Firmware Version: 01.01B01 Serial Number:

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Morgan Wesström
Emil Mikulic wrote: On Tue, Jan 19, 2010 at 09:16:41AM +0100, Gerrit K?hn wrote: Thanks for bringing up this topic here. I have drives showing up close to 80 load cycle counts here. Guess it's time for that fix... :-| Device Model: WDC WD10EACS-00ZJB0 Firmware Version: 01.01B01

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Gary Palmer
On Tue, Jan 19, 2010 at 03:24:49AM -0800, Jeremy Chadwick wrote: WD2001FAAS - WD Caviar Black, 2TB, 64MB, 7200rpm Do you mean WD2001FASS? I can't find a WD2001FAAS. Thanks, Gary ___ freebsd-stable@freebsd.org mailing list

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Jeremy Chadwick
On Tue, Jan 19, 2010 at 10:44:59AM -0500, Gary Palmer wrote: On Tue, Jan 19, 2010 at 03:24:49AM -0800, Jeremy Chadwick wrote: WD2001FAAS - WD Caviar Black, 2TB, 64MB, 7200rpm Do you mean WD2001FASS? I can't find a WD2001FAAS. Yup, typo -- bound to be at least one given the amount of data

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Oliver Lehmann
Hi, it seems that I'm not experiencing this at all... Jeremy Chadwick wrote: WD10EACS - WD Caviar Green, 1TB, 16MB, variable rpm have one (external HDD, always powered on) Model = WDC WD10EAVS-00D7B1 Firmware Version = 01.01A01 Power_On_Hours 5757 Power_Cycle_Count 75

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Charles Sprickman
On Tue, 19 Jan 2010, Gerrit Kühn wrote: On Tue, 19 Jan 2010 03:24:49 -0800 Jeremy Chadwick free...@jdc.parodius.com wrote about Re: immense delayed write to file system (ZFS and UFS2), performance issues: JC JC If you want a consumer-edition drive that's better tuned for JC JC server work

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Erik Stian Tefre
Morgan Wesström wrote: Garrett Moore wrote: The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see what sort of difference this makes for performance. Even if it makes no

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread BSD Life
2010/1/19 Daniel O'Connor docon...@gsoft.com.au On Tue, 19 Jan 2010, Morgan Wesström wrote: The disks involved don't happen to be Western Digital Green Power disks, do they? The Intelli-Park function in these disks are wrecking havoc with I/O in Linux-land at least, causing massive stalls

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread O. Hartmann
On 01/18/10 21:34, � wrote: O. Hartmann wrote: I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores (Dell Poweredge III). Symptome: All

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread O. Hartmann
On 01/19/10 10:09, krad wrote: 2010/1/18 Morgan Wesstr�mfreebsd-questi...@pp.dyndns.biz O. Hartmann wrote: I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core,

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-19 Thread Michael Loftis
--On Wednesday, January 20, 2010 1:16 AM +0100 O. Hartmann ohart...@mail.zedat.fu-berlin.de wrote: This could end in a bad situation, where one process writes a files, say with some arbitrary stuff and another successing process is intended to read this file. even if the processes are run

immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread O. Hartmann
I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores (Dell Poweredge III). Symptome: All boxes have ZFS and UFS2 filesystems. Since

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread Jeremy Chadwick
On Mon, Jan 18, 2010 at 09:13:52PM +0100, O. Hartmann wrote: I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores (Dell Poweredge III).

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread Morgan Wesström
O. Hartmann wrote: I realise a strange behaviour of several FreeBSD 8.0-STABLE/amd64 boxes. All boxes have the most recent STABLE. One box is a UP system, two others SMP boxes, one with a Q6600 4-core, another XEON with 2x 4-cores (Dell Poweredge III). Symptome: All boxes have ZFS and UFS2

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread Daniel O'Connor
On Tue, 19 Jan 2010, Morgan Wesström wrote: The disks involved don't happen to be Western Digital Green Power disks, do they? The Intelli-Park function in these disks are wrecking havoc with I/O in Linux-land at least, causing massive stalls and iowait through the roof during the 25-30 seconds

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread Garrett Moore
The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see what sort of difference this makes for performance. Even if it makes no difference to performance, thank you for

Re: immense delayed write to file system (ZFS and UFS2), performance issues

2010-01-18 Thread Daniel O'Connor
On Tue, 19 Jan 2010, Garrett Moore wrote: The drives being discussed in my related thread (regarding poor performance) are all WD Green drives. I have used wdidle3 to set all of my drive timeouts to 5 minutes. I'll see what sort of difference this makes for performance. Even if it makes no