Re: [zfs-discuss] Ideal SATA/SAS Controllers for ZFS

2010-05-18 Thread Marc Bevand
The LSI SAS1064E slipped through the cracks when I built the list. This is a 4-port PCIe x8 HBA with very good Solaris (and Linux) support. I don't remember having seen it mentionned on zfs-discuss@ before, even though many were looking for 4-port controllers. Perhaps the fact it is priced too

Re: [zfs-discuss] Using WD Green drives?

2010-05-18 Thread Pasi Kärkkäinen
On Mon, May 17, 2010 at 03:12:44PM -0700, Erik Trimble wrote: On Mon, 2010-05-17 at 12:54 -0400, Dan Pritts wrote: On Mon, May 17, 2010 at 06:25:18PM +0200, Tomas Ögren wrote: Resilver does a whole lot of random io itself, not bulk reads.. It reads the filesystem tree, not block 0, block

[zfs-discuss] Pool revcovery from replaced disks.

2010-05-18 Thread Demian Phillips
Is it possible to recover a pool (as it was) from a set of disks that were replaced during a capacity upgrade? ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] Pool revcovery from replaced disks.

2010-05-18 Thread Thomas Burgess
wow, that's a truly excelent question. If you COULD do it, it might work with a simple import but i have no idea...i'd love to know myself. On Tue, May 18, 2010 at 7:06 AM, Demian Phillips demianphill...@gmail.comwrote: Is it possible to recover a pool (as it was) from a set of disks that

[zfs-discuss] Very serious performance degradation

2010-05-18 Thread Philippe
Hi, I'm running Opensolaris 2009.06, and I'm facing a serious performance loss with ZFS ! It's a raidz1 pool, made of 4 x 1TB SATA disks : zfs_raidONLINE 0 0 0 raidz1ONLINE 0 0 0 c7t2d0 ONLINE 0 0 0

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Bob Friesenhahn
On Tue, 18 May 2010, Philippe wrote: The usage of the pool is for daily backups, with rsync. Some big files are updated simulteanously, in different FS. So, I suspect a huge fragmentation of the files ! Or maybe..., a need of more RAM ?? You forgot to tell us what brand/model of disks you

Re: [zfs-discuss] Using WD Green drives?

2010-05-18 Thread Dan Pritts
On Tue, May 18, 2010 at 09:40:15AM +0300, Pasi Kärkkäinen wrote: Thus, you'll get good throughput for resilver on these drives pretty much in just ONE case: large files with NO deletions. If you're using them for write-once/read-many/no-delete archives, then you're OK. Anything else is

[zfs-discuss] ZFS in campus clusters

2010-05-18 Thread John Hoogerdijk
I'm building a campus cluster with identical storage in two locations with ZFS mirrors spanning both storage frames. Data will be mirrored using zfs. I'm looking for the best way to add log devices to this campus cluster. I am considering building a separate mirrored zpool of Flash disk that

Re: [zfs-discuss] ZFS in campus clusters

2010-05-18 Thread Darren J Moffat
On 18/05/2010 15:40, John Hoogerdijk wrote: I'm building a campus cluster with identical storage in two locations with ZFS mirrors spanning both storage frames. Data will be mirrored using zfs. I'm looking for the best way to add log devices to this campus cluster. So this is a single pool

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Philippe
Hi, The 4 disks are Western Digital ATA 1TB (one is slighlty different) : 1 x ATA-WDC WD10EACS-00D-1A01-931.51GB 3 x ATA-WDC WD10EARS-00Y-0A80-931.51GB I've done lots of tests (speed tests + SMART reports) with each of these 4 disk on another system (another computer, running Windows 2003

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread John J Balestrini
Howdy, Is dedup on? I was having some pretty strange problems including slow performance when dedup was on. Disabling dedup helped out a whole bunch. My system only has 4gig of ram, so that may have played a part too. Good luck! John On May 18, 2010, at 7:51 AM, Philippe wrote: Hi, The

Re: [zfs-discuss] ZFS in campus clusters

2010-05-18 Thread John Hoogerdijk
On 18/05/2010 15:40, John Hoogerdijk wrote: I'm building a campus cluster with identical storage in two locations with ZFS mirrors spanning both storage frames. Data will be mirrored using zfs. I'm looking for the best way to add log devices to this campus cluster. So this is a single

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Tomas Ögren
On 18 May, 2010 - Philippe sent me these 6,0K bytes: Hi, The 4 disks are Western Digital ATA 1TB (one is slighlty different) : 1 x ATA-WDC WD10EACS-00D-1A01-931.51GB 3 x ATA-WDC WD10EARS-00Y-0A80-931.51GB I've done lots of tests (speed tests + SMART reports) with each of these 4 disk

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Matt Cowger
I note in your iostat data below that one drive (sd5) consistently performs MUCH worse than the others, even when doing less work. -Original Message- From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss-boun...@opensolaris.org] On Behalf Of John J Balestrini Sent: Tuesday,

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Bob Friesenhahn
On Tue, 18 May 2010, Philippe wrote: The 4 disks are Western Digital ATA 1TB (one is slighlty different) : 1 x ATA-WDC WD10EACS-00D-1A01-931.51GB 3 x ATA-WDC WD10EARS-00Y-0A80-931.51GB I've done lots of tests (speed tests + SMART reports) with each of these 4 disk on another system (another

Re: [zfs-discuss] Ideal SATA/SAS Controllers for ZFS

2010-05-18 Thread Marc Nicholas
Nice write-up, Marc. Aren't the SuperMicro cards their funny UIO form factor? Wouldn't want someone buying a card that won't work in a standard chassis. -marc On Tue, May 18, 2010 at 2:26 AM, Marc Bevand m.bev...@gmail.com wrote: The LSI SAS1064E slipped through the cracks when I built the

Re: [zfs-discuss] Ideal SATA/SAS Controllers for ZFS

2010-05-18 Thread Marc Bevand
Marc Nicholas geekything at gmail.com writes: Nice write-up, Marc.Aren't the SuperMicro cards their funny UIO form factor? Wouldn't want someone buying a card that won't work in a standard chassis. Yes, 4 or the 6 Supermicro cards are UIO cards. I added a warning about it. Thanks. -mrb

Re: [zfs-discuss] Ideal SATA/SAS Controllers for ZFS

2010-05-18 Thread Thomas Burgess
A really great alternative to the UIO cards for those who don't want the headache of modifying the brackets or cases is the Intel SASUC8I * * * * *This is a rebranded LSI SAS3081E-R* * * *It can be flashed with the LSI IT firmware from the LSI website and is physically identical to the LSI card.

[zfs-discuss] spares bug: explain to me status of bug report.

2010-05-18 Thread eXeC001er
Hi. In bugster i found bug about spares. I can to reproduce the problem. but developer set status Not a defect. Why? http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6905317 Thanks. ___ zfs-discuss mailing list zfs-discuss@opensolaris.org

Re: [zfs-discuss] spares bug: explain to me status of bug report.

2010-05-18 Thread Cindy Swearingen
Hi-- The scenario in the bug report below is that the pool is exported. The spare can't kick in if the pool is exported. It looks like the issue reported in this CR's See Also section, CR 6887163 is still open. Thanks, Cindy On 05/18/10 11:19, eXeC001er wrote: Hi. In bugster i found bug

Re: [zfs-discuss] spares bug: explain to me status of bug report.

2010-05-18 Thread eXeC001er
6887163 /bugdatabase/view_bug.do?bug_id=6887163 11-Closed:Duplicate (Closed) 6945634 /bugdatabase/view_bug.do?bug_id=6945634 11-Closed:Duplicate (Closed) 2010/5/18 Cindy Swearingen cindy.swearin...@oracle.com Hi-- The scenario in the bug report below is that the pool is exported. The

Re: [zfs-discuss] spares bug: explain to me status of bug report.

2010-05-18 Thread Cindy Swearingen
I think the remaining CR is this one: http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6911420 cs On 05/18/10 12:08, eXeC001er wrote: 6887163 /bugdatabase/view_bug.do?bug_id=6887163 11-Closed:Duplicate (Closed) 6945634 /bugdatabase/view_bug.do?bug_id=6945634 11-Closed:Duplicate

Re: [zfs-discuss] Ideal SATA/SAS Controllers for ZFS

2010-05-18 Thread Marc Bevand
Thomas Burgess wonslung at gmail.com writes: A really great alternative to the UIO cards for those who don't want the headache of modifying the brackets or cases is the Intel SASUC8I This is a rebranded LSI SAS3081E-R It can be flashed with the LSI IT firmware from the LSI website and

[zfs-discuss] Is dedupe ready for prime time?

2010-05-18 Thread Paul Choi
I've been reading this list for a while, there's lots of discussion about b134 and deduplication. I see some stuff about snapshots not being destroyed, and maybe some recovery issues. What I'd like to know is, is ZFS with deduplication stable enough to use? I have two NFS servers, each

Re: [zfs-discuss] Is dedupe ready for prime time?

2010-05-18 Thread Roy Sigurd Karlsbakk
- Paul Choi paulc...@plaxo.com skrev: I've been reading this list for a while, there's lots of discussion about b134 and deduplication. I see some stuff about snapshots not being destroyed, and maybe some recovery issues. What I'd like to know is, is ZFS with deduplication stable

Re: [zfs-discuss] Hashing files rapidly on ZFS

2010-05-18 Thread Bertrand Augereau
Thanks Dan, this is exactly what I had in mind (hashing the block checksums). You convinced me to do it independently from zfs. -- This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org

Re: [zfs-discuss] Is dedupe ready for prime time?

2010-05-18 Thread Paul Choi
Roy, Thanks for the info. Yeah, the bug you mentioned is pretty critical. In terms of SSDs, I have Intel X25-M for L2ARC and X25-E for ZIL. And the host has 24G RAM. I'm just waiting for that 2010.03 release or whatever we want to call it when it's released... -Paul On 5/18/10 12:49 PM,

Re: [zfs-discuss] Is dedupe ready for prime time?

2010-05-18 Thread Roy Sigurd Karlsbakk
- Paul Choi paulc...@plaxo.com skrev: Roy, Thanks for the info. Yeah, the bug you mentioned is pretty critical. In terms of SSDs, I have Intel X25-M for L2ARC and X25-E for ZIL. And the host has 24G RAM. I'm just waiting for that 2010.03 release or whatever we want to call it when

Re: [zfs-discuss] Pool revcovery from replaced disks.

2010-05-18 Thread Peter Jeremy
On 2010-May-18 19:06:11 +0800, Demian Phillips demianphill...@gmail.com wrote: Is it possible to recover a pool (as it was) from a set of disks that were replaced during a capacity upgrade? If no other writes occurred during the capacity upgrade then I'd suspect it would be possible. The

[zfs-discuss] New SSD options

2010-05-18 Thread Don
I'm looking for alternatives SSD options to the Intel X25-E and the ZEUS IOPS. The ZEUS IOPS would probably cost as much as my entire current disk system (80 15k SAS drives)- and that's just silly. The Intel is much less expensive, and while fast- pales in comparison to the ZEUS. I've

Re: [zfs-discuss] ZFS in campus clusters

2010-05-18 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of John Hoogerdijk I'm building a campus cluster with identical storage in two locations with ZFS mirrors spanning both storage frames. Data will be mirrored using zfs. I'm looking for the

Re: [zfs-discuss] Very serious performance degradation

2010-05-18 Thread Edward Ned Harvey
How full is your filesystem? Give us the output of zfs list You might be having a hardware problem, or maybe it's extremely full. Also, if you have dedup enabled, on a 3TB filesystem, you surely want more RAM. I don't know if there's any rule of thumb you could follow, but offhand I'd say 16G

[zfs-discuss] scsi messages and mpt warning in log - harmless, or indicating a problem?

2010-05-18 Thread Willard Korfhage
This afternoon, messages like the following started appearing in /var/adm/messages: May 18 13:46:37 fs8 scsi: [ID 365881 kern.info] /p...@0,0/pci8086,2...@1/pci15d9,a...@0 (mpt0): May 18 13:46:37 fs8 Log info 0x3108 received for target 5. May 18 13:46:37 fs8 scsi_status=0x0,

[zfs-discuss] zhist good enough for usage

2010-05-18 Thread Edward Ned Harvey
The purpose of zhist is to simplify access to past snapshots. For example, if you zhist ls somefile then the results will be: A list of all the previous snapshot versions of that file or directory. No need to find the right .zfs directory, or check to see which ones have changed. Some