[zfs-discuss] ZFS + MPXIO + SRDF

2008-08-13 Thread Moinak Ghosh
I have to help setup a configuration where a ZPOOL on MPXIO on OpenSolaris is being used with Symmetrix devices with replication being handled via Symmetrix Remote Data Facility (SRDF). So I am curious whether anyone has used this configuration and have any feedback/suggestions. Will there be

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Jonathan Wheeler
Hi Mattias Miles. To test the version mismatch theory, I setup a snv_91 VM (using virtualbox) on my snv_95 desktop, and tried the zfs receive again. Unfortunately the symptoms are exactly the same: around the ~20GB mark, the justhome.zfs stream still bombs out with the checksum error. I

Re: [zfs-discuss] more ZFS recovery

2008-08-13 Thread Cromar Scott
Miles Nordin [EMAIL PROTECTED] cs == Cromar Scott [EMAIL PROTECTED] writes: cs It appears that the metadata on that pool became corrupted cs when the processor failed. The exact mechanism is a bit of a cs mystery, [...] cs We were told that the probability of metadata

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Mattias Pantzare
2008/8/13 Jonathan Wheeler [EMAIL PROTECTED]: So far we've established that in this case: *Version mismatches aren't causing the problem. *Receiving across the network isn't the issue (because I have the exact same issue restoring the stream directly on my file server). *All that's left was

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Darren J Moffat
Mattias Pantzare wrote: 2008/8/13 Jonathan Wheeler [EMAIL PROTECTED]: So far we've established that in this case: *Version mismatches aren't causing the problem. *Receiving across the network isn't the issue (because I have the exact same issue restoring the stream directly on my file

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Miles Nordin
jw == Jonathan Wheeler [EMAIL PROTECTED] writes: mp == Mattias Pantzare [EMAIL PROTECTED] writes: jw Miles: zfs receive -nv works ok one might argue 'zfs receive' should validate checksums with the -n option, so you can check if a just-written dump is clean before counting on it. Without

Re: [zfs-discuss] more ZFS recovery

2008-08-13 Thread Miles Nordin
cs == Cromar Scott [EMAIL PROTECTED] writes: cs We opened a call with Sun support. We were told that the cs corruption issue was due to a race condition within ZFS. We cs were also told that the issue was known and was scheduled for cs a fix in S10U6. nice. Is there a bug

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Jonathan Wheeler
Thanks for the information, I'm learning quite a lot from all this. It seems to me that zfs send *should* be doing some kind of verification, since some work has clearly been put into zfs so that zfs's can be dumped into files/pipes. It's a great feature to have, and I can't believe that this

Re: [zfs-discuss] Thumper, ZFS and performance

2008-08-13 Thread Mertol Ozyoney
We had done several benchmarks on Thumpers. Config 1 is definetly better on most of the loads. Some Raid1 configs perform better on certain loads. Mertol Mertol Ozyoney Storage Practice - Sales Manager Sun Microsystems, TR Istanbul TR Phone +902123352200 Mobile +905339310752 Fax

Re: [zfs-discuss] more ZFS recovery

2008-08-13 Thread Cromar Scott
Miles Nordin [EMAIL PROTECTED] cs == Cromar Scott [EMAIL PROTECTED] writes: cs We opened a call with Sun support. We were told that the cs corruption issue was due to a race condition within ZFS. We cs were also told that the issue was known and was scheduled for cs a fix in

Re: [zfs-discuss] GUI support for ZFS root?

2008-08-13 Thread Bob Friesenhahn
On Tue, 12 Aug 2008, Lori Alt wrote: There are no plans to add zfs root support to the existing install GUI. GUI install support for zfs root will be provided by the new Caiman installer. Latest BeleniX OpenSolaris uses the Caiman installer so it may be worth installing it just to see what

Re: [zfs-discuss] GUI support for ZFS root?

2008-08-13 Thread Mario Goebbels
Latest BeleniX OpenSolaris uses the Caiman installer so it may be worth installing it just to see what it is like. I installed it under VirtualBox yesterday. Installing using whole disk did not work with VirtualBox but the suggested default partitioning did work. OpenSolaris 2008.05

Re: [zfs-discuss] ZFS raidz write performance:what to expect from SATA drives on ICH9R (A

2008-08-13 Thread Shaky
Did you ever figure this out? I have the same hardware: Intel DG33TL motherboard with Intel gigabit nic and ICH9R but with Hitachi 1TB drives. I'm getting 2MB/s write speeds. I've tried the zeroing out trick. No luck. Network is fine. Disks are fine, the write at around 50MB/s when formatted

Re: [zfs-discuss] ZFS raidz write performance:what to expect from SATA drives on ICH9R (A

2008-08-13 Thread Shaky
Oh, Jeff's write script gives around 60MB/s IIRC. This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org http://mail.opensolaris.org/mailman/listinfo/zfs-discuss

Re: [zfs-discuss] ZFS raidz write performance:what to expect from SATA drives on ICH9R (A

2008-08-13 Thread Shaky
I used BCwipe to zero the drives. How do you: boot Knoppix again and zero out the start and end sectors manually (erasing all GPT data) ?? thanks This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-discuss@opensolaris.org

Re: [zfs-discuss] ZFS + MPXIO + SRDF

2008-08-13 Thread Robert Milkowski
Hello Moinak, Wednesday, August 13, 2008, 1:58:34 PM, you wrote: MG I have to help setup a configuration where a ZPOOL on MPXIO on MG OpenSolaris is being used with Symmetrix devices with replication MG being handled via Symmetrix Remote Data Facility (SRDF). MG So I am curious whether anyone

Re: [zfs-discuss] ZFS + MPXIO + SRDF

2008-08-13 Thread Carson Gaspar
Robert Milkowski wrote: Wednesday, August 13, 2008, 1:58:34 PM, you wrote: MG I have to help setup a configuration where a ZPOOL on MPXIO on MG OpenSolaris is being used with Symmetrix devices with replication MG being handled via Symmetrix Remote Data Facility (SRDF). MG So I am

[zfs-discuss] marvell88sx patch

2008-08-13 Thread Bob Friesenhahn
I see that a driver patch has now been released for marvell88sx hardware. I expect that this is the patch that Thumper owners have been anxiously waiting for. The patch ID is 138053-02. Bob == Bob Friesenhahn [EMAIL PROTECTED],

Re: [zfs-discuss] integrated failure recovery thoughts (single-bit

2008-08-13 Thread paul
Given that the checksum algorithms utilized in zfs are already fairly CPU intensive, I can't help but wonder if it's verified that a majority of checksum inconsistency failures appear to be single bit; if it may be advantageous to utilize some computationally simpler hybrid form of a

Re: [zfs-discuss] ZFS + MPXIO + SRDF

2008-08-13 Thread eric kustarz
On Aug 13, 2008, at 5:58 AM, Moinak Ghosh wrote: I have to help setup a configuration where a ZPOOL on MPXIO on OpenSolaris is being used with Symmetrix devices with replication being handled via Symmetrix Remote Data Facility (SRDF). So I am curious whether anyone has used this

Re: [zfs-discuss] ZFS + MPXIO + SRDF

2008-08-13 Thread Moinak Ghosh
Actually the SRDF copy has to be imported on the standby(R2) host if the primary host/storage has to be offlined for some reason; but thanks for the note. Regards, Moinak. This message posted from opensolaris.org ___ zfs-discuss mailing list

Re: [zfs-discuss] integrated failure recovery thoughts (single-bit

2008-08-13 Thread Bob Friesenhahn
On Wed, 13 Aug 2008, paul wrote: Given that the checksum algorithms utilized in zfs are already fairly CPU intensive, I can't help but wonder if it's verified that a majority of checksum inconsistency failures appear to be single bit; if it may be advantageous to utilize some

Re: [zfs-discuss] GUI support for ZFS root?

2008-08-13 Thread Sean Sprague
Mario, Latest BeleniX OpenSolaris uses the Caiman installer so it may be worth installing it just to see what it is like. I installed it under VirtualBox yesterday. Installing using whole disk did not work with VirtualBox but the suggested default partitioning did work.

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Miles Nordin
jw == Jonathan Wheeler [EMAIL PROTECTED] writes: jw A common example used all over the place is zfs send | ssh jw $host. In these examples is ssh guaranteeing the data delivery jw somehow? it is really all just appologetics. It sounds like a zfs bug to me. The only alternative is

Re: [zfs-discuss] integrated failure recovery thoughts (single-bit

2008-08-13 Thread Bob Friesenhahn
On Wed, 13 Aug 2008, paul wrote: Shy extremely noisy hardware and/or literal hard failure, most errors will most likely always be expressed as 1 bit out of some very large N number of bits. This claim ignores the fact that most computers today are still based on synchronously clocked

Re: [zfs-discuss] integrated failure recovery thoughts (single-bit

2008-08-13 Thread Richard Elling
paul wrote: Bob wrote: ... Given the many hardware safeguards against single (and several) bit errors, the most common data error will be large. For example, the disk drive may return data from the wrong sector. - actually data integrity check bits as may exist within memory

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Richard Elling
Jonathan Wheeler wrote: Thanks for the information, I'm learning quite a lot from all this. It seems to me that zfs send *should* be doing some kind of verification, since some work has clearly been put into zfs so that zfs's can be dumped into files/pipes. It's a great feature to have, and

Re: [zfs-discuss] corrupt zfs stream? checksum mismatch

2008-08-13 Thread Anton B. Rang
There is an explicit check in ZFS for the checksum, as you deduced. I suspect that by disabling this check you could recover much, if not all, of your data. You could probably do this with mdb by 'simply' writing a NOP over the branch in dmu_recv_stream. It appears that 'zfs send' was designed