Re: [zfs-discuss] Mirrored zpool across network

2007-09-10 Thread Mark
Hey all again, Looking into a few other options. How about infiniband? it would give us more bandwidth, but will it increase complexity/price? any thoughts? Cheers Mark This message posted from opensolaris.org ___ zfs-discuss mailing list zfs-disc

Re: [zfs-discuss] Mirrored zpool across network

2007-08-28 Thread Darren J Moffat
Depending on what hardware you have and what size the data chunks are will determine what impact IPsec will have. WAN vs LAN isn't the issue. As for mitigating the impact of the crypto in IPsec it depends on the data size. If the size of the packets is > 512 bytes then the crypto framework wi

Re: [zfs-discuss] Mirrored zpool across network

2007-08-24 Thread Mark
hi, Few questions, I seem to remember in WAN environments IPsec can have a reasonably large performance impact, how large is this performance impact? and is there soe way to mitigate it? The problem is we could be needing to use all a gigbit links bandwidth (possibly more). is IPsec AH slightly

Re: [zfs-discuss] Mirrored zpool across network

2007-08-24 Thread Darren J Moffat
Mark wrote: > Ok, had a bit of a look around, > > What about this setup. > > Two boxes with all the hard drives in them. And all drives iSCSI Targets. A > third Box puts all of the Drives into a mirrored RAIDz setup (one box > mirroring the other, each has a RAIDz zfs zpool). This setup wil be

Re: [zfs-discuss] Mirrored zpool across network

2007-08-24 Thread Mark
Ok, had a bit of a look around, What about this setup. Two boxes with all the hard drives in them. And all drives iSCSI Targets. A third Box puts all of the Drives into a mirrored RAIDz setup (one box mirroring the other, each has a RAIDz zfs zpool). This setup wil be shared via samba out. Doe

Re: [zfs-discuss] Mirrored zpool across network

2007-08-23 Thread Robert Milkowski
Hello Ralf, Wednesday, August 22, 2007, 8:55:35 AM, you wrote: RR> instead, or, most important for the typical data center, the *operator* RR> is not able to replace a disk like he's used to: pulling the old disc RR> out, putting the new disc in, resync starting, finished. You'll always RR> have

Re: [zfs-discuss] Mirrored zpool across network

2007-08-22 Thread Matthew Ahrens
Ralf Ramge wrote: > I consider this a big design flaw of ZFS. Are you saying that it's a design flaw of ZFS that we haven't yet implemented remote replication? I would consider that a missing feature, not a design flaw. There's nothing in the design of ZFS to prevent such a feature (and in fa

Re: [zfs-discuss] Mirrored zpool across network

2007-08-22 Thread Jim Dunham
Ralf, > Well, and what I want to say: if you place the bitmap volume on the > same > disk, this situation even gets worse. The problem is the > involvement of > SVM. Building the soft partition again makes the handling even more > complex and the case harder to handle for operators. It's the b

Re: [zfs-discuss] Mirrored zpool across network

2007-08-22 Thread Mark
Wow, I just opened a whole can of worms there that went flying over my head. Thanks for all the information! i'll see if i can plough through it all :) I'm guessing that i might be able to do asynchronous, but the problem is that the video is going to be streaming from a camera in real time. An

Re: [zfs-discuss] Mirrored zpool across network

2007-08-22 Thread Ralf Ramge
Jim Dunham wrote: > This is just one scenario for deploying the 48 disks of x4500. The > blog listed below offers another option, by mirroring the bitmaps > across all available disks, bring the total disk count back up to 46, > (or 44, if 2x HSP) leaving the other two for a mirrored root disk.

Re: [zfs-discuss] Mirrored zpool across network

2007-08-21 Thread Jim Dunham
Ralf, > Torrey McMahon wrote: >> AVS? >> > Jim Dunham will probably shoot me, or worse, but I recommend thinking > twice about using AVS for ZFS replication. That's is why the call this a discussion group, as it encourages differing opinions, > Basically, you only have a > few options: > > 1)

Re: [zfs-discuss] Mirrored zpool across network

2007-08-21 Thread Ralf Ramge
Torrey McMahon wrote: > AVS? > Jim Dunham will probably shoot me, or worse, but I recommend thinking twice about using AVS for ZFS replication. Basically, you only have a few options: 1) Using a battery buffered hardware RAID controller, which leads to bad ZFS performance in many cases, 2)

Re: [zfs-discuss] Mirrored zpool across network

2007-08-20 Thread Adam Leventhal
On Sun, Aug 19, 2007 at 05:45:18PM -0700, Mark wrote: > Basically, the setup is a large volume of Hi-Def video is being streamed > from a camera, onto an editing timeline. This will be written to a > network share. Due to the large amounts of data, ZFS is a really good > option for us. But we need

Re: [zfs-discuss] Mirrored zpool across network

2007-08-19 Thread Torrey McMahon
Mark wrote: > Hi All, > > Im just wondering (i figure you can do this but dont know what hardware and > stuff i would need) if I can set up a mirror of a raidz zpool across a > network. > > Basically, the setup is a large volume of Hi-Def video is being streamed from > a camera, onto an editing

[zfs-discuss] Mirrored zpool across network

2007-08-19 Thread Mark
Hi All, Im just wondering (i figure you can do this but dont know what hardware and stuff i would need) if I can set up a mirror of a raidz zpool across a network. Basically, the setup is a large volume of Hi-Def video is being streamed from a camera, onto an editing timeline. This will be writ