Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-09 Thread Keith Bierman
On Oct 8, 2008, at 4:27 PM 10/8/, Jim Dunham wrote: , a single Solaris node can not be both the primary and secondary node. If one wants this type of mirror functionality on a single node, use host based or controller based mirroring software. If one is running multiple zones, couldn't

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Moore, Joe
Brian Hechinger On Mon, Oct 06, 2008 at 10:47:04AM -0400, Moore, Joe wrote: I wonder if an AVS-replicated storage device on the backends would be appropriate? write - ZFS-mirrored slog - ramdisk -AVS- physical disk \ +-iscsi- ramdisk -AVS-

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Wilkinson, Alex
0n Sat, Oct 04, 2008 at 10:37:26PM -0700, Chris Greer wrote: The big thing here is I ended up getting a MASSIVE boost in performance even with the overhead of the 1GB link, and iSCSI. The iorate test I was using went from 3073 IOPS on 90% sequential writes to 23953 IOPS with

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Brian Hechinger
On Wed, Oct 08, 2008 at 08:50:57AM -0400, Moore, Joe wrote: I've not worked with AVS other than looking at the basic concepts, but to me this looks like a dont-shoot-yourself-in-the-foot critical warning rather than an actual functionality restriction. Is there a -force option to

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Chris Greer
I was using EMC's iorate for the comparison. ftp://ftp.emc.com/pub/symm3000/iorate/ I had 4 processes running on the pool in parallel do 4K sequential writes. I've also been playing around with a few other benchmark tools (i just had results from other storage test with this same iorate

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Jim Dunham
Joe, Brian Hechinger On Mon, Oct 06, 2008 at 10:47:04AM -0400, Moore, Joe wrote: I wonder if an AVS-replicated storage device on the backends would be appropriate? write - ZFS-mirrored slog - ramdisk -AVS- physical disk \ +-iscsi- ramdisk -AVS-

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-08 Thread Brian Hechinger
On Wed, Oct 08, 2008 at 06:27:51PM -0400, Jim Dunham wrote: If one wants this type of mirror functionality on a single node, use host based or controller based mirroring software. Is there mirroring software that can do async copies to a mirror? -brian -- Coding in C is like sending a 3

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-07 Thread Ross
Or would they? A box dedicated to being a RAM based slog is going to be faster than any SSD would be. Especially if you make the expensive jump to 8Gb FC. Not necessarily. While this has some advantages in terms of price performance, at ~$2400 the 80GB ioDrive would give it a run for

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-07 Thread Robert Milkowski
Hello Nicolas, Monday, October 6, 2008, 10:51:58 PM, you wrote: NW I'm pretty sure that local RAM beats remote-anything, no matter what the NW anything (as long as it isn't RAM) and what the protocol to get to it NW (as long as it isn't a normal backplane). (You could claim with NUMA NW memory

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Ross
Very interesting idea, thanks for sharing it. Infiniband would definately be worth looking at for performance, although I think you'd need iSER to get the benefits and that might still be a little new: http://www.opensolaris.org/os/project/iser/Release-notes/. It's also worth bearing in

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Moore, Joe
Nicolas Williams wrote There have been threads about adding a feature to support slow mirror devices that don't stay synced synchronously. At least IIRC. That would help. But then, if the pool is busy writing then your slow ZIL mirrors would generally be out of sync, thus being of no help

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Brian Hechinger
On Sun, Oct 05, 2008 at 11:30:54PM -0500, Nicolas Williams wrote: There have been threads about adding a feature to support slow mirror devices that don't stay synced synchronously. At least IIRC. That would help. But then, if the pool is busy writing then your slow ZIL That would

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Brian Hechinger
On Mon, Oct 06, 2008 at 10:47:04AM -0400, Moore, Joe wrote: I wonder if an AVS-replicated storage device on the backends would be appropriate? write - ZFS-mirrored slog - ramdisk -AVS- physical disk \ +-iscsi- ramdisk -AVS- physical disk You'd

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Nicolas Williams
On Mon, Oct 06, 2008 at 05:38:33PM -0400, Brian Hechinger wrote: On Sun, Oct 05, 2008 at 11:30:54PM -0500, Nicolas Williams wrote: There have been threads about adding a feature to support slow mirror devices that don't stay synced synchronously. At least IIRC. That would help. But then,

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Brian Hechinger
On Mon, Oct 06, 2008 at 10:47:04AM -0400, Moore, Joe wrote: I wonder if an AVS-replicated storage device on the backends would be appropriate? write - ZFS-mirrored slog - ramdisk -AVS- physical disk \ +-iscsi- ramdisk -AVS- physical disk You'd

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-06 Thread Brian Hechinger
On Mon, Oct 06, 2008 at 01:13:40AM -0700, Ross wrote: It's also worth bearing in mind that you can have multiple mirrors. I don't know what effect that will have on the performance, but it's an easy way to boost the reliability even further. I think this idea configured on a set of 2-3

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-05 Thread Brian Hechinger
On Sat, Oct 04, 2008 at 10:37:26PM -0700, Chris Greer wrote: So I tried this experiment this week... On each host (OpenSolaris 2008.05), I created an 8GB ramdisk with ramdiskadm. I shared this ramdisk on each host via the iscsi target and initiator over a 1GB crossconnect cable (jumbo

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-05 Thread Adam Leventhal
So what are the downsides to this? If both nodes were to crash and I used the same technique to recreate the ramdisk I would lose any transactions in the slog at the time of the crash, but the physical disk image is still in a consistent state right (just not from my apps point of

Re: [zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-05 Thread Nicolas Williams
On Sun, Oct 05, 2008 at 09:07:31PM -0400, Brian Hechinger wrote: On Sat, Oct 04, 2008 at 10:37:26PM -0700, Chris Greer wrote: I'm not sure I could survive a crash of both nodes, going to try and test some more. Ok, so taking my idea above, maybe a pair of 15K SAS disks in those boxes so

[zfs-discuss] An slog experiment (my NAS can beat up your NAS)

2008-10-04 Thread Chris Greer
I currently have a traditional NFS cluster hardware setup in the lab (2 host with FC attached JBOD storage) but no cluster software yet. I've been wanting to try out the separate ZIL to see what it might do to boost performance. My problem is that I don't have any cool SSD devices, much less