Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-30 Thread Frank Middleton
On 09/29/09 10:23 PM, Marc Bevand wrote: If I were you I would format every 1.5TB drive like this: * 6GB slice for the root fs As noted in another thread, 6GB is way too small. Based on actual experience, an upgradable rpool must be more than 20GB. I would suggest at least 32GB; out of 1.5TB

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-30 Thread paul
Also, one of those drives will need to be the boot drive. (Even if it's possible I don't want to boot from the data dive, need to keep it focused on video storage.) So it'll end up being 11 drives in the raid-z. -- This message posted from opensolaris.org FWIW, most enclosures like the

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-30 Thread Orvar Korvar
Many sysadmins recommends raidz2. The reason is, if a drive breaks and you have to rebuild your array, it will take a long time with a large drive. With a 4TB drive or larger, it could take a week to rebuild your array! During that week, there will be heavy load on the rest of the drives, which

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-30 Thread Marc Bevand
Frank Middleton f.middleton at apogeect.com writes: As noted in another thread, 6GB is way too small. Based on actual experience, an upgradable rpool must be more than 20GB. It depends on how minimal your install is. The OpenSolaris install instructions recommend 8GB minimum, I have one

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-30 Thread Frank Middleton
On 09/30/09 12:59 PM, Marc Bevand wrote: It depends on how minimal your install is. Absolutely minimalist install from live CD subsequently updated via pkg to snv111b. This machine is an old 32 bit PC used now as an X-terminal, so doesn't need any additional software. It now has a bigger

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Marc Bevand
Richard Connamacher rich at indieimage.com writes: I was thinking of custom building a server, which I think I can do for around $10,000 of hardware (using 45 SATA drives and a custom enclosure), and putting OpenSolaris on it. It's a bit of a risk compared to buying a $30,000 server, but

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Trevor Pretty
Or just "try and buy" the machines from Sun for ZERO DOLLARS!!! Like Erik said.. "Both the Thor and 7110 are available for Try-and-Buy. Get them and test them against your workload - it's the only way to be sure (to paraphrase Ripley)." Marc Bevand wrote: Richard Connamacher

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Richard Connamacher
Bob, thanks for the tips. Before building a custom solution I want to do my due diligence and make sure that, for every part that can go bad, I've got a backup ready to be swapped in at a moment's notice. But I am seriously considering the alternative as well, paying more to get something with

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Richard Connamacher
Marc, Thanks for the tips! I was looking at building a smaller scale version of it first with maybe 8 1.5 TB drives, but I like your idea better. I'd probably use 1.5 TB drives since the cost per gigabyte is about the same now. -- This message posted from opensolaris.org

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Richard Connamacher
Also, one of those drives will need to be the boot drive. (Even if it's possible I don't want to boot from the data dive, need to keep it focused on video storage.) So it'll end up being 11 drives in the raid-z. -- This message posted from opensolaris.org

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-29 Thread Marc Bevand
Richard Connamacher rich at indieimage.com writes: Also, one of those drives will need to be the boot drive. (Even if it's possible I don't want to boot from the data dive, need to keep it focused on video storage.) But why? By allocating 11 drives instead of 12 to your data pool, you will

[zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Richard Connamacher
I'm looking at building a high bandwidth file server to store video for editing, as an alternative to buying a $30,000 hardware RAID and spending $2000 per seat on fibrechannel and specialized SAN drive software. Uncompressed HD runs around 1.2 to 4 gigabits per second, putting it in 10

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Bob Friesenhahn
On Mon, 28 Sep 2009, Richard Connamacher wrote: I'm looking at building a high bandwidth file server to store video for editing, as an alternative to buying a $30,000 hardware RAID and spending $2000 per seat on fibrechannel and specialized SAN drive software. Uncompressed HD runs around

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Richard Connamacher
Thanks for the detailed information. When you get the patch, I'd love to hear if it fixes the problems you're having. From my understanding, a working prefetch would keep video playback from stuttering whenever the drive head moves — is this right? The inability to read and write

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Bob Friesenhahn
On Mon, 28 Sep 2009, Richard Connamacher wrote: Thanks for the detailed information. When you get the patch, I'd love to hear if it fixes the problems you're having. From my understanding, a working prefetch would keep video playback from stuttering whenever the drive head moves — is this

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Richard Connamacher
For me, agressive prefetch is most important in order to schedule reads from enough disks in advance to produce a high data rate. This is because I am using mirrors. When using raidz or raidz2 the situation should be a bit different because raidz is striped. The prefetch bug which is

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Bob Friesenhahn
On Mon, 28 Sep 2009, Richard Connamacher wrote: I'm planning on using RAIDZ2 if it can keep up with my bandwidth requirements. So maybe ZFS could be an option after all? ZFS certainly can be an option. If you are willing to buy Sun hardware, they have a try and buy program which would

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Richard Connamacher
I was thinking of custom building a server, which I think I can do for around $10,000 of hardware (using 45 SATA drives and a custom enclosure), and putting OpenSolaris on it. It's a bit of a risk compared to buying a $30,000 server, but would be a fun experiment. -- This message posted from

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Bob Friesenhahn
On Mon, 28 Sep 2009, Richard Connamacher wrote: I was thinking of custom building a server, which I think I can do for around $10,000 of hardware (using 45 SATA drives and a custom enclosure), and putting OpenSolaris on it. It's a bit of a risk compared to buying a $30,000 server, but would

Re: [zfs-discuss] Would ZFS work for a high-bandwidth video SAN?

2009-09-28 Thread Erik Trimble
Bob Friesenhahn wrote: On Mon, 28 Sep 2009, Richard Connamacher wrote: I was thinking of custom building a server, which I think I can do for around $10,000 of hardware (using 45 SATA drives and a custom enclosure), and putting OpenSolaris on it. It's a bit of a risk compared to buying a