[zfs-discuss] Pure SSD Pool

2011-07-09 Thread Karl Rossing
Hi, I have a dual xeon 64GB 1U server with two free 3.5 drive slots. I also have a free PCI-E slot. I'm going to run a postgress database with a business intelligence application. The database size is not really set. It will be between 250-500GB running on Solaris 10 or b134. My storage

Re: [zfs-discuss] Summary: Dedup memory and performance (again, again)

2011-07-09 Thread Edward Ned Harvey
Given the abysmal performance, I have to assume there is a significant number of overhead reads or writes in order to maintain the DDT for each actual block write operation. Something I didn't mention in the other email is that I also tracked iostat throughout the whole operation. It's all

Re: [zfs-discuss] Pure SSD Pool

2011-07-09 Thread Roy Sigurd Karlsbakk
I have a dual xeon 64GB 1U server with two free 3.5 drive slots. I also have a free PCI-E slot. I'm going to run a postgress database with a business intelligence application. The database size is not really set. It will be between 250-500GB running on Solaris 10 or b134. Running

Re: [zfs-discuss] Summary: Dedup memory and performance (again, again)

2011-07-09 Thread Edward Ned Harvey
From: zfs-discuss-boun...@opensolaris.org [mailto:zfs-discuss- boun...@opensolaris.org] On Behalf Of Edward Ned Harvey When you read back duplicate data that was previously written with dedup, then you get a lot more cache hits, and as a result, the reads go faster.  Unfortunately these

Re: [zfs-discuss] Summary: Dedup memory and performance (again, again)

2011-07-09 Thread Roy Sigurd Karlsbakk
When it's not cached, of course the read time was equal to the original write time. When it's cached, it goes 4x faster. Perhaps this is only because I'm testing on a machine that has super fast storage... 11 striped SAS disks yielding 8Gbit/sec as compared to all-RAM which yielded

Re: [zfs-discuss] Replacement disks for Sun X4500

2011-07-09 Thread Roy Sigurd Karlsbakk
Oh - and as a final point - if you are planning to run Solaris on this box, make sure they are not the 4KB sector disks, as at least in my experience, their performance with ZFS is profoundly bad. Particularly with all the metadata update stuff... Hitachi deskstar uses 512byte sectors

Re: [zfs-discuss] Summary: Dedup memory and performance (again, again)

2011-07-09 Thread Edward Ned Harvey
From: Roy Sigurd Karlsbakk [mailto:r...@karlsbakk.net] Sent: Saturday, July 09, 2011 2:33 PM Could you test with some SSD SLOGs and see how well or bad the system performs? These are all async writes, so slog won't be used. Async writes that have a single fflush() and fsync() at the end

Re: [zfs-discuss] Summary: Dedup memory and performance (again, again)

2011-07-09 Thread Roy Sigurd Karlsbakk
From: Roy Sigurd Karlsbakk [mailto:r...@karlsbakk.net] Sent: Saturday, July 09, 2011 2:33 PM Could you test with some SSD SLOGs and see how well or bad the system performs? These are all async writes, so slog won't be used. Async writes that have a single fflush() and fsync() at