Re: [zfs-discuss] ZIL to disk

2010-01-16 Thread Jeffry Molanus
Thx all, I understand now. BR, Jeffry if an application requests a synchronous write then it is commited to ZIL immediately, once it is done the IO is acknowledged to application. But data written to ZIL is still in memory as part of an currently open txg and will be committed to a pool

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Jeffry Molanus
Sometimes people get confused about the ZIL and separate logs. For sizing purposes, the ZIL is a write-only workload. Data which is written to the ZIL is later asynchronously written to the pool when the txg is committed. Right; the tgx needs time to transfer the ZIL. The ZFS write

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Neil Perrin
On 01/15/10 12:59, Jeffry Molanus wrote: Sometimes people get confused about the ZIL and separate logs. For sizing purposes, the ZIL is a write-only workload. Data which is written to the ZIL is later asynchronously written to the pool when the txg is committed. Right; the tgx needs time

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Scott Meilicke
I think Y is such a variable and complex number it would be difficult to give a rule of thumb, other than to 'test with your workload'. My server, having three, five disk raidzs (striped) and an intel x25-e as a zil can fill my two G ethernet pipes over NFS (~200MBps) during mostly sequential

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Al Hopper
On Fri, Jan 15, 2010 at 1:59 PM, Jeffry Molanus jeffry.mola...@proact.nl wrote: Sometimes people get confused about the ZIL and separate logs. For sizing purposes, the ZIL is a write-only workload.  Data which is written to the ZIL is later asynchronously written to the pool when the txg is

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Jeffry Molanus
-Original Message- From: neil.per...@sun.com [mailto:neil.per...@sun.com] I think you misunderstand the function of the ZIL. It's not a journal, and doesn't get transferred to the pool as of a txg. It's only ever written except after a crash it's read to do replay. See:

Re: [zfs-discuss] ZIL to disk

2010-01-15 Thread Robert Milkowski
On 16/01/2010 00:09, Jeffry Molanus wrote: -Original Message- From: neil.per...@sun.com [mailto:neil.per...@sun.com] I think you misunderstand the function of the ZIL. It's not a journal, and doesn't get transferred to the pool as of a txg. It's only ever written except

[zfs-discuss] ZIL to disk

2010-01-14 Thread Jeffry Molanus
Hi all, Are there any recommendations regarding min IOPS the backing storage pool needs to have when flushing the SSD ZIL to the pool? Consider a pool of 3x 2TB SATA disks in RAIZ1, you would roughly have 80 IOPS. Any info about the relation between ZIL pool performance? Or will the ZIL

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Bob Friesenhahn
On Thu, 14 Jan 2010, Jeffry Molanus wrote: Are there any recommendations regarding min IOPS the backing storage pool needs to have when flushing the SSD ZIL to the pool? Consider a pool of 3x 2TB SATA disks in RAIZ1, you would roughly have 80 IOPS. Any info about the relation between ZIL

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Jeffry Molanus
There are different kinds of IOPS. The expensive ones are random IOPS whereas sequential IOPS are much more efficient. The intention of the SSD-based ZIL is to defer the physical write so that would-be random IOPS can be converted to sequential scheduled IOPS like a normal write. ZFS

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Richard Elling
On Jan 14, 2010, at 10:58 AM, Jeffry Molanus wrote: Hi all, Are there any recommendations regarding min IOPS the backing storage pool needs to have when flushing the SSD ZIL to the pool? Pedantically, as many as you can afford :-) The DDRdrive folks sell IOPS at 200 IOPS/$. Sometimes

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Ray Van Dolson
On Thu, Jan 14, 2010 at 03:41:17PM -0800, Richard Elling wrote: Consider a pool of 3x 2TB SATA disks in RAIZ1, you would roughly have 80 IOPS. Any info about the relation between ZIL pool performance? Or will the ZIL simply fill up and performance drops to pool speed? The ZFS write

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Ray Van Dolson
On Thu, Jan 14, 2010 at 03:55:20PM -0800, Ray Van Dolson wrote: On Thu, Jan 14, 2010 at 03:41:17PM -0800, Richard Elling wrote: Consider a pool of 3x 2TB SATA disks in RAIZ1, you would roughly have 80 IOPS. Any info about the relation between ZIL pool performance? Or will the ZIL

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Richard Elling
On Jan 14, 2010, at 3:59 PM, Ray Van Dolson wrote: On Thu, Jan 14, 2010 at 03:55:20PM -0800, Ray Van Dolson wrote: On Thu, Jan 14, 2010 at 03:41:17PM -0800, Richard Elling wrote: Consider a pool of 3x 2TB SATA disks in RAIZ1, you would roughly have 80 IOPS. Any info about the relation

Re: [zfs-discuss] ZIL to disk

2010-01-14 Thread Richard Elling
On Jan 14, 2010, at 4:02 PM, Richard Elling wrote: That is a simple performance model for small, random reads. The ZIL is a write-only workload, so the model will not apply. BTW, it is a Good Thing (tm) the small, random read model does not apply to the ZIL. -- richard