Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Mickaël Maillot
Hi Intel X-25 M are MLC not SLC, there are very good for L2ARC. and next, you need more RAM: ZFS can't handle 4x 80 Gb of L2ARC with only 4Gb of RAM because ZFS use memory to allocate and manage L2ARC. 2010/2/10 Felix Buenemann felix.buenem...@googlemail.com: Am 09.02.10 09:58, schrieb Felix

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Felix Buenemann
Hi Mickaël, Am 12.02.10 13:49, schrieb Mickaël Maillot: Intel X-25 M are MLC not SLC, there are very good for L2ARC. Yes, I'm only using those for L2ARC, I'm planing on getting to Mtron Pro 7500 16GB SLC SSDs for ZIL. and next, you need more RAM: ZFS can't handle 4x 80 Gb of L2ARC with

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Richard Elling
On Feb 12, 2010, at 8:20 AM, Felix Buenemann wrote: Hi Mickaël, Am 12.02.10 13:49, schrieb Mickaël Maillot: Intel X-25 M are MLC not SLC, there are very good for L2ARC. Yes, I'm only using those for L2ARC, I'm planing on getting to Mtron Pro 7500 16GB SLC SSDs for ZIL. and next, you

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Felix Buenemann
Am 12.02.10 18:17, schrieb Richard Elling: On Feb 12, 2010, at 8:20 AM, Felix Buenemann wrote: Hi Mickaël, Am 12.02.10 13:49, schrieb Mickaël Maillot: Intel X-25 M are MLC not SLC, there are very good for L2ARC. Yes, I'm only using those for L2ARC, I'm planing on getting to Mtron Pro 7500

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Bill Sommerfeld
On 02/12/10 09:36, Felix Buenemann wrote: given I've got ~300GB L2ARC, I'd need about 7.2GB RAM, so upgrading to 8GB would be enough to satisfy the L2ARC. But that would only leave ~800MB free for everything else the server needs to do. - Bill

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Richard Elling
On Feb 12, 2010, at 9:36 AM, Felix Buenemann wrote: Am 12.02.10 18:17, schrieb Richard Elling: On Feb 12, 2010, at 8:20 AM, Felix Buenemann wrote: Hi Mickaël, Am 12.02.10 13:49, schrieb Mickaël Maillot: Intel X-25 M are MLC not SLC, there are very good for L2ARC. Yes, I'm only using

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Daniel Carosone
On Fri, Feb 12, 2010 at 11:26:33AM -0800, Richard Elling wrote: Mathing aorund a bit, for a 300 GB L2ARC (apologies for the tab separation): size (GB) 300 size (sectors) 585937500 labels (sectors)9232 available

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-12 Thread Brendan Gregg - Sun Microsystems
G'Day, On Sat, Feb 13, 2010 at 09:02:58AM +1100, Daniel Carosone wrote: On Fri, Feb 12, 2010 at 11:26:33AM -0800, Richard Elling wrote: Mathing aorund a bit, for a 300 GB L2ARC (apologies for the tab separation): size (GB) 300 size (sectors) 585937500

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-09 Thread Felix Buenemann
Am 09.02.10 02:30, schrieb Bob Friesenhahn: On Tue, 9 Feb 2010, Felix Buenemann wrote: Well to make things short: Using JBOD + ZFS Striped Mirrors vs. controller's RAID10, dropped the max. sequential read I/O from over 400 MByte/s to below 300 MByte/s. However random I/O and sequential writes

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Felix Buenemann
Hi Daniel, Am 08.02.10 05:45, schrieb Daniel Carosone: On Mon, Feb 08, 2010 at 04:58:38AM +0100, Felix Buenemann wrote: I have some questions about the choice of SSDs to use for ZIL and L2ARC. I have one answer. The other questions are mostly related to your raid controller, which I can't

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Bob Friesenhahn
On Mon, 8 Feb 2010, Felix Buenemann wrote: I was under the impression, that using HW RAID10 would save me 50% PCI bandwidth and allow the controller to more intelligently handle its cache, so I sticked with it. But I should run some benchmarks in RAID10 vs. JBOD with ZFS mirrors to see if

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Richard Elling
To add to Bob's notes... On Feb 8, 2010, at 8:37 AM, Bob Friesenhahn wrote: On Mon, 8 Feb 2010, Felix Buenemann wrote: I was under the impression, that using HW RAID10 would save me 50% PCI bandwidth and allow the controller to more intelligently handle its cache, so I sticked with it.

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Bob Friesenhahn
On Mon, 8 Feb 2010, Richard Elling wrote: If there is insufficient controller bandwidth capacity, then the controller becomes the bottleneck. We don't tend to see this for HDDs, but SSDs can crush a controller and channel. It is definitely seen with older PCI hardware. Bob -- Bob

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Felix Buenemann
Am 08.02.10 22:23, schrieb Bob Friesenhahn: On Mon, 8 Feb 2010, Richard Elling wrote: If there is insufficient controller bandwidth capacity, then the controller becomes the bottleneck. We don't tend to see this for HDDs, but SSDs can crush a controller and channel. It is definitely seen

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-08 Thread Bob Friesenhahn
On Tue, 9 Feb 2010, Felix Buenemann wrote: Well to make things short: Using JBOD + ZFS Striped Mirrors vs. controller's RAID10, dropped the max. sequential read I/O from over 400 MByte/s to below 300 MByte/s. However random I/O and sequential writes seemed to perform Much of the difference

[zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-07 Thread Felix Buenemann
I have some questions about the choice of SSDs to use for ZIL and L2ARC. I'm trying to build an OpenSolaris iSCSI SAN out of a whitebox system, which is intended to be used as a backup SAN during storage migration, so it's built on a tight budget. The system currently has 4GB RAM, 3GHz

Re: [zfs-discuss] ZFS ZIL + L2ARC SSD Setup

2010-02-07 Thread Daniel Carosone
On Mon, Feb 08, 2010 at 04:58:38AM +0100, Felix Buenemann wrote: I have some questions about the choice of SSDs to use for ZIL and L2ARC. I have one answer. The other questions are mostly related to your raid controller, which I can't answer directly. - Is it safe to run the L2ARC without