Re: [zfs-discuss] Pools inside pools

2010-09-28 Thread Markus Kovero
Yes. But what is enough reserved free memory? If you need 1Mb for a normal configuration you might need 2Mb when you are doing ZFS on ZFS. (I am just guessing). This is the same problem as mounting an NFS server on itself via NFS. Also not supported. The system has shrinkable caches and

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Haudy Kazemi
Mattias Pantzare wrote: On Wed, Sep 22, 2010 at 20:15, Markus Kovero markus.kov...@nebula.fi wrote: Such configuration was known to cause deadlocks. Even if it works now (which I don't expect to be the case) it will make your data to be cached twice. The CPU utilization will also be

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Haudy Kazemi
Erik Trimble wrote: On 9/22/2010 11:15 AM, Markus Kovero wrote: Such configuration was known to cause deadlocks. Even if it works now (which I don't expect to be the case) it will make your data to be cached twice. The CPU utilization will also be much higher, etc. All in all I strongly

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Markus Kovero
Isn't this a matter of not keeping enough free memory as a workspace?  By free memory, I am referring to unallocated memory and also recoverable main memory used for shrinkable read caches (shrinkable by discarding cached data).  If the system keeps enough free and recoverable memory

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Markus Kovero
What is an example of where a checksummed outside pool would not be able to protect a non-checksummed inside pool? Would an intermittent RAM/motherboard/CPU failure that only corrupted the inner pool's block before it was passed to the outer pool (and did not corrupt the outer pool's

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Haudy Kazemi
Markus Kovero wrote: What is an example of where a checksummed outside pool would not be able to protect a non-checksummed inside pool? Would an intermittent RAM/motherboard/CPU failure that only corrupted the inner pool's block before it was passed to the outer pool (and did not corrupt the

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Mattias Pantzare
On Thu, Sep 23, 2010 at 08:48, Haudy Kazemi kaze0...@umn.edu wrote: Mattias Pantzare wrote: ZFS needs free memory for writes. If you fill your memory with dirty data zfs has to flush that data to disk. If that disk is a virtual disk in zfs on the same computer those writes need more memory

Re: [zfs-discuss] Pools inside pools

2010-09-23 Thread Nicolas Williams
On Thu, Sep 23, 2010 at 06:58:29AM +, Markus Kovero wrote: What is an example of where a checksummed outside pool would not be able to protect a non-checksummed inside pool? Would an intermittent RAM/motherboard/CPU failure that only corrupted the inner pool's block before it was

[zfs-discuss] Pools inside pools

2010-09-22 Thread Markus Kovero
Hi, I'm asking for opinions here, any possible disaster happening or performance issues related in setup described below. Point being to create large pool and smaller pools within where you can monitor easily iops and bandwidth usage without using dtrace or similar techniques. 1. Create pool #

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Pawel Jakub Dawidek
On Wed, Sep 22, 2010 at 02:06:27PM +, Markus Kovero wrote: Hi, I'm asking for opinions here, any possible disaster happening or performance issues related in setup described below. Point being to create large pool and smaller pools within where you can monitor easily iops and bandwidth

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Markus Kovero
Such configuration was known to cause deadlocks. Even if it works now (which I don't expect to be the case) it will make your data to be cached twice. The CPU utilization will also be much higher, etc. All in all I strongly recommend against such setup. -- Pawel Jakub Dawidek

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Erik Trimble
On 9/22/2010 11:15 AM, Markus Kovero wrote: Such configuration was known to cause deadlocks. Even if it works now (which I don't expect to be the case) it will make your data to be cached twice. The CPU utilization will also be much higher, etc. All in all I strongly recommend against such

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Markus Kovero
Actually, the mechanics of local pools inside pools is significantly different than using remote volumes (potentially exported ZFS volumes) to build a local pool from. I don't see how, I'm referring to method where hostA shares local iscsi volume to hostB where volume is being mirrored

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Mattias Pantzare
On Wed, Sep 22, 2010 at 20:15, Markus Kovero markus.kov...@nebula.fi wrote: Such configuration was known to cause deadlocks. Even if it works now (which I don't expect to be the case) it will make your data to be cached twice. The CPU utilization will also be much higher, etc. All in all

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Maurice Volaski
If you write to a zvol on a different host (via iSCSI) those writes use memory in a different memory pool (on the other computer). No deadlock. I would expect in a usual configuration that one side of a mirrored iSCSI-based pool would be on the same host as it's underlying zvol's pool. --

Re: [zfs-discuss] Pools inside pools

2010-09-22 Thread Markus Kovero
If you write to a zvol on a different host (via iSCSI) those writes use memory in a different memory pool (on the other computer). No deadlock. I would expect in a usual configuration that one side of a mirrored iSCSI-based pool would be on the same host as it's underlying zvol's pool.