Re[2]: [zfs-discuss] Re: Re: ZFS forces system to paging to the point it is

2006-09-13 Thread Robert Milkowski
Hello Philippe,

It was recommended to lower ncsize and I did (to default ~128K).
So far it works ok for last days and staying at about 1GB free ram
(fluctuating between 900MB-1,4GB).

Do you think it's a long term solution or with more load and more data
the problem can surface again even with current ncsize value?


-- 
Best regards,
 Robertmailto:[EMAIL PROTECTED]
   http://milek.blogspot.com

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Re: Re: ZFS forces system to paging to the point it is

2006-09-13 Thread Mark Maybee

Robert Milkowski wrote:

Hello Philippe,

It was recommended to lower ncsize and I did (to default ~128K).
So far it works ok for last days and staying at about 1GB free ram
(fluctuating between 900MB-1,4GB).

Do you think it's a long term solution or with more load and more data
the problem can surface again even with current ncsize value?


Robert,

I don't think this should be impacted too much by load/data, as long
as the DNLC is able to evict, you should be in good shape.  We are
still working on a fix for the root cause of this issue however.

-Mark
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re[2]: [zfs-discuss] Re: Re: ZFS forces system to paging to the point it is

2006-09-07 Thread Robert Milkowski
Hello Mark,

Thursday, September 7, 2006, 12:32:32 AM, you wrote:

MM Robert Milkowski wrote:
 
 
 On Wed, 6 Sep 2006, Mark Maybee wrote:
 
 Robert Milkowski wrote:

 ::dnlc!wc


  1048545 3145811 76522461

 Well, that explains half your problem... and maybe all of it:
 
 
 
 After I reduced vdev prefetch from 64K to 8K for last few hours system 
 is working properly without workaround and free memory stays at about 1GB.
 
 Reducing vdev prefetch to 8K alse reduced read thruoutput 10x.
 
 I belive this is somehow related - maybe vdev cache was so aggressive (I 
 got 40-100MB/s of reads) and consuming memory so fast that thread which 
 is supposed to regain some memory couldn't keep up?

MM I suppose, although the data volume doesn't seem that high... maybe you
MM are just operating at the hairy edge here.  Anyway, I have filed a bug
MM to track this issue:

MM 6467963 do_dnlc_reduce_cache() can be blocked by ZFS_OBJ_HOLD_ENTER()

Well, it was working so far and then in less than 5 minutes free
memory went to 0 and system was unresponsive I couldn't log in.

So I guess exporting/importing pool and in addition lowering vdev
prefetch to 8K is needed here. Hope it will stay longer that way.

:(

-- 
Best regards,
 Robertmailto:[EMAIL PROTECTED]
   http://milek.blogspot.com

___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


[zfs-discuss] Re: Re: ZFS forces system to paging to the point it is

2006-09-06 Thread Robert Milkowski
 ::dnlc!wc
 1048545 3145811 76522461

 
 
This message posted from opensolaris.org
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss


Re: [zfs-discuss] Re: Re: ZFS forces system to paging to the point it is

2006-09-06 Thread Mark Maybee

Robert Milkowski wrote:



On Wed, 6 Sep 2006, Mark Maybee wrote:


Robert Milkowski wrote:


::dnlc!wc



 1048545 3145811 76522461


Well, that explains half your problem... and maybe all of it:




After I reduced vdev prefetch from 64K to 8K for last few hours system 
is working properly without workaround and free memory stays at about 1GB.


Reducing vdev prefetch to 8K alse reduced read thruoutput 10x.

I belive this is somehow related - maybe vdev cache was so aggressive (I 
got 40-100MB/s of reads) and consuming memory so fast that thread which 
is supposed to regain some memory couldn't keep up?


I suppose, although the data volume doesn't seem that high... maybe you
are just operating at the hairy edge here.  Anyway, I have filed a bug
to track this issue:

6467963 do_dnlc_reduce_cache() can be blocked by ZFS_OBJ_HOLD_ENTER()

-Mark
___
zfs-discuss mailing list
zfs-discuss@opensolaris.org
http://mail.opensolaris.org/mailman/listinfo/zfs-discuss