[zfs-discuss] Monitoring zfs using dtrace

2010-10-03 Thread Paul Johnston
Apologies for cross posting but I have been looking at the probes fired when a snapshot is created. I get pa...@openindiana:~/programming/dtrace$ pfexec ./snapshots.d dtrace: script './snapshots.d' matched 54 probes CPU IDFUNCTION:NAME 0 37478

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-07 Thread Carson Gaspar
Bob Friesenhahn wrote: It seems like this Nagios script is not very useful since the notion of free memory has become antiquated. Not true. The script is simply not intelligent enough. There are really 3 broad kinds of RAM usage: A) Unused B) Unfreeable by the kernel (normal process

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-07 Thread Fajar A. Nugraha
On Wed, May 6, 2009 at 10:17 PM, Richard Elling richard.ell...@gmail.com wrote: Fajar A. Nugraha wrote: IMHO it's probably best to set a limit on ARC size and treat it like any other memory used by applications. There are a few cases where this makes sense, but not many.  The ARC will

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-07 Thread Richard Elling
Fajar A. Nugraha wrote: On Wed, May 6, 2009 at 10:17 PM, Richard Elling richard.ell...@gmail.com wrote: Fajar A. Nugraha wrote: IMHO it's probably best to set a limit on ARC size and treat it like any other memory used by applications. There are a few cases where this

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-07 Thread Moore, Joe
Carson Gaspar wrote: Not true. The script is simply not intelligent enough. There are really 3 broad kinds of RAM usage: A) Unused B) Unfreeable by the kernel (normal process memory) C) Freeable by the kernel (buffer cache, ARC, etc.) Monitoring usually should focus on keeping (A+C)

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-07 Thread Bob Friesenhahn
On Thu, 7 May 2009, Moore, Joe wrote: Carson Gaspar wrote: Not true. The script is simply not intelligent enough. There are really 3 broad kinds of RAM usage: A) Unused B) Unfreeable by the kernel (normal process memory) C) Freeable by the kernel (buffer cache, ARC, etc.) Monitoring usually

[zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Troy Nancarrow (MEL)
Hi, Please forgive me if my searching-fu has failed me in this case, but I've been unable to find any information on how people are going about monitoring and alerting regarding memory usage on Solaris hosts using ZFS. The problem is not that the ZFS ARC is using up the memory, but that the

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Fajar A. Nugraha
On Wed, May 6, 2009 at 1:08 PM, Troy Nancarrow (MEL) troy.nancar...@foxtel.com.au wrote: So how are others monitoring memory usage on ZFS servers? I think you can get the amount of memory zfs arc uses with arcstat.pl. http://www.solarisinternals.com/wiki/index.php/Arcstat IMHO it's probably

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Thomas Maier-Komor
Troy Nancarrow (MEL) schrieb: Hi, Please forgive me if my searching-fu has failed me in this case, but I've been unable to find any information on how people are going about monitoring and alerting regarding memory usage on Solaris hosts using ZFS. The problem is not that the ZFS ARC is

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Richard Elling
Fajar A. Nugraha wrote: On Wed, May 6, 2009 at 1:08 PM, Troy Nancarrow (MEL) troy.nancar...@foxtel.com.au wrote: So how are others monitoring memory usage on ZFS servers? I think you can get the amount of memory zfs arc uses with arcstat.pl.

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Bob Friesenhahn
On Wed, 6 May 2009, Troy Nancarrow (MEL) wrote: Please forgive me if my searching-fu has failed me in this case, but I've been unable to find any information on how people are going about monitoring and alerting regarding memory usage on Solaris hosts using ZFS. The problem is not that the ZFS

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Richard Elling
Bob Friesenhahn wrote: On Wed, 6 May 2009, Troy Nancarrow (MEL) wrote: Please forgive me if my searching-fu has failed me in this case, but I've been unable to find any information on how people are going about monitoring and alerting regarding memory usage on Solaris hosts using ZFS. The

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Bob Friesenhahn
On Wed, 6 May 2009, Richard Elling wrote: Memory is meant to be used. 96% RAM use is good since it represents an effective use of your investment. Actually, I think a percentage of RAM is a bogus metric to measure. For example, on a 2TBytes system, you would be wasting 80 GBytes. Perhaps

Re: [zfs-discuss] Monitoring ZFS host memory use

2009-05-06 Thread Paul Choi
Ben Rockwood's written a very useful util called arc_summary: http://www.cuddletech.com/blog/pivot/entry.php?id=979 It's really good for looking at ARC usage (including memory usage). You might be able to make some guesses based on kstat -n zfs_file_data and kstat -n zfs_file_data_buf. Look for

[zfs-discuss] Monitoring ZFS Statistic

2008-12-08 Thread Roman Ivanov
By combining two great tools arcstat and dimstat you can get ZFS statistics in: * table view * chart view * any date/time interval * host to host compare For example, online table and chart view Ream more here http://blogs.sun.com/pomah/entry/monitoring_zfs_statistic -- This

Re: [zfs-discuss] Monitoring ZFS

2006-12-13 Thread Roch - PAE
The latency issue might improve with this rfe 6471212 need reserved I/O scheduler slots to improve I/O latency of critical ops -r Tom Duell writes: Group, We are running a benchmark with 4000 users simulating a hospital management system running on Solaris 10 6/06 on USIV+ based

Re[2]: [zfs-discuss] Monitoring ZFS

2006-12-13 Thread Robert Milkowski
Hello Neil, Wednesday, December 13, 2006, 1:59:15 AM, you wrote: NP Tom Duell wrote On 12/12/06 17:11,: Group, We are running a benchmark with 4000 users simulating a hospital management system running on Solaris 10 6/06 on USIV+ based SunFire 6900 with 6540 storage array. Are there

[zfs-discuss] Monitoring ZFS

2006-12-12 Thread Tom Duell
Group, We are running a benchmark with 4000 users simulating a hospital management system running on Solaris 10 6/06 on USIV+ based SunFire 6900 with 6540 storage array. Are there any tools for measuring internal ZFS activity to help us understand what is going on during slowdowns? We have

Re: [zfs-discuss] Monitoring ZFS

2006-12-12 Thread Neil Perrin
Tom Duell wrote On 12/12/06 17:11,: Group, We are running a benchmark with 4000 users simulating a hospital management system running on Solaris 10 6/06 on USIV+ based SunFire 6900 with 6540 storage array. Are there any tools for measuring internal ZFS activity to help us understand what is

Re: [zfs-discuss] Monitoring ZFS

2006-12-12 Thread Tom Duell
Thanks, Neil, for the assistance. Tom Neil Perrin wrote On 12/12/06 19:59,: Tom Duell wrote On 12/12/06 17:11,: Group, We are running a benchmark with 4000 users simulating a hospital management system running on Solaris 10 6/06 on USIV+ based SunFire 6900 with 6540 storage array. Are