[Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
Just in the past probably two weeks, the memory, CPU usage, and disk activity on my server have sky rocketed. My average memory usage has gone from around 500MB to nearly 1.5GB! The CPU usage has gone from one or two percent to nearly 20%. The disk activity has gone from nil to 2800 on the

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
I've had efw 2.2r3 running for 2 months for a customer that has about 30 users. The cpu use in those two months averages about 3.4% The script for rrdfix.sh is pretty simple, and seems to mainly being trying to delete files associated with system graphs: #!/bin/sh DIRS=/var/log/rrd/ /var/ntop/

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
: Wednesday, December 03, 2008 9:14 AM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 I believe it to be a 2GHz (though I'm not sure) dual core Pentium so I doubt the CPU is the problem. Running the script by hand give a few errors

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
for these directories? Do they have the same permissions? -Original Message- From: danodemano [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 03, 2008 9:14 AM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 I believe

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
Are there files in files in /var/ntop/rrd/flows/ ? - This SF.Net email is sponsored by the Moblin Your Move Developer's challenge Build the coolest Linux based applications with Moblin SDK win great prizes Grand prize is

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
This is all that is in there: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls Host Last Seen ICMP Watch NetFlow PDA Remote Round-Robin Databases compdoc wrote: Are there files in files in /var/ntop/rrd/flows/ ?

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
, December 03, 2008 9:40 AM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 This is all that is in there: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls Host Last Seen ICMP Watch NetFlow PDA Remote Round-Robin Databases

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
- From: danodemano [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 03, 2008 9:40 AM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 This is all that is in there: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls Host Last Seen ICMP

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
Well, I'm guessing those plugins you've enabled have created those directories. It sounds like rrdfix is trying to delete those directories, but not being able to. Can you tell ntop to place those files somewhere else? -

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
Not that I am aware of but since I had really just enabled them because I could, I just shut them all off and removed those directories myself as root. I rebooted the box to make sure that everything was take care of. As soon as rrdfix.sh fires back up, my CPU and memory usage still jump back

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
The other main command in rrdfix.sh is: find $DIRS -name *.rrd When I run that command by hand, I get the stuff listed below. Do you have other directories or files than that showing up? ./var/log/rrd/cpu.rrd ./var/log/rrd/mem.rrd ./var/log/rrd/disk.rrd ./var/log/rrd/GREEN.rrd

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
LOL, I think maybe we've found the problem.running that command took a FULL minute listing out what I can only guess is tens of thousands of files Most of them looks like this: /var/ntop/rrd/interfaces/br0/hosts/145/24/143/222/pktSent.rrd

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
The permissions are as such: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls -al total 8 drwx-- 2 ntop ntop 4096 Dec 3 12:17 . drwxr-xr-x 5 ntop ntop 4096 Nov 15 14:10 .. I'm not really sure how to resolve it honestlyI'm sure that there would be an easy way to fix it all and wipe all those

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread Mike Knisely
[mailto:[EMAIL PROTECTED] Sent: Wednesday, December 03, 2008 1:49 PM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 The permissions are as such: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls -al total 8 drwx-- 2 ntop ntop 4096 Dec

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread compdoc
, December 03, 2008 11:49 AM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 The permissions are as such: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls -al total 8 drwx-- 2 ntop ntop 4096 Dec 3 12:17 . drwxr-xr-x 5 ntop ntop 4096 Nov 15 14

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 The permissions are as such: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls -al total 8 drwx-- 2 ntop ntop 4096 Dec 3 12:17 . drwxr-xr-x 5 ntop ntop 4096 Nov 15 14:10 .. I'm not really sure

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread Mike Knisely
: Wednesday, December 03, 2008 1:49 PM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 The permissions are as such: [EMAIL PROTECTED]:/var/ntop/rrd/flows # ls -al total 8 drwx-- 2 ntop ntop 4096 Dec 3 12:17 . drwxr-xr-x 5

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread danodemano
03, 2008 2:50 PM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 LOL, well it would have worked greatexcept for this: -bash: /bin/tar: Argument list too long Any way around this?? compdoc, ntop is the owner on all files

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread Mike Knisely
] Sent: Wednesday, December 03, 2008 2:50 PM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 LOL, well it would have worked greatexcept for this: -bash: /bin/tar: Argument list too long Any way around this?? compdoc

Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3

2008-12-03 Thread Mike Knisely
- From: danodemano [mailto:[EMAIL PROTECTED] Sent: Wednesday, December 03, 2008 4:14 PM To: efw-user@lists.sourceforge.net Subject: Re: [Efw-user] rrdfix.sh VERY high CPU and memory usage EFW 2.2RC3 I actually ended up just TARing the whole directorywhich took somewhere around 20 minutes to do