[analog-help] Memory usage,
Hi all, I know this is a subject that has been discussed in some details previously, I have looked through the archives and found lots of useful information, some of which does appear to have helped with my problem. I note however that for many people who are reporting memory usage problems they are dealing with much larger log files than I am, and that their efforts are actually failing due to 'not enough memory' I am currently analysing logs varying in size, but most recently of around 350,000 entries. My system has 1Gb of RAM, which should, I think, be adequate. Analog does complete okay, and eventually I am getting the results I require - so the amount of memory being used is not my key problem at the moment. However, the memory analog uses at run time does not seem to be freed after usage - I have just processed a logfile of around 100MB and 350,000 entries. I now have only 28mb of free memory, and around 1Gb used. This then obviously has a knock on effect on any subsequent runs and the other functions of the server. Any pointers or suggestions you can give me to help pinpoint the cause of, and remedy the issues I'm seeing would be gratefully received. Regards Lee -- Lee Evans + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Memory usage,
Lee Evans [EMAIL PROTECTED] wrote: Any pointers or suggestions you can give me to help pinpoint the cause of, and remedy the issues I'm seeing would be gratefully received. What Operating System are you using? Aengus + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Memory usage,
On Thu, 24 Jun 2004, Lee Evans wrote: However, the memory analog uses at run time does not seem to be freed after usage - I have just processed a logfile of around 100MB and 350,000 entries. I now have only 28mb of free memory, and around 1Gb used. This is surely impossible. It's under the control of the OS, not the program, and any OS which didn't free memory when programs quit would crash very quickly indeed. Maybe whatever tool you are using isn't reporting the free memory accurately (or at least, not reporting a useful statistic). -- Stephen Turner, Cambridge, UKhttp://homepage.ntlworld.com/adelie/stephen/ Low Priced Cambridge Clare College. Big selection at eBay UK! (Ad after Google search for Clare College Cambridge) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
RE: [analog-help] Memory usage,
Aha - good question! Sorry. Linux x86 - Redhat 7.2 Analog 5.32 Cheers lee -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: 24 June 2004 14:59 To: [EMAIL PROTECTED] Subject: Re: [analog-help] Memory usage, Lee Evans [EMAIL PROTECTED] wrote: Any pointers or suggestions you can give me to help pinpoint the cause of, and remedy the issues I'm seeing would be gratefully received. What Operating System are you using? Aengus +--- +- | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +--- +- + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
RE: [analog-help] Memory usage,
This is surely impossible. It's under the control of the OS, not the program, and any OS which didn't free memory when programs quit would crash very quickly indeed. Maybe whatever tool you are using isn't reporting the free memory accurately (or at least, not reporting a useful statistic). [EMAIL PROTECTED] local]# cat /proc/meminfo total:used:free: shared: buffers: cached: Mem: 1188331520 1123258368 650731520 14237696 1057882112 Swap: 271425536 9392128 262033408 No other programs seem to have the same effect (if I don't run analog the system never seems to touch even 300mb used), despite this the system does appear completely stable (even if a little sluggish!) Thanks for your help Lee + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
Re: [analog-help] Memory usage,
meminfo (and top, etc.) on Linux will always look like that. The OS does not report allocated memory as free once it has been allocated. Rather, it will be listed as used but in actuality is available to other process to use. It's something like a lazy garbage collection -- it only cleans up when there is a need for it. If you actually run analog again, I think you will find that you have no problems running it at all. Or any other program. -- Jeremy Wadsack Seven Simple Machines Lee Evans wrote: This is surely impossible. It's under the control of the OS, not the program, and any OS which didn't free memory when programs quit would crash very quickly indeed. Maybe whatever tool you are using isn't reporting the free memory accurately (or at least, not reporting a useful statistic). [EMAIL PROTECTED] local]# cat /proc/meminfo total:used:free: shared: buffers: cached: Mem: 1188331520 1123258368 650731520 14237696 1057882112 Swap: 271425536 9392128 262033408 No other programs seem to have the same effect (if I don't run analog the system never seems to touch even 300mb used), despite this the system does appear completely stable (even if a little sluggish!) + | TO UNSUBSCRIBE from this list: |http://lists.isite.net/listgate/analog-help/unsubscribe.html | | Digest version: http://lists.isite.net/listgate/analog-help-digest/ | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +
