Hello Peter, I run the remove_spiders script once every 3-5 days. My server access logs are written as daily logs; running the script on one 'day' of logs takes 3-4 minutes, Java @ 100% CPU, postmaster @ 20% CPU, though low on memory usage. Never tried to improve this at all. Could be put into a cron job at low usage times but of course you may prefer/have to do the second step manually.
Hope this is of some help. Best regards, Joseph Greene Institutional Repository Project Manager 325 James Joyce Library University College Dublin Belfield, Dublin 4 353 (0)1 716 7398 joseph.gre...@ucd.ie http://irserver.ucd.ie/dspace/ -----Original Message----- From: dspace-tech-requ...@lists.sourceforge.net [mailto:dspace-tech-requ...@lists.sourceforge.net] Sent: 10 February 2010 09:46 To: dspace-tech@lists.sourceforge.net Subject: DSpace-tech Digest, Vol 46, Issue 22 Message: 5 Date: Wed, 10 Feb 2010 10:33:20 +0100 From: "Peter van Wonderen" <p.v.wonde...@ubvu.vu.nl> Subject: [Dspace-tech] Dspace Minho add-on using reasing resources heavily when removing spiders To: <dspace-tech@lists.sourceforge.net> Message-ID: <436ebe781aa8e345b54c13c393879875020de...@dizzy.ubvu.vu.nl> Content-Type: text/plain; charset="us-ascii" Is anyone of you using the Minho statistics add-on? And do you have experience running the org.dspace.stats.util.Spiders script? It is using a lot of processor resources. And it takes quite a long time to remove records especially from the stats.view table. Do you have the same experience? Or might this require better tuning of our Linux server? I would appreciate if you could share your experience with me. Kind regards, Peter van Wonderen Vrije Universiteit University Library De Boelelaan 1105 1082 HV Amsterdam The Netherlands +31-20-5985112 -------------- next part -------------- An HTML attachment was scrubbed... ------------------------------ ---------------------------------------------------------------------------- -- SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev ------------------------------ _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech End of DSpace-tech Digest, Vol 46, Issue 22 ******************************************* ------------------------------------------------------------------------------ SOLARIS 10 is the OS for Data Centers - provides features such as DTrace, Predictive Self Healing and Award Winning ZFS. Get Solaris 10 NOW http://p.sf.net/sfu/solaris-dev2dev _______________________________________________ DSpace-tech mailing list DSpace-tech@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/dspace-tech
