Re: [dspace-tech] DSpace statistics/logs file size control

[Andrea Schweer]

Hi Deborah, On 02/03/16 15:14, Fitchett, Deborah wrote: Our solr statistics files are large and growing, and similarly our dspace/log directory. We were looking at compressing the dspace.log files to save space but understand that: a)      The stat-monthly cronjob needs the dspace log files for the latest month, but That's correct. b)      The stat-general cronjob needs all dspace.log files present or the general/total stats that you get when you first hit the statistics page will be inaccurate. No, that isn't how it works. Once the month is over and you have the monthly .dat file, you can compress/delete/move the dspace.log files. (I believe JSPUI uses the html files created by stat-report-general / stat-report-monthly; XMLUI doesn't use these html files and consequently doesn't need you to run the stat-report-XYZ commands.) Also, just to be clear -- all of this only applies to what I call the "Admin statistics" (what you see at http://demo.dspace.org/xmlui/statistics when logged in as an administrator). The solr-based usage statistics don't read any log files at all. If by "solr statistics files" you mean the solr.log.[date] files in [dspace]/log, those are just "what's going on" type log files telling you what solr queries are being made -- they aren't read by any DSpace processes. You can delete these and/or reduce the solr log level in log4j-solr.properties to WARN or the like without losing any data; in fact I believe one of the more recent DSpace versions has some bug fixes around verbosity of the Solr logging. (Ah no, that's just for catalina.out, see https://github.com/DSpace/DSpace/commit/aaf608ceae59cbbabe0f52495a8c3834e0d942a5) I hope this helps! cheers, Andrea -- Dr Andrea Schweer Lead Software Developer, ITS Information Systems The University of Waikato, Hamilton, New Zealand +64-7-837 9120 -- You received this message because you are subscribed to the Google Groups "DSpace Technical Support" group. To unsubscribe from this group and stop receiving emails from it, send an email to dspace-tech+unsubscr...@googlegroups.com. To post to this group, send email to dspace-tech@googlegroups.com. Visit this group at https://groups.google.com/group/dspace-tech. For more options, visit https://groups.google.com/d/optout.