Oh awesome, that will let us save a lot of space indeed! Thanks very much!

Deborah

From: Andrea Schweer [mailto:[email protected]]
Sent: Wednesday, 2 March 2016 4:04 p.m.
To: Fitchett, Deborah <[email protected]>; 
[email protected]
Subject: Re: [dspace-tech] DSpace statistics/logs file size control

Hi Deborah,
On 02/03/16 15:14, Fitchett, Deborah wrote:
Our solr statistics files are large and growing, and similarly our dspace/log 
directory. We were looking at compressing the dspace.log files to save space 
but understand that:

a)      The stat-monthly cronjob needs the dspace log files for the latest 
month, but

That's correct.



b)      The stat-general cronjob needs all dspace.log files present or the 
general/total stats that you get when you first hit the statistics page will be 
inaccurate.

No, that isn't how it works. Once the month is over and you have the monthly 
.dat file, you can compress/delete/move the dspace.log files. (I believe JSPUI 
uses the html files created by stat-report-general / stat-report-monthly; XMLUI 
doesn't use these html files and consequently doesn't need you to run the 
stat-report-XYZ commands.)

Also, just to be clear -- all of this only applies to what I call the "Admin 
statistics" (what you see at http://demo.dspace.org/xmlui/statistics when 
logged in as an administrator).

The solr-based usage statistics don't read any log files at all. If by "solr 
statistics files" you mean the solr.log.[date] files in [dspace]/log, those are 
just "what's going on" type log files telling you what solr queries are being 
made -- they aren't read by any DSpace processes. You can delete these and/or 
reduce the solr log level in log4j-solr.properties to WARN or the like without 
losing any data; in fact I believe one of the more recent DSpace versions has 
some bug fixes around verbosity of the Solr logging. (Ah no, that's just for 
catalina.out, see 
https://github.com/DSpace/DSpace/commit/aaf608ceae59cbbabe0f52495a8c3834e0d942a5)

I hope this helps!

cheers,
Andrea



--

Dr Andrea Schweer

Lead Software Developer, ITS Information Systems

The University of Waikato, Hamilton, New Zealand

+64-7-837 9120

________________________________
P Please consider the environment before you print this email.
"The contents of this e-mail (including any attachments) may be confidential 
and/or subject to copyright. Any unauthorised use, distribution, or copying of 
the contents is expressly prohibited. If you have received this e-mail in 
error, please advise the sender by return e-mail or telephone and then delete 
this e-mail together with all attachments from your system."

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Reply via email to