Hi, Ryan.

Logs are a huge issue for us too—mostly the ones in [dspace]/log/ like
solr.log and dspace.log:

$ du -sh /dspace/log/*.log* | sort -h
...
542M    /dspace/log/solr.log.2016-12-02
723M    /dspace/log/solr.log
775M    /dspace/log/solr.log.2016-12-01
945M    /dspace/log/solr.log.2016-12-10
959M    /dspace/log/solr.log.2016-12-11
979M    /dspace/log/solr.log.2016-12-08
983M    /dspace/log/solr.log.2016-12-12
998M    /dspace/log/solr.log.2016-12-03
999M    /dspace/log/solr.log.2016-12-04
1.1G    /dspace/log/solr.log.2016-12-05
1.1G    /dspace/log/solr.log.2016-12-06
1.3G    /dspace/log/solr.log.2016-12-07
1.4G    /dspace/log/solr.log.2016-12-09

Right now I have a series of cron jobs that finds log files older than a
month and zips them with xz, sends them to Amazon S3, and then deletes
them. It's been a year or so since I modified the heuristics so I
definitely need to look at it again. We're still using the legacy stats I
think, which requires having the whole month of logs available during
processing.

Tomcat's logs aren't too heavy, but I will probably disable Tomcat access
logs eventually. In theory they are interesting to look at in case of
issues, but in practice I never do (rather look at dspace.log, solr.log,
and catalina.out).

Cheers,

On Tue, Dec 13, 2016 at 1:29 AM Steans, Ryan J <[email protected]>
wrote:

> We’re seeing an issue with our logs building up quite a bit in our root
> volume.
>
>
>
> I’m wondering if we can get some advice on whether we should
>
>
>
> 1) Implement a more aggressive rotation policy (e.g. only keep the logs a
> week).
>
> 2) Turn off Tomcat access logging entirely.
>
>
>
> Thanks
>
>
>
> *Ryan Steans*
>
> Assistant Director
>
> Texas Digital Library
>
> 512-495-4403
>
> ORCiD:  0000-0002-7151-5613
>
>
>
> Web: http://www.tdl.org/
>
> Twitter: @TxDigLibrary <http://twitter.com/TXDigLibrary>
>
> Facebook: http://www.facebook.com/texasdigitallibrary
>
> Join the e-mail list: http://tdl.org/news/newsletters/newsletter-signup/
>
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "DSpace Technical Support" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to [email protected].
> To post to this group, send email to [email protected].
> Visit this group at https://groups.google.com/group/dspace-tech.
> For more options, visit https://groups.google.com/d/optout.
>
-- 

Alan Orth
[email protected]
https://englishbulgaria.net
https://alaninkenya.org
https://mjanja.ch

-- 
You received this message because you are subscribed to the Google Groups 
"DSpace Technical Support" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To post to this group, send email to [email protected].
Visit this group at https://groups.google.com/group/dspace-tech.
For more options, visit https://groups.google.com/d/optout.

Reply via email to