Great. Looks like adding --incremental has done the trick. Last night we only added 513 new records, and only a few of those were from the update_totalissues.pl script. Since it looks like there's already a log rotation option I can tweak, I think I'm in a good place now. If I were to still suggest any changes, it would be an option to _**not put the entire biblio record into the log**_ for that task, and instead maybe just log the prior issues counts.
*Joel Coehoorn* Director of Information Technology *York University* Office: 402-363-5603 | [email protected] | york.edu On Thu, Aug 31, 2023 at 5:38 PM Fridolin SOMERS < [email protected]> wrote: > Hi, > > You can use daily cron : cleanup_database.pl --logs DAYS > > > https://git.koha-community.org/Koha-community/Koha/src/branch/master/misc/cronjobs/cleanup_database.pl#L88 > > Le 31/08/2023 à 06:17, Coehoorn, Joel a écrit : > > I found the --incremental was missing. This is an installation that has > > evolved since before 2016, so I suspect it predates that addition. I've > > added it and am monitoring to see if growth is more reasonable. > > > > What I may submit as a bug report or feature request is an option to > > rotate these logs. So we'd add a background task to delete records older > > than some reasonable (possibly configurable) number. This would keep the > > table from growing indefinitely. > > > > *Joel Coehoorn* > > Director of Information Technology > > *York University* > > Office: 402-363-5603 | [email protected] <mailto:[email protected]> | > > york.edu <https://york.edu> > > > > > > > > On Thu, Aug 31, 2023 at 3:22 AM Fridolin SOMERS > > <[email protected] <mailto:[email protected]>> > wrote: > > > > Do you use update_totalissues.pl <http://update_totalissues.pl> with > > --incremental ? > > > > Le 30/08/2023 à 21:37, Jonathan Druart a écrit : > > > Hi Joel, > > > > > > We could skip the logging when the biblio is modified by this > > cronjob, > > > please report this problem in a new bug report. > > > > > > Regards, > > > Jonathan > > > > > > Le mar. 29 août 2023 à 21:22, Coehoorn, Joel <[email protected] > > <mailto:[email protected]>> a écrit : > > >> > > >> We're seeing a large quantity of records filling the action_logs > > table... > > >> nearly 18,000 in the last 24 hours. This in turn uses a LOT of > disk > > >> space... it was briefly over 90GB until I intervened, and > > because MySQL is > > >> dumb about shrinking tables we were fortunate I caught it in > time. > > >> > > >> It looks like the update_totalissues.pl > > <http://update_totalissues.pl> script is running every night and > > >> putting the entire biblio record into the info column in the > > table for > > >> every record we have. > > >> > > >> What could be causing this, and how can I stop it (without > > disabling the > > >> job completely, which I assume is part of Koha and important)? > > >> > > >> *Joel Coehoorn* > > >> Director of Information Technology > > >> *York University* > > >> Office: 402-363-5603 | [email protected] > > <mailto:[email protected]> | york.edu <http://york.edu> > > >> > > >> *Please contact [email protected] <mailto:[email protected]> > > <[email protected] <mailto:[email protected]>> for technical > > >> assistance.* > > >> > > >> > > >> The mission of York University is to transform lives through > > >> Christ-centered education and to equip students for lifelong > > service to > > >> God, family, and society > > >> _______________________________________________ > > >> > > >> Koha mailing list http://koha-community.org > > <http://koha-community.org> > > >> [email protected] <mailto:[email protected]> > > >> Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > > <https://lists.katipo.co.nz/mailman/listinfo/koha> > > > _______________________________________________ > > > > > > Koha mailing list http://koha-community.org > > <http://koha-community.org> > > > [email protected] <mailto:[email protected]> > > > Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > > <https://lists.katipo.co.nz/mailman/listinfo/koha> > > > > -- > > Fridolin SOMERS <[email protected] > > <mailto:[email protected]>> > > Software and system maintainer 🦄 > > BibLibre, France > > _______________________________________________ > > > > Koha mailing list http://koha-community.org < > http://koha-community.org> > > [email protected] <mailto:[email protected]> > > Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > > <https://lists.katipo.co.nz/mailman/listinfo/koha> > > > > -- > Fridolin SOMERS <[email protected]> > Software and system maintainer 🦄 > BibLibre, France > _______________________________________________ > > Koha mailing list http://koha-community.org > [email protected] > Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > _______________________________________________ Koha mailing list http://koha-community.org [email protected] Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
