Hi Aleisha Have you tried to lower the batch commit?
see https://perldoc.koha-community.org/misc/search_tools/rebuild_elasticsearch.html Regards, Alvaro |----------------------------------------------------------------------------------------| Stay safe / Cuídate/ Reste sécurisé *7* Switch off as you go / Apaga lo que no usas / Débranchez au fur et à mesure. *q *Recycle always / Recicla siempre / Recyclez toujours P Print only if absolutely necessary / Imprime solo si es necesario / Imprimez seulement si nécessaire Le mer. 28 avr. 2021 à 23:52, Aleisha Amohia <[email protected]> a écrit : > Hi all, > > We have a site with around 600,000 authority records and have enabled > elasticsearch. Reindexing and searching has worked easily for biblios > (there are just over 10,000 biblios) but fails for authorities. > > $ sudo koha-elasticsearch --rebuild -d -a -v <instance> > [19024] Checking state of authorities index > [19024] Dropping and recreating authorities index > [19024] Indexing authorities > > And then it just hangs there for ages until the server runs out of > memory and dies. > > We're running ES 6.x on Koha 20.05.x. > > I tried running the script directly and specifying an authid and that > worked as expected. > > $ perl /usr/share/koha/bin/search_tools/rebuild_elasticsearch.pl -a -d > -v -ai 2135575 > [17684] Checking state of authorities index > [17684] Dropping and recreating authorities index > [17684] Indexing authorities > [17684] Committing final records... > [17684] Total 1 records indexed > > It feels like this is happening because we have too many authority > records. Is there a way to fix this? Has anyone come across this before? > > Thanks! > > -- > *Aleisha Amohia*(she/her) > _______________________________________________ > > Koha mailing list http://koha-community.org > [email protected] > Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha > _______________________________________________ Koha mailing list http://koha-community.org [email protected] Unsubscribe: https://lists.katipo.co.nz/mailman/listinfo/koha
