https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=36484
--- Comment #9 from David Cook <[email protected]> --- Thanks for providing more info, Alex. Much appreciated! (In reply to Alex Buckley from comment #7) > The use case we have is, a partner library has 359 background jobs with: > - type='update_elastic_index' > - status='new' > > Even though koha-worker and koha-es-indexer are running these 359 jobs are > stuck on the status of new and are not being processed. I have 50+ instances running Elasticsearch, and I have seen that symptom with 1 of them. It has other issues related to Elasticsearch indexing too though (like bizarre timeouts when the indexer is processing). I'm still looking into it. I have some plans to improve /usr/share/koha/bin/workers/es_indexer_daemon.pl as I don't think it's managing well enough. That said, in this case, it could be that the web app is failing to enqueue the task at all in RabbitMQ. I'll be looking into that side of things too. > RabbitMQ is not looking for outstanding jobs instead it is only listening to > new jobs - in a similar situation to > https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=30654 So RabbitMQ doesn't look for jobs. It's just a message broker. So I'm not sure what you mean there. I think you probably mean the es_indexer_daemon.pl. You might see that I've been fairly critical of 30654 hehe. > This enhancement ensures when we start koha-common services like koha-worker > and koha-es-indexer all these new 'update_elastic_index' jobs are processed > and not ignored. These patches would probably help in the short-term but they won't help us to resolve the underlying problem, so I'm a bit wary. For this scenario, I'm thinking that we need a tool to re-queue backgrounds jobs. That should help us to get the tasks pumping through on-demand without covering up the underlying problem. -- That all said, I agree that we need to improve the Elasticsearch indexing ASAP. While it works well for 98% of my libraries, I want it to work perfectly for 100% of them. -- You are receiving this mail because: You are watching all bug changes. _______________________________________________ Koha-bugs mailing list [email protected] https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
