[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Marcel de Rooy changed: What|Removed |Added Blocks||35092 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=35092 [Bug 35092] [OMNIBUS] Remaining background job/worker issues -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Michael Adamyk changed: What|Removed |Added CC||mada...@ckls.org -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 --- Comment #5 from David Cook --- So bug 32594 introduced an "elastic_index" queue and a worker that could batch together indexing jobs. Bug 32558 added forking so that workers could process more jobs. The idea here is that we'd have a "real_time_holds_queue" so that a worker could just be devoted to that instead of competing with other jobs? -- We do need to work on a better way of setting up workers, because a smaller library will have more limited computing power, and probably will need fewer workers to handle all the jobs, while larger libraries with more computing power will want to have more workers for more separate queues... -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Brenda changed: What|Removed |Added CC||bow...@washoecounty.us -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Laura Escamilla changed: What|Removed |Added CC||Laura.escamilla@bywatersolu ||tions.com --- Comment #4 from Laura Escamilla --- *** Bug 34596 has been marked as a duplicate of this bug. *** -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Bug 32572 depends on bug 32594, which changed state. Bug 32594 Summary: Add a dedicated ES indexing background worker https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32594 What|Removed |Added Status|Pushed to stable|RESOLVED Resolution|--- |FIXED -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Phil Ringnalda changed: What|Removed |Added CC||p...@chetcolibrary.org -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 David Cook changed: What|Removed |Added CC||dc...@prosentient.com.au -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Emily Lamancusa changed: What|Removed |Added Severity|enhancement |major --- Comment #3 from Emily Lamancusa --- I'm upping the severity of this bug as well as bug 32558, because being limited to 2 background worker processes is causing us some pretty significant issues with the volume of background jobs we generate - we've had to turn the real time holds queue off because the workers couldn't keep up. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Emily Lamancusa changed: What|Removed |Added CC||emily.lamancusa@montgomeryc ||ountymd.gov -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Nick Clemens changed: What|Removed |Added Depends on||32594 Referenced Bugs: https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32594 [Bug 32594] Add a dedicated ES indexing background worker -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 --- Comment #2 from Nick Clemens --- (In reply to Jonathan Druart from comment #1) > (In reply to Nick Clemens from comment #0) > > Fetch ES jobs until we hit 100 records or run out of queue, then index 100 > > at a time > > Indexing 1 record at a time takes a long time for each record > > Isn't the problem koha-side actually, where we should batch update the index > instead of call index_records for each record? The problem is not for a batch action, but for a series of individual actions i.e. 10 checkins happening one after another, then scale that to a site with 50 branches, all checking in their dropbox - 500 single index actions enqueued -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Jonathan Druart changed: What|Removed |Added CC||jonathan.druart+koha@gmail. ||com --- Comment #1 from Jonathan Druart --- (In reply to Nick Clemens from comment #0) > Fetch ES jobs until we hit 100 records or run out of queue, then index 100 > at a time > Indexing 1 record at a time takes a long time for each record Isn't the problem koha-side actually, where we should batch update the index instead of call index_records for each record? -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 32572] We should have a background queue for each job type
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=32572 Nick Clemens changed: What|Removed |Added See Also||https://bugs.koha-community ||.org/bugzilla3/show_bug.cgi ||?id=32558 -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org https://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
