[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Katrin Fischer changed: What|Removed |Added CC||katrin.fisc...@bsz-bw.de Status|Signed Off |In Discussion --- Comment #13 from Katrin Fischer --- No consensus here yet - moving to 'in Discussion'. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #12 from Tomás Cohen Arazi --- Is pigz available on D8, D9 and supported Ubuntus? (I guess 16.04 and 18.04). While I see the advantage of having backups done faster, they are also an async task, and using all available cores in full (as a peak) might not be good for production sites. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #11 from Jonathan Druart --- Reducing the number of dependencies is on my long-term todo list, I am keeping it in mind. We could add that tips to the manpage. I am not strongly attach to it, I just wanted to get opinions on the idea. If you all think it was a bad idea, let's add a new dependency! :) -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #10 from Mason James --- (In reply to Jonathan Druart from comment #5) > One more deps, one more deps! :) > > Maybe we should use it only if installed (and not require it?) hi Jonathan a single 56k dependency, for a 3x speedup in backup time (i7-2600 cpu) why would anyone *not* want this enabled, by default? -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #9 from M. Tompsett --- (In reply to Jonathan Druart from comment #7) > (In reply to M. Tompsett from comment #6) > > It's not installed by default. > > Hum? If we didn't add the dependency, it isn't in debian by default. You have to install it. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #8 from M. Tompsett --- (In reply to Jonathan Druart from comment #7) > (In reply to M. Tompsett from comment #6) > > It's not installed by default. > > Hum? The patch adds the dependency. In debian/control, I read "koha-common > depends on pigz" Right, and it should add it, because it is kind of silly to have a patch that decides which to use if pigz is installed. People would generally not read any documentation, if there would be any, about that possibility. Because we want this out of the box, not need to know arcane knowledge to use it. This patch is just fine the way it is. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Jonathan Druart changed: What|Removed |Added CC||tomasco...@gmail.com --- Comment #7 from Jonathan Druart --- (In reply to M. Tompsett from comment #6) > It's not installed by default. Hum? The patch adds the dependency. In debian/control, I read "koha-common depends on pigz" -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #6 from M. Tompsett --- (In reply to Jonathan Druart from comment #5) > One more deps, one more deps! :) > > Maybe we should use it only if installed (and not require it?) It's not installed by default. I think adding the dependency is a good idea, as we want faster out of the box, not requiring knowing the magical incantation to get it to work. -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Jonathan Druart changed: What|Removed |Added CC||jonathan.dru...@bugs.koha-c ||ommunity.org --- Comment #5 from Jonathan Druart --- One more deps, one more deps! :) Maybe we should use it only if installed (and not require it?) -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Marcel de Rooy changed: What|Removed |Added CC||m.de.r...@rijksmuseum.nl Severity|normal |enhancement --- Comment #4 from Marcel de Rooy --- Speed up.. Sounds like an enhancement to me. Correct me when I am wrong -- You are receiving this mail because: You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett changed: What|Removed |Added Status|Needs Signoff |Signed Off -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett changed: What|Removed |Added Assignee|koha-b...@lists.koha-commun |m...@kohaaloha.com |ity.org | -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett changed: What|Removed |Added Attachment #73848|0 |1 is obsolete|| --- Comment #3 from M. Tompsett --- Created attachment 73927 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73927&action=edit Bug 20543: Use multi-core compression to speed up Koha backups to test... 1/ run backup, observe execution time $ sudo time koha-dump mylib real0m17.000s 2/ apply patch 3/ copy new koha-dump to sbin $ sudo cp debian/scripts/koha-dump /usr/sbin/koha-dump 4/ install pigz $ sudo apt-get install pigz 5/ run backup, observer execution time is less $ sudo time koha-dump mylib real0m8.000s * tested on a 4 thread system Signed-off-by: Mark Tompsett -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 M. Tompsett changed: What|Removed |Added CC||mtomp...@hotmail.com --- Comment #2 from M. Tompsett --- Nice! I used perl /home/vagrant/misc4dev/cp_debian_files.pl to place the script in place. And toggled between master and my patched branch. while true; do time sudo koha-dump kohadev; done -- had to CTRL-Z and then kill %1 to stop it, but the idea was to get a feel for multiple runs, since I was just using the default kohadev DB. Basically 1.3 (old) vs 0.8 (patched) real seconds on a laptop with 4 cores 2 threads, virtualizing the jessie box with "4" of the "8" cpus (tweaked the virtualbox settings before testing this). Times were comparable when the box only had 1 cpu. -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 Mason James changed: What|Removed |Added Status|NEW |Needs Signoff -- You are receiving this mail because: You are the assignee for the bug. You are watching all bug changes. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
[Koha-bugs] [Bug 20543] Use multi-core compression to speed up Koha backups
https://bugs.koha-community.org/bugzilla3/show_bug.cgi?id=20543 --- Comment #1 from Mason James --- Created attachment 73848 --> https://bugs.koha-community.org/bugzilla3/attachment.cgi?id=73848&action=edit Bug 20543: Use multi-core compression to speed up Koha backups to test... 1/ run backup, observe execution time $ sudo time koha-dump mylib real0m17.000s 2/ apply patch 3/ copy new koha-dump to sbin $ sudo cp debian/scripts/koha-dump /usr/sbin/koha-dump 4/ install pigz $ sudo apt-get install pigz 5/ run backup, observer execution time is less $ sudo time koha-dump mylib real0m8.000s * tested on a 4 thread system -- You are receiving this mail because: You are watching all bug changes. You are the assignee for the bug. ___ Koha-bugs mailing list Koha-bugs@lists.koha-community.org http://lists.koha-community.org/cgi-bin/mailman/listinfo/koha-bugs website : http://www.koha-community.org/ git : http://git.koha-community.org/ bugs : http://bugs.koha-community.org/
