Re: --create-testdir eats CPU and does nothing
On Sonntag, 6. August 2017 07:09:23 CEST Dmitry Selyutin wrote: > Hi everyone! > > I'm amazed that someone still remembers this project. Looking at its > sources, I see that there is room for improvement, but still the overall > project structure may still be integrated into gnulib. I would be glad to > continue working on the project in my free time, though my Python skills > are a bit rusty. As for parallelization, I think it may be a good idea to > use Python 3 since it now has some form of Go-like coroutines IIRC. > > Do you think it's a good idea to revive the old project? It seems that it > may still be useful. It sounds like you have been pretty far with that project. I would love to see it working with the current gnulib. Please let me know when it is ready to be tested. Regards, Tim signature.asc Description: This is a digitally signed message part.
Re: --create-testdir eats CPU and does nothing
Hi everyone! I'm amazed that someone still remembers this project. Looking at its sources, I see that there is room for improvement, but still the overall project structure may still be integrated into gnulib. I would be glad to continue working on the project in my free time, though my Python skills are a bit rusty. As for parallelization, I think it may be a good idea to use Python 3 since it now has some form of Go-like coroutines IIRC. Do you think it's a good idea to revive the old project? It seems that it may still be useful.
Re: --create-testdir eats CPU and does nothing
On Samstag, 5. August 2017 18:34:58 CEST Bruno Haible wrote: > Tim Rühsen wrote: > > > $ ./gnulib-tool --create-testdir --dir=../testdir1 > > > gnulib-tool: warning: module euidaccess depends on a module with an > > > incompatible license: group-member > > > > Correction, it came back after ~20 minutes. > > You have a fast machine. > > > Is there any chance to parallelize the work of ./gnulib-tool ? The machine > > was just 6-7% idle. > > Not parallelize. But rewrite in a decent programming language. IMO the way > to go would be to merge Dmitry Selyutin's rewrite > https://github.com/ghostmansd/gnulib-python > into gnulib. But I guess there is a good reason for not doing it !? It dates 2012. check-copyright seems to be a good candidate for parallelizing. I tested that with the 'parallel' tool (with some modifications of course). A speedup only when certain tools / shell are/is available would be fine, IMO. But that's just a random idea, I am absolutely not enough into gnulib nor shell programming. Regards, Tim signature.asc Description: This is a digitally signed message part.
Re: --create-testdir eats CPU and does nothing
On Samstag, 5. August 2017 08:46:22 CEST Paul Eggert wrote: > Tim Rühsen wrote: > > Is there any chance to parallelize the work of ./gnulib-tool ? The machine > > was just 6-7% idle. > > There was a GNU project to improve gnulib-tool's performance a while ago. I > don't know what came of it. That, plus 'configure', is a lot of why > single-core performance still matters when building GNU software. There was a thread in gnu-prog-discuss with some ideas how to improve the speed of configure runs. But I guess, nobody works on it consequently. I put some work at it: https://gitlab.com/gnuwget/wget2/wikis/Developer-hints:-Increasing-speed-of-GNU-toolchain Regards, Tim signature.asc Description: This is a digitally signed message part.
Re: --create-testdir eats CPU and does nothing
Tim Rühsen wrote: > > $ ./gnulib-tool --create-testdir --dir=../testdir1 > > gnulib-tool: warning: module euidaccess depends on a module with an > > incompatible license: group-member > > Correction, it came back after ~20 minutes. You have a fast machine. > Is there any chance to parallelize the work of ./gnulib-tool ? The machine > was > just 6-7% idle. Not parallelize. But rewrite in a decent programming language. IMO the way to go would be to merge Dmitry Selyutin's rewrite https://github.com/ghostmansd/gnulib-python into gnulib. Bruno
Re: --create-testdir eats CPU and does nothing
Tim Rühsen wrote: Is there any chance to parallelize the work of ./gnulib-tool ? The machine was just 6-7% idle. There was a GNU project to improve gnulib-tool's performance a while ago. I don't know what came of it. That, plus 'configure', is a lot of why single-core performance still matters when building GNU software.
Re: --create-testdir eats CPU and does nothing
On Samstag, 5. August 2017 14:15:32 CEST Tim Rühsen wrote: > Hi, > > with a fresh git clone, this command doesn't come back: > > $ ./gnulib-tool --create-testdir --dir=../testdir1 > gnulib-tool: warning: module euidaccess depends on a module with an > incompatible license: group-member > > Looks like it eats CPU of one core. > > ./testdir1 has been created but still empty after 15 minutes. > > What did I miss ? Correction, it came back after ~20 minutes. This is a 8 Core, 16 Threads, 16GB, m.2 SSD (3Gb/s) machine. Is there any chance to parallelize the work of ./gnulib-tool ? The machine was just 6-7% idle. Regards, Tim signature.asc Description: This is a digitally signed message part.
--create-testdir eats CPU and does nothing
Hi, with a fresh git clone, this command doesn't come back: $ ./gnulib-tool --create-testdir --dir=../testdir1 gnulib-tool: warning: module euidaccess depends on a module with an incompatible license: group-member Looks like it eats CPU of one core. ./testdir1 has been created but still empty after 15 minutes. What did I miss ? Regards, Tim signature.asc Description: This is a digitally signed message part.
