Re: [PATCH v3] tags: much faster, parallel "make tags"

2015-05-11 Thread Alexey Dobriyan
On Sun, May 10, 2015 at 09:58:12PM +0100, Pádraig Brady wrote: > On 10/05/15 14:26, Alexey Dobriyan wrote: > > On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: > >> On 08/05/15 14:26, Alexey Dobriyan wrote: > > > >>> exuberant() > >>> { > >>> - all_target_sources | xargs $1 -a

Re: [PATCH v3] tags: much faster, parallel make tags

2015-05-11 Thread Alexey Dobriyan
On Sun, May 10, 2015 at 09:58:12PM +0100, Pádraig Brady wrote: On 10/05/15 14:26, Alexey Dobriyan wrote: On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: On 08/05/15 14:26, Alexey Dobriyan wrote: exuberant() { - all_target_sources | xargs $1 -a

Re: [PATCH v3] tags: much faster, parallel "make tags"

2015-05-10 Thread Pádraig Brady
On 10/05/15 14:26, Alexey Dobriyan wrote: > On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: >> On 08/05/15 14:26, Alexey Dobriyan wrote: > >>> exuberant() >>> { >>> - all_target_sources | xargs $1 -a\ >>> + rm -f .make-tags.* >>> + >>> +

Re: [PATCH v3] tags: much faster, parallel "make tags"

2015-05-10 Thread Alexey Dobriyan
[fix Andrew's email] On Sun, May 10, 2015 at 04:26:34PM +0300, Alexey Dobriyan wrote: > On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: > > On 08/05/15 14:26, Alexey Dobriyan wrote: > > > > exuberant() > > > { > > > - all_target_sources | xargs $1 -a\ > >

Re: [PATCH v3] tags: much faster, parallel "make tags"

2015-05-10 Thread Alexey Dobriyan
On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: > On 08/05/15 14:26, Alexey Dobriyan wrote: > > exuberant() > > { > > - all_target_sources | xargs $1 -a\ > > + rm -f .make-tags.* > > + > > + all_target_sources >.make-tags.src > > +

Re: [PATCH v3] tags: much faster, parallel make tags

2015-05-10 Thread Pádraig Brady
On 10/05/15 14:26, Alexey Dobriyan wrote: On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: On 08/05/15 14:26, Alexey Dobriyan wrote: exuberant() { - all_target_sources | xargs $1 -a\ + rm -f .make-tags.* + + all_target_sources .make-tags.src

Re: [PATCH v3] tags: much faster, parallel make tags

2015-05-10 Thread Alexey Dobriyan
On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: On 08/05/15 14:26, Alexey Dobriyan wrote: exuberant() { - all_target_sources | xargs $1 -a\ + rm -f .make-tags.* + + all_target_sources .make-tags.src + NR_CPUS=$(getconf

Re: [PATCH v3] tags: much faster, parallel make tags

2015-05-10 Thread Alexey Dobriyan
[fix Andrew's email] On Sun, May 10, 2015 at 04:26:34PM +0300, Alexey Dobriyan wrote: On Sat, May 09, 2015 at 06:07:18AM +0100, Pádraig Brady wrote: On 08/05/15 14:26, Alexey Dobriyan wrote: exuberant() { - all_target_sources | xargs $1 -a\ + rm -f

Re: [PATCH v3] tags: much faster, parallel "make tags"

2015-05-08 Thread Pádraig Brady
On 08/05/15 14:26, Alexey Dobriyan wrote: > ctags is single-threaded program. Split list of files to be tagged into > equal parts, 1 part for each CPU and then merge the results. > > Speedup on one 2-way box I have is ~143 s => ~99 s (-31%). > On another 4-way box: ~120 s => ~65 s (-46%!). > >

[PATCH v3] tags: much faster, parallel "make tags"

2015-05-08 Thread Alexey Dobriyan
ctags is single-threaded program. Split list of files to be tagged into equal parts, 1 part for each CPU and then merge the results. Speedup on one 2-way box I have is ~143 s => ~99 s (-31%). On another 4-way box: ~120 s => ~65 s (-46%!). Resulting "tags" files aren't byte-for-byte identical

[PATCH v3] tags: much faster, parallel make tags

2015-05-08 Thread Alexey Dobriyan
ctags is single-threaded program. Split list of files to be tagged into equal parts, 1 part for each CPU and then merge the results. Speedup on one 2-way box I have is ~143 s = ~99 s (-31%). On another 4-way box: ~120 s = ~65 s (-46%!). Resulting tags files aren't byte-for-byte identical because

Re: [PATCH v3] tags: much faster, parallel make tags

2015-05-08 Thread Pádraig Brady
On 08/05/15 14:26, Alexey Dobriyan wrote: ctags is single-threaded program. Split list of files to be tagged into equal parts, 1 part for each CPU and then merge the results. Speedup on one 2-way box I have is ~143 s = ~99 s (-31%). On another 4-way box: ~120 s = ~65 s (-46%!). Resulting