Re: [Nix-dev] build-cores, load limit and boinc

2012-03-29 Thread Ludovic Courtès
Hi,

Lluís Batlle i Rossell vi...@viric.name skribis:

 It calls make with '-l4', for my case, and due to boinc, my load is always
 around 4, and make ends up not using parallel building.

See http://lists.gnu.org/archive/html/autoconf/2011-03/msg7.html
on the problems with using ‘-l’.

Ludo’.

___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


[Nix-dev] build-cores, load limit and boinc

2012-03-25 Thread Lluís Batlle i Rossell
Hello,

I could not find a way to run 'boinc' in a multicore machine (which runs
cpu-intensive jobs at nice 20) and have nix using more than one core for a build
job (the enableParallelBuilding thing).

It calls make with '-l4', for my case, and due to boinc, my load is always
around 4, and make ends up not using parallel building.

Can you imagine any solution to this? I know '-lX' is important because nix can
also spawn multiple jobs, and numnixjobs * nummakejobs can be too big. So.. any
idea, so we can keep on using 'boinc' or any kind of nice 20 job without making
nix builds slower?

Regards,
Lluís.
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] build-cores, load limit and boinc

2012-03-25 Thread Marc Weber
Hi Lluís,

if your load is about 4, why bother? Isn't your cpu utilized well then?

You could hook into the make files instead. make is passing tokens to
submakes which signals that it may spawn a process. If a submake is done
it passes back the token. This way make controls load. Now you could
hook into make and make nix pass tokens to make..
However I have no idea about how much work this would be.

Of coucrse you can force by overwriting the make command line being
used, and you can force a different target load (greater than num
cores).

Marc Weber
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] build-cores, load limit and boinc

2012-03-25 Thread Lluís Batlle i Rossell
On Sun, Mar 25, 2012 at 03:26:27PM +0200, Marc Weber wrote:
 Hi Lluís,
 
 if your load is about 4, why bother? Isn't your cpu utilized well then?

Well, my use of 'boinc' is: use whatever cycles there are free in the machine.

The limit by load in nix builds make calls, brings that notion to the nix build:
use whatever cores there are free.

There is clearly a collision in what cores should be considered free. I want to
tell the system: first, nix builds. Then, if there are free cycles, boinc.

 Of coucrse you can force by overwriting the make command line being
 used, and you can force a different target load (greater than num
 cores).

Double the number of cores would work, but could make nix spawn double the jobs
it should in some cases.

Better ideas? :)
___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev


Re: [Nix-dev] build-cores, load limit and boinc

2012-03-25 Thread Michael Raskin
if your load is about 4, why bother? Isn't your cpu utilized well then?

You could hook into the make files instead. make is passing tokens to
submakes which signals that it may spawn a process. If a submake is done
it passes back the token. This way make controls load. Now you could
hook into make and make nix pass tokens to make..
However I have no idea about how much work this would be.

You seem to misunderstand the problem. It looks like a priority problem:
if nothing else uses CPU, boinc (something unrelated to builds) can take
it, but the build should be fast.





___
nix-dev mailing list
nix-dev@lists.science.uu.nl
http://lists.science.uu.nl/mailman/listinfo/nix-dev