Re: [Interest] load average building QtWebEngine

2016-03-20 Thread René J . V . Bertin
Allan Sandfeld Jensen wrote:


> It only launches one ninja process, and ninja guesses the number threads
> itself by using cpuinfo (unless you control it with NINJAFLAGS), but that
> can't get load to 60. I would guess the load is not from CPU, but maybe memory
> load, if you start swapping other processes could end up waiting on swapped
> out memory, which could theoretically get the load to 60.

This is on OS X 10.9, where swapping is unlikely to happen (and htop only 
showed 
a tiny bit in use). From 10.9 onwards there are other advanced memory 
management 
features like compression that must come at a cost too. But either way, I'm 
used 
to see "kernel_task" pop up when system_time CPU load increases, and it didn't 
here.

Your explanation does sound plausible, though. Even if the memory monitoring 
thingy I'm running didn't put up the alert I'd expect in that kind of 
situation, 
and the system was surprisingly responsive even when I went back to my local 
session (I'd been monitoring remotely). 

I don't use NINJAFLAGS myself, but maybe it's set in the Makefile that calls 
ninja, as a function of the -j number make has been called with?

Also, I interrupted the process shortly after posting this message, and 
restarted the build without -j. I still saw peak loads up to 30, but that's 
already quite a bit less. And I'd say there were indeed less concurrent clang 
processes.

BR,
René

___
Interest mailing list
Interest@qt-project.org
http://lists.qt-project.org/mailman/listinfo/interest


Re: [Interest] load average building QtWebEngine

2016-03-19 Thread Allan Sandfeld Jensen
On Saturday 19 March 2016, René J.V. Bertin wrote:
> Hi,
> 
> This seems a bit silly to ask, but I'm seeing extremely high load averages:
> 60.74 53.07 41.45 building QtWebEngine (about 8100 files in). That's on a
> 2 core, 2 thread i7, with the build started with make -j4 . I'm indeed
> seeing more than 4 concurrent clang processes and nothing else that takes
> anywhere near the CPU load to drive me up to insane values like >40 over
> the last couple of minutes.
> 
> It looks like there's only a single ninja process being spawned from one of
> the Makefiles, so it's not like there are 4 of those that each decide to
> build using 4 or 5 parallel processes.
> 
> Curious. And probably not speeding up the build ...
> 
It only launches one ninja process, and ninja guesses the number threads 
itself by using cpuinfo (unless you control it with NINJAFLAGS), but that 
can't get load to 60. I would guess the load is not from CPU, but maybe memory 
load, if you start swapping other processes could end up waiting on swapped 
out memory, which could theoretically get the load to 60.

Regards
`Allan
___
Interest mailing list
Interest@qt-project.org
http://lists.qt-project.org/mailman/listinfo/interest


[Interest] load average building QtWebEngine

2016-03-19 Thread René J . V . Bertin
Hi,

This seems a bit silly to ask, but I'm seeing extremely high load averages: 
60.74 53.07 41.45 building QtWebEngine (about 8100 files in).
That's on a 2 core, 2 thread i7, with the build started with make -j4 . I'm 
indeed seeing more than 4 concurrent clang processes and nothing else that 
takes anywhere near the CPU load to drive me up to insane values like >40 over 
the last couple of minutes.

It looks like there's only a single ninja process being spawned from one of the 
Makefiles, so it's not like there are 4 of those that each decide to build 
using 4 or 5 parallel processes.

Curious. And probably not speeding up the build ...

R.
___
Interest mailing list
Interest@qt-project.org
http://lists.qt-project.org/mailman/listinfo/interest