Hi Ian,

> I know qooxdoo recently did some tests with python native thread 
> support. And as we all know python uses threads in linear way, not parallel.
>
> Qooxdoo generator can fork out threads anyway. I fork out threads in PHP 
> that doesn't have native thread support at all. It works like a charm.
>
> People have more CPUs nowadays. I have Intel i7 (4 CPU x 2HT) at work, 
> for example gcc uses all CPUs to the full. If I run ./generate.py, it 
> uses only 1 CPU, other 7 CPUs are idling.
>
> It would allow to save valuable seconds. :)
>   

Thanks for your comments. I believe when you say "fork out threads" you 
mean "fork out processes", right?! (In Unix lingo "forking" is applied 
to processes; threads are simply "created"). Yeah, that's probably the 
way to go, creating multiple processes and let the OS handle the 
balancing. There is even the new "multiprocessing" package in Python 
2.6, which should support this nicely. We cannot use it as we still 
support Python 2.4, but could hand-code it anyway.

I'm wondering how many processes one would fork? Obviously, you wouldn't 
create as many processes as you would create threads (like one for every 
class to compile, for example). Would you try to figure out the number 
of cores, and set the number of processes accordingly? Or just fork a 
fixed number, like 8?! Then you have to manage distributing the work 
among those, like every process has to compile so-and-so many classes...

Thomas

>   

------------------------------------------------------------------------------
Register Now & Save for Velocity, the Web Performance & Operations 
Conference from O'Reilly Media. Velocity features a full day of 
expert-led, hands-on workshops and two days of sessions from industry 
leaders in dedicated Performance & Operations tracks. Use code vel09scf 
and Save an extra 15% before 5/3. http://p.sf.net/sfu/velocityconf
_______________________________________________
qooxdoo-devel mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/qooxdoo-devel

Reply via email to