#12016: parallelism in Sage: just use value of 'MAKE'
---------------------------+------------------------------------------------
Reporter: jhpalmieri | Owner: GeorgSWeber
Type: enhancement | Status: needs_work
Priority: critical | Milestone: sage-4.8
Component: build | Keywords:
Work_issues: | Upstream: N/A
Reviewer: | Author: John Palmieri, Jeroen Demeyer
Merged: | Dependencies: sage-4.8.alpha3 + #12096
---------------------------+------------------------------------------------
Comment(by jhpalmieri):
Another patch:
{{{
#!diff
diff --git a/setup.py b/setup.py
--- a/setup.py
+++ b/setup.py
@@ -242,7 +242,8 @@ def execute_list_of_commands_in_parallel
WARNING: commands are run roughly in order, but of course successive
commands may be run at the same time.
"""
- print "Execute %s commands (using %s threads)"%(len(command_list),
min(len(command_list),nthreads))
+ nthreads = min(len(command_list),nthreads)
+ print "Execute %s commands (using %s threads)"%(len(command_list),
nthreads)
from multiprocessing import Pool
import twisted.persisted.styles #doing this import will allow
instancemethods to be pickable
p = Pool(nthreads)
}}}
Without this one, if you do `export MAKE='make -j'` and then `make
ptestlong`, although it says it's using 0 threads, it actually starts up
999999 threads (to do nothing, as far as I can tell).
I get lots of doctest failures and warnings using `make -j`, along the
lines of `OSError: [Errno 11] Resource temporarily unavailable` and
`/bin/sh: Cannot fork`, but I guess this is to be expected? Maybe we
should put some sort of cap on the number of threads to use for
doctesting?
--
Ticket URL: <http://trac.sagemath.org/sage_trac/ticket/12016#comment:27>
Sage <http://www.sagemath.org>
Sage: Creating a Viable Open Source Alternative to Magma, Maple, Mathematica,
and MATLAB
--
You received this message because you are subscribed to the Google Groups
"sage-trac" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/sage-trac?hl=en.
