#8306: Parallel inter/intra-spkg builds
----------------------------+-----------------------------------------------
Reporter: mpatel | Owner: GeorgSWeber
Type: enhancement | Status: needs_review
Priority: major | Milestone: sage-4.3.4
Component: build | Keywords:
Author: Mitesh Patel | Upstream: N/A
Reviewer: David Kirkby | Merged:
Work_issues: |
----------------------------+-----------------------------------------------
Description changed by mpatel:
Old description:
> Along with a primed [http://ccache.samba.org/ ccache], compiling multiple
> spkgs in parallel may significantly speed up Sage builds on multicore
> machines. See [http://groups.google.com/group/sage-
> release/browse_thread/thread/4c915ae814dd6514 sage-release] for some
> information. Notes:
>
> * I put packages installed by setuptools (twisted, zodb, pygments,
> jinja, jinja2, sphinx, sqlalchemy, sagenb) in a linear chain, because
> setuptools does not consistently update `SAGE_LOCAL/lib/python/site-
> packages/easy-install.pth` in parallel.
>
> * I dropped mpir from gap's dependencies (see
> [http://groups.google.com/group/sage-devel/msg/c97a99f23ea576b7 sage-
> devel]).
>
> To test the changes:
>
> * Update `spkg/install` and `spkg/standard/deps` from
> [http://sage.math.washington.edu/home/mpatel/trac/8306 here].
> * Add #8357's `eclib-*.spkg`.
> * Add #8477's `palp-*.spkg`.
> * `export SAGE_PARALLEL_SPKG_BUILD="yes"`
> * `export MAKE="make -jX"` where `X > 1`
> * `make`
>
> To build with `SAGE_CHECK="ok"`, add #7091's `sqlalchemy-*.spkg`. To
> make `sage -i foo-X.Y.spkg` ''also'' append to `spkg/logs/foo-X.Y.log`,
> apply [attachment:trac_8306_scripts-spkg_log_files.patch] to the scripts
> repository.
New description:
Along with a primed [http://ccache.samba.org/ ccache], compiling multiple
spkgs in parallel may significantly speed up Sage builds on multicore
machines. See [http://groups.google.com/group/sage-
release/browse_thread/thread/4c915ae814dd6514 sage-release] for some
information. Notes:
* I put packages installed by setuptools (twisted, zodb, pygments, jinja,
jinja2, sphinx, sqlalchemy, sagenb) in a linear chain, because setuptools
does not consistently update `SAGE_LOCAL/lib/python/site-packages/easy-
install.pth` in parallel.
* I dropped mpir from gap's dependencies (see
[http://groups.google.com/group/sage-devel/msg/c97a99f23ea576b7 sage-
devel]).
To test the changes:
* Update `spkg/install` and `spkg/standard/deps` from
[http://sage.math.washington.edu/home/mpatel/trac/8306 here].
* Copy [http://sage.math.washington.edu/home/mpatel/trac/8306/pipestatus
pipestatus] to `spkg/`.
* Add #8357's `eclib-*.spkg`.
* Add #8477's `palp-*.spkg`.
* `export SAGE_PARALLEL_SPKG_BUILD="yes"`
* `export MAKE="make -jX"` where `X > 1`
* `make`
To build with `SAGE_CHECK="ok"`, add #7091's `sqlalchemy-*.spkg`. To make
`sage -i foo-X.Y.spkg` ''also'' append to `spkg/logs/foo-X.Y.log`, apply
[attachment:trac_8306_scripts-spkg_log_files.patch] to the scripts
repository.
--
--
Ticket URL: <http://trac.sagemath.org/sage_trac/ticket/8306#comment:41>
Sage <http://www.sagemath.org>
Sage: Creating a Viable Open Source Alternative to Magma, Maple, Mathematica,
and MATLAB
--
You received this message because you are subscribed to the Google Groups
"sage-trac" group.
To post to this group, send email to [email protected].
To unsubscribe from this group, send email to
[email protected].
For more options, visit this group at
http://groups.google.com/group/sage-trac?hl=en.
