On 17 July 2015 at 15:49, Steven Dake (stdake) <[email protected]> wrote:
>
>
> From: Robert Collins <[email protected]>
> Reply-To: "OpenStack Development Mailing List (not for usage questions)"
> <[email protected]>
> Date: Thursday, July 16, 2015 at 6:48 PM
> To: OpenStack Development Mailing List <[email protected]>
> Subject: Re: [openstack-dev] [kolla] image bloat
>

> Rob,
>
> We don’t use pip during deployment as it results in an uncontrolled
> deployment mechanism.  Instead we pre-build containers and rely on an atomic
> deployment (either the container deploys or doesn’t, vs using pip during
> deployment, where some could fail and some could succeed).  Pre-building is
> more deterministic, but images must be build.

sure- I wasn't suggesting a change to install-at-deploy [you know my
views on deploys better than that!].

> Using pip is slower then yum when installing packages.  Most of this has to
> do with invocation of the c compiler for various modules (lxml is an example
> that takes awhile).

With the wheel cache introduced in 7.0.3, you may find that that has
changed [particularly if the build environment can map in a persistent
cache rather than having to start one in the lowest Docker layer].
Installing all the dependencies of OpenStack via pip (including the
oslo.* libraries):
cold [but not empty] cache:
time pip install -r global-requirements.txt
real    2m31.990s
user    1m15.969s
sys     0m9.111s

hot cache:
real    1m15.698s
user    1m6.497s
sys     0m7.549s

E.g. nearly all the time difference was network latency, revalidating
or downloading index data.

> What I actually proposed in the above email was getting rid of our common
> dependency layer where yum is only used one time during the build.  This
> would be replaced by using yum for each container (* 40 or so containers
> *100 or so dependencies).  We already do this for from-source, but not
> from-binary container building.

Ah ok, I understand now - thanks!

-Rob

-- 
Robert Collins <[email protected]>
Distinguished Technologist
HP Converged Cloud

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [email protected]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to