On Mon, Oct 20, 2014 at 4:51 PM, <[email protected]> wrote:
> Hi,
>
> I've been using WAL-E for a few months for backups and recovery. It's
> great!
>
> WAL-E does, however, pull in 20 Python dependencies.* For an infrastructure
> tool,
> that's almost an unmanageably large number.
Regrettably a ton of these are from OpenStack. As it would turn out,
WAL-E does enough lazy-loading that not having all the dependencies
for all backends is not a problem.
One person suggested making all backends optional, but I deep-sixed
this idea on the basis that, unrefined, it means that the
default-installation of WAL-E would be exactly useless.
A better suggestion that would require some work is to have other
packages like "wal-e-{s3,openstack,azure}" that would do the obvious
and not install the other junk.
> And thus it was a bit of a disappointment to see the new release
> candidate (thanks for WALE_S3_ENDPOINT, btw!) introduce three more
> dependencies through the use of python-daemon:
>
> python-daemon>=1.5.2
> setuptools (through python-daemon)
> lockfile>=0.7 (through python-daemon)
>
> The dependency on setuptools is particularly pernicious, since pretty
> much all our virtualenvs are using distribute.
I think it'd be reasonable to take stewardship of the daemonization
parts to avoid this, yes. Consider that I decided to own subprocess
because of unbackpatched bug fixes :/
> It seems like WAL-E only uses python-daemon in one place during
> operator.backup.wal_restore(). Is there any chance that could be
> refactored to use one of the various vendored daemon implementations?
Yes. Do you have a recommendation of one that works very reliably?
> Or, is there any chance you all could persuade the python-daemon
> maintainer to update his install_requires so that it doesn't include
> setuptools?
Maybe? In this case given cutting a dependency is tractable I'd be
okay absorbing one under my maintenance for now.
Do you have any interest in submitting a patch that does as you say
about the daemon bits?
(You might wonder why that's even there: it's for the
apparently-very-useful pipelined and parallel WAL download on restore)
--
You received this message because you are subscribed to the Google Groups
"wal-e" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
For more options, visit https://groups.google.com/d/optout.
