Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Jim Fulton
On Tue, May 14, 2013 at 10:36 PM, Daniel Holth dho...@gmail.com wrote: Why don't we simply provide an option to ignore == if it is not a root dependency? I don't understand what you mean. Jim On Mon, May 13, 2013 at 2:02 PM, Jim Fulton j...@zope.com wrote: On Mon, May 13, 2013 at 10:16 AM,

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Daniel Holth
If you were to say: install gerbil==3 wheel==0.16 and gerbil version 3's requirements were: water_bottle == 4 shavings 7 wheel = 0.16 # of course and shavings's requirements were: cedar == 0.9 The root of the dependency graph is gerbil==3 wheel==0.16.0. These are the only == constraints

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Donald Stufft
Pip respects == but requirements.txt can override. On May 16, 2013, at 9:51 AM, Daniel Holth dho...@gmail.com wrote: If you were to say: install gerbil==3 wheel==0.16 and gerbil version 3's requirements were: water_bottle == 4 shavings 7 wheel = 0.16 # of course and shavings's

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Daniel Holth
On Thu, May 16, 2013 at 10:08 AM, Jim Fulton j...@zope.com wrote: On Thu, May 16, 2013 at 9:51 AM, Daniel Holth dho...@gmail.com wrote: If you were to say: install gerbil==3 wheel==0.16 and gerbil version 3's requirements were: water_bottle == 4 shavings 7 wheel = 0.16 # of course and

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Jim Fulton
On Thu, May 16, 2013 at 9:51 AM, Daniel Holth dho...@gmail.com wrote: If you were to say: install gerbil==3 wheel==0.16 and gerbil version 3's requirements were: water_bottle == 4 shavings 7 wheel = 0.16 # of course and shavings's requirements were: cedar == 0.9 The root of the

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Jim Fulton
On Thu, May 16, 2013 at 10:13 AM, Daniel Holth dho...@gmail.com wrote: On Thu, May 16, 2013 at 10:08 AM, Jim Fulton j...@zope.com wrote: On Thu, May 16, 2013 at 9:51 AM, Daniel Holth dho...@gmail.com wrote: If you were to say: install gerbil==3 wheel==0.16 and gerbil version 3's

Re: [Distutils] Overriding dependency versions

2013-05-16 Thread Daniel Holth
I don't think it should be up to the tool to decide that a dependency is wrong. IMO, the tool should satisfy the declared dependencies as well as possible, report conflicts, and give the user a way to decide a conflict. In this case we don't expect a conflict, but are unfortunate enough to

Re: [Distutils] does pypi or red-dove have a better firehose API than download all the packages?

2013-05-16 Thread Marius Gedminas
On Wed, May 15, 2013 at 04:10:47PM -0400, Donald Stufft wrote: PyPI XMLRPC? Doesn't that require *two* HTTP requests per package? One to get a list of package versions, and one to get the metadata for a specified version number? I studied http://wiki.python.org/moin/PyPIXmlRpc as best as I

Re: [Distutils] does pypi or red-dove have a better firehose API than download all the packages?

2013-05-16 Thread David Wilson
Would something like http://pypi.h1.botanicus.net/static/dump.txt.gz be useful to you? (warning: 57mb expanding to 540mb). Each line is a JSON-encoded dict containing a single package release. for line in gzip.open('dump.txt.gz'): dct = json.loads(line) etc The code for it is very

[Distutils] Continuous Deployment Style Build System for Python (Requesting Feedback)

2013-05-16 Thread James Carpenter
Please take a look and let us know what you think. Please include feedback on any confusion or errors in the docs too, so we can fix them. === Defend Against Fruit is focused on providing a pragmatic, continuous deployment style build system for Python.

Re: [Distutils] Continuous Deployment Style Build System for Python (Requesting Feedback)

2013-05-16 Thread Nick Coghlan
Very interesting! The next draft of the metadata 2.0 spec is probably a couple of weeks away from broader public consumption, at which time I'll be interested in hearing whether or not that better meets DAF's needs (especially for transitive dependency tracking). (I haven't been putting the

Re: [Distutils] My rst README is not formatted on pypi.python.org

2013-05-16 Thread Jeremy Gillick
That fixed it! Which is kinda silly that in-page links would be filtered out. In any case, thanks for helping me to get this working! From: Donald Stufft  To: Jeremy Gillick  Sent: Wednesday, May 15, 2013 6:01 PM Subject: Re: [Distutils] My rst README is not

[Distutils] Continuous Deployment Style Build System for Python

2013-05-16 Thread James Carpenter
Defend Against Fruit is focused on providing a pragmatic, continuous deployment style build system for Python. Current Python build systems do not properly account for the needs of effective continuous deployment. This package extends the Python tooling to add the missing pieces. With an eye to

Re: [Distutils] Continuous Deployment Style Build System for Python (Requesting Feedback)

2013-05-16 Thread James Carpenter
I haven't read PEP 426, but one of the things I would keep in mind is to consider moving to or additionally supporting a Maven style repository layout. It isn't that a Maven layout is necessary better than layout X. It is just that the Maven artifact repository managers are far more mature than

Re: [Distutils] Continuous Deployment Style Build System for Python (Requesting Feedback)

2013-05-16 Thread Daniel Holth
You will be astonished to learn exactly how dumb the index is. Most of the metadata used for package discovery is in the file names. Then whole packages are downloaded and executed to produce their metadata. Improving this is a major goal. On May 16, 2013 7:35 PM, James Carpenter nawk...@gmail.com

Re: [Distutils] does pypi or red-dove have a better firehose API than download all the packages?

2013-05-16 Thread Daniel Holth
On Thu, May 16, 2013 at 3:46 PM, David Wilson d...@botanicus.net wrote: Would something like http://pypi.h1.botanicus.net/static/dump.txt.gz be useful to you? (warning: 57mb expanding to 540mb). Each line is a JSON-encoded dict containing a single package release. for line in

Re: [Distutils] does pypi or red-dove have a better firehose API than download all the packages?

2013-05-16 Thread David Wilson
Interesting! I produced that dump as part of a demo of using Xapian for cheese shop search (still a work in progress, when I get a free moment). Adding e.g. a depends: operator is something I'd like, and your database sounds very useful for achieving that goal. Thanks for the link. I may be