[Distutils] Re: Environment markers for GPU/CUDA availibility

2018-09-11 Thread David Cournapeau
On Tue, Sep 4, 2018 at 7:32 PM Nathaniel Smith wrote: > On Tue, Sep 4, 2018 at 3:10 AM, Paul Moore wrote: > > There's very much an 80-20 question here, we need to avoid letting the > > needs of the 20% of projects with unusual needs, complicate usage for > > the 80%. On the other hand, of

[Distutils] packaging guide and private packages index

2018-07-30 Thread David Cournapeau
Hi, I see that there is almost no mention of private packages index in the packaging guide, and no recommendation on what to use. Currently googling for private packages mostly return obsolete (and not very practical) recommendations based on dependency links. In 2018, what would be the

[Distutils] PyCon Colombia 2017 keynote on packaging

2017-02-12 Thread David Cournapeau
Hi, I was invited to give a talk at PyCon Colombia 2017, and I did it on packaging. I thought people here would be interested to know about it. I insisted on the need for packaging to get software into as many hands as possible, gave a history of the packaging ecosystem, advised people to use

Re: [Distutils] GSoC 2017 - Working on pip

2017-02-10 Thread David Cournapeau
On Fri, Feb 10, 2017 at 4:28 PM, Justin Cappos wrote: > So, there aren't "heuristics" to tweak here. The algorithm just encodes > the rules for trying package combinations (usually, latest version first) > and then backtracks to a previous point when an unresolvable conflict is

Re: [Distutils] GSoC 2017 - Working on pip

2017-02-10 Thread David Cournapeau
On Fri, Feb 10, 2017 at 3:52 PM, David Cournapeau <courn...@gmail.com> wrote: > > > On Fri, Feb 10, 2017 at 2:33 PM, Justin Cappos <jcap...@nyu.edu> wrote: > >> Yes, don't use a SAT solver. It requires all metadata from all packages >> (~30MB uncompresse

Re: [Distutils] GSoC 2017 - Working on pip

2017-02-10 Thread David Cournapeau
On Fri, Feb 10, 2017 at 2:33 PM, Justin Cappos wrote: > Yes, don't use a SAT solver. It requires all metadata from all packages > (~30MB uncompressed) and gives hard to predict results in some cases. > I doubt there exists an algorithm where this is not the case. Also the

Re: [Distutils] Future of setuptools and buildout

2016-08-20 Thread David Cournapeau
On Sat, Aug 20, 2016 at 6:30 PM, Nick Coghlan wrote: > On 20 August 2016 at 02:46, Chris Barker wrote: > > Maybe the alternative to setuptools_lite is to set up one of these other > > tools to work well (easily) for building python packages. If it can

Re: [Distutils] comparison of configuration languages

2016-05-07 Thread David Cournapeau
A missing dimension for comparison: round tripping support. It is quite useful for formats when used as a configuration. The best I know in that dimension is yaml (if using ruamel.yaml), which round trip comments. OTOH, adding round tripping to something like toml should not be too hard if the

Re: [Distutils] PEP 425 vs pip

2016-03-21 Thread David Cournapeau
On Fri, Mar 11, 2016 at 3:26 PM, Nick Coghlan <ncogh...@gmail.com> wrote: > On 11 March 2016 at 19:41, David Cournapeau <courn...@gmail.com> wrote: > > Hi, > > > > At Enthought we have been trying to use PEP 425 tags to include its > metadata > > in our

[Distutils] PEP 425 vs pip

2016-03-11 Thread David Cournapeau
Hi, At Enthought we have been trying to use PEP 425 tags to include its metadata in our packages. It has been harder than expected because of missing information in PEP 425, and maybe inconsistencies with what pip actually does. I think PEP 425 should be updated to take into account pip actual

Re: [Distutils] [final version?] PEP 513 - A Platform Tag for Portable Linux Built Distributions

2016-02-17 Thread David Cournapeau
On Wed, Feb 17, 2016 at 8:55 AM, Antoine Pitrou wrote: > On Tue, 16 Feb 2016 16:10:34 -0800 > Glyph Lefkowitz wrote: > > > > I am 100% on board with telling people "don't use `sudo pip install´". > Frankly I have been telling the pip developers to

Re: [Distutils] [final version?] PEP 513 - A Platform Tag for Portable Linux Built Distributions

2016-02-16 Thread David Cournapeau
On Tue, Feb 16, 2016 at 11:05 AM, Matthias Klose wrote: > On 02.02.2016 02:35, Glyph Lefkowitz wrote: > >> >> On Feb 1, 2016, at 3:37 PM, Matthias Klose wrote: >>> >>> On 30.01.2016 00:29, Nathaniel Smith wrote: >>> Hi all, I think this is ready

Re: [Distutils] PEP: Build system abstraction for pip/conda etc

2016-02-11 Thread David Cournapeau
On Thu, Feb 11, 2016 at 2:32 PM, Paul Moore <p.f.mo...@gmail.com> wrote: > On 11 February 2016 at 14:02, David Cournapeau <courn...@gmail.com> wrote: > >>> On Wed, Feb 10, 2016 at 1:52 PM, Paul Moore <p.f.mo...@gmail.com> > wrote: > >>>> > &

Re: [Distutils] PEP: Build system abstraction for pip/conda etc

2016-02-11 Thread David Cournapeau
On Thu, Feb 11, 2016 at 7:43 AM, Ralf Gommers <ralf.gomm...@gmail.com> wrote: > > > On Wed, Feb 10, 2016 at 3:30 PM, David Cournapeau <courn...@gmail.com> > wrote: > >> >> >> >> On Wed, Feb 10, 2016 at 1:52 PM, Paul Moore <p.f.mo...@gm

Re: [Distutils] PEP: Build system abstraction for pip/conda etc

2016-02-10 Thread David Cournapeau
On Wed, Feb 10, 2016 at 1:52 PM, Paul Moore wrote: > On 10 February 2016 at 13:43, Paul Moore wrote: > >> In this case, the build system abstraction PEP should propose some > >> additional text for > >> >

Re: [Distutils] Status update on the NumPy & SciPy vs SSE problem?

2016-02-05 Thread David Cournapeau
On Thu, Feb 4, 2016 at 11:42 AM, Antoine Pitrou wrote: > On Thu, 4 Feb 2016 21:22:32 +1000 > Nick Coghlan wrote: > > > > I figured that was independent of the manylinux PEP (since it affects > > Windows as well), but I'm also curious as to the current

Re: [Distutils] [final version?] PEP 513 - A Platform Tag for Portable Linux Built Distributions

2016-02-01 Thread David Cournapeau
On Sat, Jan 30, 2016 at 8:37 AM, Nathaniel Smith wrote: > On Fri, Jan 29, 2016 at 11:52 PM, Nick Coghlan wrote: > > On 30 January 2016 at 09:29, Nathaniel Smith wrote: > >> Hi all, > >> > >> I think this is ready for pronouncement now --

Re: [Distutils] draft PEP: manylinux1

2016-01-27 Thread David Cournapeau
On Wed, Jan 27, 2016 at 4:37 PM, Chris Barker <chris.bar...@noaa.gov> wrote: > > > On Wed, Jan 27, 2016 at 1:37 AM, David Cournapeau <courn...@gmail.com> > wrote: > >> >> I will make sure to let the manylinux effort know when we decide to move >> to Ce

Re: [Distutils] draft PEP: manylinux1

2016-01-27 Thread David Cournapeau
On Wed, Jan 27, 2016 at 5:18 PM, Donald Stufft <don...@stufft.io> wrote: > > On Jan 27, 2016, at 12:00 PM, David Cournapeau <courn...@gmail.com> wrote: > > So now, one could argue that it is not the community's job to tackle old > OS, and they would be right, but: >

Re: [Distutils] draft PEP: manylinux1

2016-01-27 Thread David Cournapeau
On Wed, Jan 27, 2016 at 5:43 PM, Nathaniel Smith <n...@pobox.com> wrote: > On Jan 27, 2016 09:00, "David Cournapeau" <courn...@gmail.com> wrote: > > > [...] > > The main argument against using centos 5 is GUI-related components, as > the old

Re: [Distutils] draft PEP: manylinux1

2016-01-27 Thread David Cournapeau
On Wed, Jan 27, 2016 at 12:02 AM, Chris Barker wrote: > On Tue, Jan 26, 2016 at 3:56 PM, Nathaniel Smith wrote: >> >> Well, the people who know what they're doing are still recommending >> CentOS 5 today, and we don't know what we're doing :-). >> > >

Re: [Distutils] draft PEP: manylinux1

2016-01-26 Thread David Cournapeau
On Tue, Jan 26, 2016 at 11:44 AM, Antoine Pitrou wrote: > On Tue, 26 Jan 2016 20:36:26 +1000 > Nick Coghlan wrote: > > > > If I understand the problem correctly, the CentOS 5 gcc toolchain is > > old enough that it simply doesn't emit the info libabigail

Re: [Distutils] draft PEP: manylinux1

2016-01-21 Thread David Cournapeau
On Thu, Jan 21, 2016 at 8:18 PM, Matthias Klose wrote: > On 21.01.2016 04:55, Nathaniel Smith wrote: > > the choice of compiler is questionable. Just a pick into a release > series. Not even the last released version on this release series. Is this > a good choice? Maybe for

Re: [Distutils] draft PEP: manylinux1

2016-01-21 Thread David Cournapeau
On Thu, Jan 21, 2016 at 10:04 PM, David Cournapeau <courn...@gmail.com> wrote: > > > On Thu, Jan 21, 2016 at 7:42 PM, Chris Barker <chris.bar...@noaa.gov> > wrote: > >> nice, idea, but >> >> libX11.so.6 >> libXext.so.6 >>

Re: [Distutils] draft PEP: manylinux1

2016-01-21 Thread David Cournapeau
On Thu, Jan 21, 2016 at 7:42 PM, Chris Barker wrote: > nice, idea, but > > libX11.so.6 > libXext.so.6 > libXrender.so.1 > libGL.so.1 > > These are all X11, yes? pretty much any workstation will have these, but > in general, servers won't. > Those would

Re: [Distutils] The Update Framework, integrate into PyPI?

2015-11-04 Thread David Cournapeau
On Wed, Nov 4, 2015 at 8:00 PM, Thomas Güttler wrote: > I read the RoadMap (Thank you Marcus Smith) and came across this: > > > An effort to integrate PyPI with the “The Update Framework” (TUF). This > is specified in PEP458 > > I see a trend to immutable systems

Re: [Distutils] Time for a setuptools_lite??

2015-10-28 Thread David Cournapeau
On Wed, Oct 28, 2015 at 9:04 AM, Nick Coghlan wrote: > > On 27 Oct 2015 13:30, "Daniel Holth" wrote: > > > > Mr. grumpy pants, > > > > Now you're trolling us by describing flit. > > I'd managed to miss Flit's creation, so I simply wasn't aware of it. > >

Re: [Distutils] wacky idea about reifying extras

2015-10-27 Thread David Cournapeau
On Mon, Oct 26, 2015 at 11:41 PM, Nathaniel Smith wrote: > On Mon, Oct 26, 2015 at 4:41 AM, Donald Stufft wrote: > > On October 26, 2015 at 3:36:47 AM, Nathaniel Smith (n...@pobox.com) > wrote: > >> > TL;DR > >> - > >> > >> If we: > >> > >> - implement a

Re: [Distutils] Second draft of a plan for a new source tree / sdist format

2015-10-27 Thread David Cournapeau
On Tue, Oct 27, 2015 at 1:12 PM, Daniel Holth wrote: > The drawback of .zip is file size since it compresses each file > individually rather than giving the compression algorithm a larger input, > it's a great format otherwise. Ubiquitous including Apple iOS packages, > Java,

Re: [Distutils] Monkey patching distutils was: Remove distutils, was: red, green, refactor ...

2015-10-22 Thread David Cournapeau
On Thu, Oct 22, 2015 at 5:04 PM, Thomas Güttler < guettl...@thomas-guettler.de> wrote: > Am 21.10.2015 um 17:15 schrieb Antoine Pitrou: > > On Wed, 21 Oct 2015 17:05:29 +0200 > > Nick Coghlan <ncogh...@gmail.com> wrote: > >> On 21 October 2015 at 14:55,

Re: [Distutils] Time for a setuptools_lite??

2015-10-21 Thread David Cournapeau
On Wed, Oct 21, 2015 at 6:44 PM, Wayne Werner <waynejwer...@gmail.com> wrote: > > On Wed, Oct 21, 2015 at 12:32 PM, David Cournapeau <courn...@gmail.com> > wrote: > >> >> >> On Wed, Oct 21, 2015 at 6:03 PM, Ronny Pfannschmidt < >> opensou...@ron

Re: [Distutils] Time for a setuptools_lite??

2015-10-21 Thread David Cournapeau
On Wed, Oct 21, 2015 at 10:25 PM, Antoine Pitrou wrote: > On Wed, 21 Oct 2015 21:41:35 +0100 > Paul Moore wrote: > > On 21 October 2015 at 20:41, Chris Barker wrote: > > > As I understand it, the current "API" that pip knows

Re: [Distutils] Time for a setuptools_lite??

2015-10-21 Thread David Cournapeau
On Wed, Oct 21, 2015 at 6:03 PM, Ronny Pfannschmidt < opensou...@ronnypfannschmidt.de> wrote: > why does that have to be in setuptools ?! > > if we want a new light system to begin with, shouldn't it be far more > sustainable to use just implementations of the new standards rather than > leaving

Re: [Distutils] Remove distutils, was: red, green, refactor ...

2015-10-21 Thread David Cournapeau
On Wed, Oct 21, 2015 at 12:52 PM, Thomas Güttler < guettl...@thomas-guettler.de> wrote: > Am 21.10.2015 um 13:28 schrieb Ionel Cristian Mărieș: > >> >> On Wed, Oct 21, 2015 at 1:42 PM, Thomas Güttler < >> guettl...@thomas-guettler.de > >> wrote: >> >> >>

Re: [Distutils] PyPi not allowing duplicate filenames

2015-10-14 Thread David Cournapeau
On Wed, Oct 14, 2015 at 8:52 PM, Chris Barker wrote: > > > On Wed, Oct 14, 2015 at 9:56 AM, Dave Forgac > wrote: > >> This was discussed recently here: >> https://github.com/pypa/packaging-problems/issues/74 >> > > and on this list at other times.

Re: [Distutils] PyPi not allowing duplicate filenames

2015-10-14 Thread David Cournapeau
On Wed, Oct 14, 2015 at 11:23 PM, Chris Barker <chris.bar...@noaa.gov> wrote: > On Wed, Oct 14, 2015 at 1:59 PM, David Cournapeau <courn...@gmail.com> > wrote: > >> But I'm talking about the cases of "whoops! I really wish I hadn't >>> uploaded th

Re: [Distutils] Where should I put tests when packaging python modules?

2015-10-06 Thread David Cournapeau
On Tue, Oct 6, 2015 at 9:30 AM, Ionel Cristian Mărieș wrote: > > On Tue, Oct 6, 2015 at 10:51 AM, Antoine Pitrou > wrote: > >> They should be inside the module. That way, you can check an installed >> module is ok by running e.g. "python -m

Re: [Distutils] Where should I put tests when packaging python modules?

2015-10-06 Thread David Cournapeau
On Tue, Oct 6, 2015 at 10:54 AM, Donald Stufft wrote: > On October 6, 2015 at 3:21:04 AM, Glyph Lefkowitz (gl...@twistedmatrix.com) > wrote: > > > Inside the package. > > > > If you put your tests outside your package, then you can't install > > the tests for two packages

Re: [Distutils] Where should I put tests when packaging python modules?

2015-10-06 Thread David Cournapeau
On Tue, Oct 6, 2015 at 11:21 AM, Donald Stufft <don...@stufft.io> wrote: > On October 6, 2015 at 6:18:32 AM, David Cournapeau (courn...@gmail.com) > wrote: > > > The significant number is not so relevant if you buy the argument > > that it is useful to downstream packa

Re: [Distutils] Where should I put tests when packaging python modules?

2015-10-06 Thread David Cournapeau
On Tue, Oct 6, 2015 at 1:57 PM, Donald Stufft wrote: > > > On October 6, 2015 at 8:51:30 AM, Antoine Pitrou (solip...@pitrou.net) > wrote: > > On Tue, 6 Oct 2015 15:34:38 +0300 > > Ionel Cristian Mărieș wrote: > > > > > > Very few > > > test runners change the current working

Re: [Distutils] Towards a simple and standard sdist format that isn't intertwined with distutils

2015-10-02 Thread David Cournapeau
On Fri, Oct 2, 2015 at 12:58 PM, Donald Stufft wrote: > On October 2, 2015 at 12:54:03 AM, Nathaniel Smith (n...@pobox.com) wrote: > > > We realized that actually as far as we could tell, it wouldn't > > be that > > hard at this point to clean up how sdists work so that it

Re: [Distutils] PEP for dependencies on libraries like BLAS (was: Re: Working toward Linux wheel support)

2015-08-14 Thread David Cournapeau
On Thu, Aug 13, 2015 at 7:08 AM, Nathaniel Smith n...@pobox.com wrote: On Wed, Aug 12, 2015 at 8:10 PM, Robert Collins robe...@robertcollins.net wrote: On 13 August 2015 at 12:51, Nathaniel Smith n...@pobox.com wrote: On Aug 12, 2015 16:49, Robert Collins robe...@robertcollins.net wrote:

Re: [Distutils] Working toward Linux wheel support

2015-08-13 Thread David Cournapeau
On Thu, Aug 13, 2015 at 2:05 AM, Nathaniel Smith n...@pobox.com wrote: On Aug 12, 2015 13:57, Nate Coraor n...@bx.psu.edu wrote: Hello all, I've implemented the wheel side of Nick's suggestion from very early in this thread to support a vendor-providable binary-compatibility.cfg.

Re: [Distutils] 400 Client Error: Binary wheel for an unsupported platform

2015-07-10 Thread David Cournapeau
On Fri, Jul 10, 2015 at 12:16 AM, Ionel Cristian Mărieș cont...@ionelmc.ro wrote: Would be quite useful to see some references and details about the vague issues being mentioned in the thread. It would help a lot the less versed engineers (like me) understand the issues at hand (and hopefully

Re: [Distutils] 400 Client Error: Binary wheel for an unsupported platform

2015-07-10 Thread David Cournapeau
On Fri, Jul 10, 2015 at 1:53 PM, Olivier Grisel olivier.gri...@ensta.org wrote: I just checked and indeed the python exec installed by miniconda does not work on Alpine linux (launch via docker from the gliderlabs/alpine image): # ldd /root/miniconda3/pkgs/python-3.4.3-0/bin/python3.4

Re: [Distutils] 400 Client Error: Binary wheel for an unsupported platform

2015-07-09 Thread David Cournapeau
On Thu, Jul 9, 2015 at 3:50 PM, Antoine Pitrou solip...@pitrou.net wrote: On Thu, 9 Jul 2015 23:50:30 +1000 Nick Coghlan ncogh...@gmail.com wrote: As Donald notes, I think we're now in a good position to start making progress here, but the first step is going to be finding a way to

Re: [Distutils] 400 Client Error: Binary wheel for an unsupported platform

2015-07-07 Thread David Cournapeau
On Tue, Jul 7, 2015 at 7:02 PM, Donald Stufft don...@stufft.io wrote: On July 7, 2015 at 10:22:55 AM, Nick Coghlan (ncogh...@gmail.com) wrote: On 8 July 2015 at 00:07, Antoine Pitrou wrote: On Tue, 7 Jul 2015 23:53:59 +1000 Nick Coghlan wrote: Unfortunately, the compatibility tagging

Re: [Distutils] Making pip and PyPI work with conda packages

2015-05-19 Thread David Cournapeau
On Wed, May 20, 2015 at 2:25 PM, Nick Coghlan ncogh...@gmail.com wrote: On 18 May 2015 at 14:32, David Cournapeau courn...@gmail.com wrote: On Mon, May 18, 2015 at 9:05 AM, Nick Coghlan ncogh...@gmail.com wrote: Indirection via pip injects the usage of setuptools even for plain distutils

Re: [Distutils] Making pip and PyPI work with conda packages

2015-05-19 Thread David Cournapeau
On Wed, May 20, 2015 at 12:46 AM, Paul Moore p.f.mo...@gmail.com wrote: On 19 May 2015 at 16:22, Chris Barker chris.bar...@noaa.gov wrote: The other issue is social: this would really only be a benefit if a wide variety of packages shared the same libs -- but each of those packages is

Re: [Distutils] Making pip and PyPI work with conda packages

2015-05-17 Thread David Cournapeau
On Mon, May 18, 2015 at 9:05 AM, Nick Coghlan ncogh...@gmail.com wrote: On 18 May 2015 07:32, Chris Barker chris.bar...@noaa.gov wrote: On Sun, May 17, 2015 at 12:05 AM, Nick Coghlan ncogh...@gmail.com wrote: % pip install --upgrade pip % pip install some_conda_package This

Re: [Distutils] PyPI is a sick sick hoarder

2015-05-16 Thread David Cournapeau
On Sat, May 16, 2015 at 11:36 PM, Justin Cappos jcap...@nyu.edu wrote: I am no expert, but I don't understand why backtracking algorithms would to be faster than SAT, since they both potentially need to walk over the full set of possible solutions. It is hard to reason about the cost because

Re: [Distutils] PyPI is a sick sick hoarder

2015-05-16 Thread David Cournapeau
On Sun, May 17, 2015 at 12:40 AM, Daniel Holth dho...@gmail.com wrote: On May 16, 2015 11:22 AM, David Cournapeau courn...@gmail.com wrote: On Sat, May 16, 2015 at 11:36 PM, Justin Cappos jcap...@nyu.edu wrote: I am no expert, but I don't understand why backtracking algorithms

Re: [Distutils] Dynamic linking between Python modules (was: Beyond wheels 1.0: helping downstream, FHS and more)

2015-05-16 Thread David Cournapeau
On Sat, May 16, 2015 at 4:56 AM, Chris Barker chris.bar...@noaa.gov wrote: On Fri, May 15, 2015 at 1:49 AM, Paul Moore p.f.mo...@gmail.com wrote: On 14 May 2015 at 19:01, Chris Barker chris.bar...@noaa.gov wrote: Ah -- here is the issue -- but I think we HAVE pretty much got what we need

Re: [Distutils] PyPI is a sick sick hoarder

2015-05-15 Thread David Cournapeau
On Sat, May 16, 2015 at 10:52 AM, Robert Collins robe...@robertcollins.net wrote: On 16 May 2015 at 13:45, Donald Stufft don...@stufft.io wrote: On May 15, 2015, at 9:22 PM, Robert Collins robe...@robertcollins.net wrote: On 16 May 2015 at 11:08, Marcus Smith qwc...@gmail.com wrote:

Re: [Distutils] Add additional file categories for distutils, setuptools, wheel

2015-04-19 Thread David Cournapeau
Thanks for pushing this Daniel. I think we should wait for a bit before making this proposal official. Just after I made my PR against wheel to implement this, I had some discussions with Nathaniel Smith from numpy, where he remarked we may want to support better everything in site-packages

Re: [Distutils] Add additional file categories for distutils, setuptools, wheel

2015-04-19 Thread David Cournapeau
On Sun, Apr 19, 2015 at 6:39 PM, Vinay Sajip vinay_sa...@yahoo.co.uk wrote: From: Paul Moore p.f.mo...@gmail.com On 19 April 2015 at 11:55, David Cournapeau courn...@gmail.com wrote: I can work on a paperman implementation of this on top of the wheel installer for the end of this week

Re: [Distutils] pywin32 on wheels [was: Beyond wheels 1.0: helping downstream, FHS and more]

2015-04-16 Thread David Cournapeau
On Thu, Apr 16, 2015 at 9:58 AM, Paul Moore p.f.mo...@gmail.com wrote: On 16 April 2015 at 14:43, Kevin Horn kevin.h...@gmail.com wrote: Those that want to use pywin32 in a virtualenv (or just without all the system changes) could simply install the wheel (or even an sdist, perhaps) from

Re: [Distutils] name of the dependency problem

2015-04-15 Thread David Cournapeau
On Wed, Apr 15, 2015 at 11:32 AM, Trishank Karthik Kuppusamy trish...@nyu.edu wrote: On 15 April 2015 at 11:15, David Cournapeau courn...@gmail.com wrote: This is indeed the case. If you want to solve dependencies in a way that works well, you want an index that describes all your available

Re: [Distutils] Beyond wheel 1.0: more fine-grained installation scheme

2015-04-14 Thread David Cournapeau
the major version number would cause older pip to reject the newer wheels, incrementing the minor version would produce a warning. On Tue, Apr 14, 2015 at 8:56 AM, David Cournapeau courn...@gmail.com wrote: Hi, I am splitting up the previous thread into one thread / proposal to focus

[Distutils] Beyond wheel 1.0: more fine-grained installation scheme

2015-04-14 Thread David Cournapeau
Hi, I am splitting up the previous thread into one thread / proposal to focus the discussion. Assuming the basis of this proposal does not sound too horrible, I would make a proof of concept in a pip branch, so that we can flush out the details and then write an actual spec (I guess an updated

Re: [Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
On Mon, Apr 13, 2015 at 12:56 PM, Chris Barker chris.bar...@noaa.gov wrote: NOTE: I don't work for any of the companies involved -- just a somewhat frustrated user... And someone that has been trying for years to make things easier for OS-X users. I’m not sure what (3) means exactly. What is

Re: [Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
Holth dho...@gmail.com wrote: On Mon, Apr 13, 2015 at 3:46 PM, David Cournapeau courn...@gmail.com wrote: On Mon, Apr 13, 2015 at 12:56 PM, Chris Barker chris.bar...@noaa.gov wrote: NOTE: I don't work for any of the companies involved -- just a somewhat frustrated user... And someone

Re: [Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
On Mon, Apr 13, 2015 at 5:25 PM, Chris Barker chris.bar...@noaa.gov wrote: On Mon, Apr 13, 2015 at 1:19 PM, David Cournapeau courn...@gmail.com wrote: This is what we use on top of setuptools egg: - ability to add dependencies which are not python packages (I think most of it is already

Re: [Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
On Mon, Apr 13, 2015 at 10:17 PM, Robert Collins robe...@robertcollins.net wrote: On 14 April 2015 at 09:35, David Cournapeau courn...@gmail.com wrote: ... One of the earlier things mentioned here - {pre,post}{install,remove} scripts - raises a red flag for me. That's indeed a good

Re: [Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
On Mon, Apr 13, 2015 at 10:44 AM, Donald Stufft don...@stufft.io wrote: On Apr 13, 2015, at 10:39 AM, David Cournapeau courn...@gmail.com wrote: Hi there, During pycon, Nick mentioned there was interest in updating the wheel format to support downstream distributions. Nick mentioned Linux

[Distutils] Beyond wheels 1.0: helping downstream, FHS and more

2015-04-13 Thread David Cournapeau
Hi there, During pycon, Nick mentioned there was interest in updating the wheel format to support downstream distributions. Nick mentioned Linux distributions, but I would like to express interest for other kind of downstream distributors like Anaconda from Continuum or Canopy from Enthought

Re: [Distutils] [pycon] Packaging-related discussions

2015-04-09 Thread David Cournapeau
Do we have a confirmation for Friday ? I have not seen a BoF board yet. On Fri, Apr 3, 2015 at 6:16 AM, Nick Coghlan ncogh...@gmail.com wrote: On 3 April 2015 at 08:09, Richard Jones rich...@python.org wrote: Could the BoF be Friday instead please? Saturday is International Tabletop Day,

Re: [Distutils] [pycon] Packaging-related discussions

2015-04-03 Thread David Cournapeau
, as it always does :) A Packaging BoF would be good, it just needs a volunteer to arrange a room with the open space organisers. Some time Saturday evening, perhaps? Cheers, Nick. Richard On Fri, 3 Apr 2015 at 00:52 David Cournapeau courn...@gmail.com wrote: Hi

[Distutils] [pycon] Packaging-related discussions

2015-04-02 Thread David Cournapeau
Hi there, I would like to know what are the events/discussions related to packaging happening this year at PyCon ? My employer is sponsoring my trip to the conference this year, and I would like to make sure I am not missing an important event. I will also be there for most of the sprints,

Re: [Distutils] Call for information - What assumptions can I make about Unix users' access to Windows?

2014-11-09 Thread David Cournapeau
Regarding winrm, note that it can be fairly complicated to set it up on the windows side. I can confirm it works well, though. We're using an internal hack of fabric to communicate from linux to windows through winrm at work, and it does the job. David On Sun, Nov 9, 2014 at 12:40 PM, Nick

Re: [Distutils] Call for information - What assumptions can I make about Unix users' access to Windows?

2014-11-09 Thread David Cournapeau
On Sun, Nov 9, 2014 at 6:39 PM, Kevin Horn kevin.h...@gmail.com wrote: Regarding remote access to windows machines, there are several options: - Remote powershell (not my area, so not sure how viable this is) - Use pexec from sysinternals to run cmd.exe remotely (probably on local network

Re: [Distutils] PEP425 - Wheel Binary Package Compatibility

2014-10-28 Thread David Cournapeau
On Tue, Oct 28, 2014 at 10:13 AM, Matthias Hafner hafne...@gmail.com wrote: Hi there, Following up on https://bitbucket.org/pypa/wheel/issue/124/glibc-incompatibility. How should we deal with incompatibility of dynamically linked libraries? Doing pip wheel numpy on a Linux 64bit machine

Re: [Distutils] Wheels and dependent third party dlls on windows

2014-10-01 Thread David Cournapeau
On Wed, Oct 1, 2014 at 5:44 PM, David Genest david.gen...@ubisoft.com wrote: Thank you all for the precious info. Here are my observations: - We are merely writing extension modules with third party dependant code packaged in a dll. In my mind, this use case is not the exception, and would

Re: [Distutils] Wheels and dependent third party dlls on windows

2014-09-30 Thread David Cournapeau
On Tue, Sep 30, 2014 at 3:31 PM, David Genest david.gen...@ubisoft.com wrote: This is not true. Python loads DLLs with LOAD_WITH_ALTERED_SEARCH_PATH, to allow them to be located alongside the pyd file. You should therefore be able to ship the dependent dll in the package directory (which

Re: [Distutils] Wheels and dependent third party dlls on windows

2014-09-30 Thread David Cournapeau
On Tue, Sep 30, 2014 at 3:44 PM, Nick Coghlan ncogh...@gmail.com wrote: On 1 October 2014 00:37, Paul Moore p.f.mo...@gmail.com wrote: On 30 September 2014 15:31, David Genest david.gen...@ubisoft.com wrote: Ok, so what if the dll is shared in a given environment (multiple extensions use

Re: [Distutils] build a wheel with waf instead of setuptools

2014-08-01 Thread David Cournapeau
That's certainly possible, bento does exactly this. You would write a setup.py that would like like: import setuptools from bento.distutils.monkey_patch import monkey_patch monkey_patch() setuptools.setup() then you can do python setup.py install/build/sdist/etc... without actually using

Re: [Distutils] Is build an inherently arbitrary-code process?

2014-03-27 Thread David Cournapeau
On Thu, Mar 27, 2014 at 7:48 PM, Donald Stufft don...@stufft.io wrote: On Mar 27, 2014, at 3:42 PM, Daniel Holth dho...@gmail.com wrote: I became convinced that build was an inherently arbitrary-code process, and not something to be universally handled by a declarative system, when I

Re: [Distutils] waf can be used to compile Python extension modules

2014-03-21 Thread David Cournapeau
On Fri, Mar 21, 2014 at 1:46 PM, Daniel Holth dho...@gmail.com wrote: Bento emulates setup.py: https://github.com/cournape/Bento/blob/master/setup.py It mostly has to implement egg_info and install to be pip compatible. Yes. While some things are quite not ideal in Bento, I think that part

Re: [Distutils] How to link to a c library ?

2014-02-21 Thread David Cournapeau
On Wed, Feb 19, 2014 at 8:30 AM, chaouche yacine yacinechaou...@yahoo.comwrote: What I was trying to accomplish --- I tried to upgrade numpy # pip install --upgrade numpy.../chaouche/build/numpy/numpy/numarray/_capi.c:198:undefined reference to `log10'

Re: [Distutils] pip on windows experience

2014-01-30 Thread David Cournapeau
On Thu, Jan 30, 2014 at 7:50 AM, Paul Moore p.f.mo...@gmail.com wrote: On 29 January 2014 22:50, David Cournapeau courn...@gmail.com wrote: i.e. it would be nice if anyone setup to build C extensions could just build numpy. This has always been possible, and if not, that's certainly

Re: [Distutils] pip on windows experience

2014-01-30 Thread David Cournapeau
On Thu, Jan 30, 2014 at 10:20 AM, Paul Moore p.f.mo...@gmail.com wrote: On 30 January 2014 09:12, David Cournapeau courn...@gmail.com wrote: On Thu, Jan 30, 2014 at 7:50 AM, Paul Moore p.f.mo...@gmail.com wrote: On 29 January 2014 22:50, David Cournapeau courn...@gmail.com wrote: i.e

Re: [Distutils] pip on windows experience

2014-01-29 Thread David Cournapeau
On Sun, Jan 26, 2014 at 12:29 AM, Nick Coghlan ncogh...@gmail.com wrote: Paul's position exactly mirrors my own - I an perfectly fine with the recommended advice to scientific users continuing to be NumPy doesn't officially support pip and virtualenv because of the way it is built and

Re: [Distutils] pip on windows experience

2014-01-29 Thread David Cournapeau
for things like MKL though. Nope, but MKL is actually easy in the sense that it deals with architectures at runtime. OSS numerical libraries generally don't (lots of work, and often a non issue when you can build stuff by yourself :) ). David On Jan 29, 2014, at 5:50 PM, David Cournapeau courn

Re: [Distutils] Packaging today

2014-01-09 Thread David Cournapeau
, -steve On Jan 8, 2014, at 1:48 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jan 8, 2014 at 6:44 PM, Chris Barker chris.bar...@noaa.gov wrote: On Wed, Jan 8, 2014 at 1:48 AM, David Cournapeau courn...@gmail.com wrote: We don't use mingw to build packages distributed

Re: [Distutils] Packaging today

2014-01-08 Thread David Cournapeau
On Mon, Jan 6, 2014 at 9:55 PM, Chris Barker chris.bar...@noaa.gov wrote: On Mon, Jan 6, 2014 at 12:26 PM, Steve Spicklemire st...@spvi.com wrote: avoid troubling anyone with pesky questions. In that respect I've apparently failed, because here comes the question! I think this is a use

Re: [Distutils] Packaging today

2014-01-08 Thread David Cournapeau
On Wed, Jan 8, 2014 at 6:44 PM, Chris Barker chris.bar...@noaa.gov wrote: On Wed, Jan 8, 2014 at 1:48 AM, David Cournapeau courn...@gmail.comwrote: We don't use mingw to build packages distributed within canopy (at least not anymore). We build everything with MSVC 2008, as mixing mingw/MSVC

Re: [Distutils] Handling the binary dependency management problem

2013-12-06 Thread David Cournapeau
On Fri, Dec 6, 2013 at 5:47 AM, Nick Coghlan ncogh...@gmail.com wrote: On 6 December 2013 11:52, Donald Stufft don...@stufft.io wrote: On Dec 5, 2013, at 8:48 PM, Chris Barker - NOAA Federal chris.bar...@noaa.gov wrote: What would really be best is run-time selection of the appropriate

Re: [Distutils] Handling the binary dependency management problem

2013-12-06 Thread David Cournapeau
On Fri, Dec 6, 2013 at 12:44 PM, Donald Stufft don...@stufft.io wrote: How does conda handle SSE vs SSE2 vs SSE3? I’m digging through it’s source code and just installed numpy with it and I can’t seem to find any handling of that? I can't speak for conda, but @enthought, we solve it by using

Re: [Distutils] Handling the binary dependency management problem

2013-12-06 Thread David Cournapeau
On Fri, Dec 6, 2013 at 5:50 PM, Chris Barker chris.bar...@noaa.gov wrote: On Fri, Dec 6, 2013 at 5:06 AM, David Cournapeau courn...@gmail.comwrote: As Ralf, I think it is overkill. The problem of SSE vs non SSE is because of one library, ATLAS, which as IMO the design flaw of being arch

Re: [Distutils] Packaging panel in Montreal next year?

2013-09-12 Thread David Cournapeau
I could make it this time. I was considering submitting a talk about a library I have been working on recently for dependency solving. Would that fall into what you had in mind ? It is designed to be fairly agnostic toward metadata format, installation scheme, etc... It handles arbitrary

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-10-04 Thread David Cournapeau
On Mon, Oct 1, 2012 at 8:22 PM, Vinay Sajip vinay_sa...@yahoo.co.uk wrote: David Cournapeau cournape at gmail.com writes: I noticed that you put the classifiers list as a string (same for platform). I think it is expected to be a list, no ? That's an oversight; there are doubtless others

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-10-01 Thread David Cournapeau
On Mon, Oct 1, 2012 at 12:40 AM, Donald Stufft donald.stu...@gmail.com wrote: On Sunday, September 30, 2012 at 6:50 PM, David Cournapeau wrote: I am not sure I understand the argument: whatever the syntax, if the feature is there, you will have the same problem ? The fact that it is used

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-10-01 Thread David Cournapeau
On Mon, Oct 1, 2012 at 8:14 AM, Vinay Sajip vinay_sa...@yahoo.co.uk wrote: David Cournapeau cournape at gmail.com writes: I am not suggesting something very complicated (we don't want to re-create a language), but more something like cabal (see conditionals in http://www.haskell.org/cabal

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-10-01 Thread David Cournapeau
On Mon, Oct 1, 2012 at 3:15 PM, Vinay Sajip vinay_sa...@yahoo.co.uk wrote: David Cournapeau cournape at gmail.com writes: Note that in Cabal at least, those conditionals work not just for requirements, but for pretty much any section that is not metadata (so in the python world, you could

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-10-01 Thread David Cournapeau
On Mon, Oct 1, 2012 at 5:06 PM, Vinay Sajip vinay_sa...@yahoo.co.uk wrote: David Cournapeau cournape at gmail.com writes: The code that produces yaml files. The point is precisely that it would be easy for me to consume this and produce the internal package representation in bento, which

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-09-30 Thread David Cournapeau
On Sun, Sep 30, 2012 at 6:03 AM, Donald Stufft donald.stu...@gmail.com wrote: I have some unpublished work I should publish. Part of the point with what i'm trying to do is to define a standard for what is inside a package, but not really for how you take a particular set of files and turn

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-09-30 Thread David Cournapeau
On Sun, Sep 30, 2012 at 4:55 AM, Daniel Holth dho...@gmail.com wrote: I like this kind of study. Fixing 1300 packages sounds a lot more manageable than fixing 18,000. (I took a similar look at setup.py but with the ast module instead of actually running the things. Your method is probably more

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-09-30 Thread David Cournapeau
On Sun, Sep 30, 2012 at 5:07 PM, Donald Stufft donald.stu...@gmail.com wrote: On Sunday, September 30, 2012 at 8:59 AM, David Cournapeau wrote: Note that all this work has already been done in Bento. I understand the appeal of using an existing format like yaml, but it is not clear to me how

Re: [Distutils] [Python-Dev] distlib updated with resources API

2012-09-30 Thread David Cournapeau
On Sun, Sep 30, 2012 at 11:35 PM, Donald Stufft donald.stu...@gmail.com wrote: On Sunday, September 30, 2012 at 6:21 PM, David Cournapeau wrote: Right, in that case, it would work, but in my experience, it is important to be able to apply conditionals to more than just requirements (packages

Re: [Distutils] GCC versions and binary egg names

2010-07-31 Thread David Cournapeau
On Sun, Aug 1, 2010 at 1:34 AM, Chris Withers ch...@simplistix.co.uk wrote: David Cournapeau wrote: On Tue, Jul 27, 2010 at 5:36 PM, Chris Withers ch...@simplistix.co.uk wrote: Indeed, but the other option requires a more complicated service to query. Being able to serve packages from

  1   2   3   4   >