Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-21 Thread Robert McGibbon
Hi all, Just as a heads up: Nathaniel and I wrote a draft PEP on binary linux wheels that is now being discussed on distutils-sig, so you can check that out and participate in the conversation if you're interested. - PEP on python.org: https://www.python.org/dev/peps/pep-0513/ - PEP on github

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-15 Thread Robert McGibbon
On Fri, Jan 15, 2016 at 11:56 AM, Travis Oliphant wrote: > > > I still submit that this is not the best use of time. Conda *already* solves the problem.My sadness is that people keep working to create an ultimately inferior solution rather than just help make a better

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-11 Thread Robert McGibbon
> And in any case we have lots of users who don't use conda and are thus doomed to support both ecosystems regardless, so we might as well make the best of it :-). Yes, this is the key. Conda is a great tool for a lot of users / use cases, but it's not for everyone. Anyways, I think I've made a

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-11 Thread Robert McGibbon
, is here: https://github.com/rmcgibbo/deloc8. It's currently fairly modest and can only list non-whitelisted external shared library dependencies, and verify that sufficiently old versioned symbols for glibc and its ilk are used. -Robert On Sun, Jan 10, 2016 at 1:19 AM, Robert McGibbon <rmcgi.

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-10 Thread Robert McGibbon
> > Right. There's a small problem which is that the base linux system >> isn't just "CentOS 5", it's "CentOS 5 and here's the list of libraries > > that you're allowed to link to: ...", where that list is empirically > > chosen to include only stuff that really is installed on ~all linux >>

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-10 Thread Robert McGibbon
le other ideas about how to filter > this based on using debian popularity-contests and the package graph. I > will report back when I have more info. > > -Robert > > On Sat, Jan 9, 2016 at 3:04 PM, Nathaniel Smith <n...@pobox.com> wrote: > >> On Sat, Jan 9, 2016 at 3:52 A

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
pen to dynamically load shared libraries that are actually just optional (and catch the error and recover gracefully if the library can't be loaded). -Robert On Sat, Jan 9, 2016 at 4:20 AM, Julian Taylor <jtaylor.deb...@googlemail.com > wrote: > On 09.01.2016 12:52, Robert McGibbon wrote

[Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
Hi all, I went ahead and tried to collect a list of all of the libraries that could be considered to constitute the "base" system for linux-64. The strategy I used was to leverage off the work done by the folks at Continuum by searching through their pre-compiled binaries from

Re: [Numpy-discussion] Defining a base linux-64 environment [was: Should I use pip install numpy in linux?]

2016-01-09 Thread Robert McGibbon
ity-contests and the package graph. I will report back when I have more info. -Robert On Sat, Jan 9, 2016 at 3:04 PM, Nathaniel Smith <n...@pobox.com> wrote: > On Sat, Jan 9, 2016 at 3:52 AM, Robert McGibbon <rmcgi...@gmail.com> > wrote: > > Hi all, > > > > I went a

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
Does anyone know if there's been any movements with the PyPI folks on allowing linux wheels to be uploaded? I know you can never be certain what's provided by the distro, but it seems like if Anaconda can solve the cross-distro-binary-distribution-of-compiled-python-extensions problem, there

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
Brett <matthew.br...@gmail.com> wrote: > Hi, > > On Fri, Jan 8, 2016 at 11:27 PM, Chris Barker <chris.bar...@noaa.gov> > wrote: > > On Fri, Jan 8, 2016 at 1:58 PM, Robert McGibbon <rmcgi...@gmail.com> > wrote: > >> > >> I'm not sure i

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
extensions. But it's categorically ruled out by the PyPI policy, IIUC. Perhaps this is OT for this thread, and I should ask on distutils-sig. -Robert On Fri, Jan 8, 2016 at 12:12 PM, Oscar Benjamin <oscar.j.benja...@gmail.com> wrote: > > On 8 Jan 2016 19:07, "Robert McGibbon" <

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
> Doesn't building on CentOS 5 also mean using a quite old version of gcc? I have had pretty good luck using the (awesomely named) Holy Build Box , which is a CentOS 5 docker image with a newer gcc version installed (but I guess the same old libc). I'm

Re: [Numpy-discussion] Should I use pip install numpy in linux?

2016-01-08 Thread Robert McGibbon
hard... right? -Robert On Fri, Jan 8, 2016 at 8:03 PM, Nathaniel Smith <n...@pobox.com> wrote: > On Fri, Jan 8, 2016 at 7:41 PM, Robert McGibbon <rmcgi...@gmail.com> > wrote: > >> Doesn't building on CentOS 5 also mean using a quite old version of gcc? > > > &

Re: [Numpy-discussion] numpy-1.11.0.dev0 windows wheels compiled with mingwpy available

2015-10-22 Thread Robert McGibbon
Got it. Thanks, Nathaniel -- this is really good information. -Robert On Mon, Oct 19, 2015 at 6:55 PM, Nathaniel Smith wrote: > On Mon, Oct 19, 2015 at 2:26 AM, Olivier Grisel > wrote: > >> Is it possible to test this with py35 as well? > > > >

Re: [Numpy-discussion] numpy-1.11.0.dev0 windows wheels compiled with mingwpy available

2015-10-18 Thread Robert McGibbon
Hi, Is it possible to test this with py35 as well? For MSVC, py35 requires a new compiler toolchain (VS2015) -- is that something mingwpy/mingw-w64 can handle? -Robert On Fri, Oct 9, 2015 at 3:29 PM, Carl Kleffner wrote: > I made numpy master (numpy-1.11.0.dev0 , >

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-16 Thread Robert McGibbon
My apologies for the typo: 'implements' - 'implementations' -Robert On Sun, Mar 15, 2015 at 11:06 PM, Robert McGibbon rmcgi...@gmail.com wrote: It might make sense to dispatch to difference c implements if the bins are equally spaced (as created by using an integer for the np.histogram bins

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-16 Thread Robert McGibbon
, Mar 15, 2015 at 11:00 PM, Jaime Fernández del Río jaime.f...@gmail.com wrote: On Sun, Mar 15, 2015 at 9:32 PM, Robert McGibbon rmcgi...@gmail.com wrote: Hi, Numpy.histogram is implemented in python, and is a little sluggish. This has been discussed previously on the mailing list, [1, 2

Re: [Numpy-discussion] Rewrite np.histogram in c?

2015-03-16 Thread Robert McGibbon
Hi, It sounds like putting together a PR makes sense then. I'll try hacking on this a bit. -Robert On Mar 16, 2015 11:20 AM, Jaime Fernández del Río jaime.f...@gmail.com wrote: On Mon, Mar 16, 2015 at 9:28 AM, Jerome Kieffer jerome.kief...@esrf.fr wrote: On Mon, 16 Mar 2015 06:56:58 -0700

[Numpy-discussion] Rewrite np.histogram in c?

2015-03-15 Thread Robert McGibbon
Hi, Numpy.histogram is implemented in python, and is a little sluggish. This has been discussed previously on the mailing list, [1, 2]. It came up in a project that I maintain, where a new feature is bottlenecked by numpy.histogram, and one developer suggested a faster implementation in cython

Re: [Numpy-discussion] appveyor CI

2015-03-05 Thread Robert McGibbon
I develop on linux and osx, and I haven't experienced any Appveyor problems related to line endings, so I assume it's normalized somehow. -Robert On Mar 5, 2015 5:08 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Thu, Mar 5, 2015 at 5:38 PM, Robert McGibbon rmcgi...@gmail.com wrote

Re: [Numpy-discussion] appveyor CI

2015-03-05 Thread Robert McGibbon
From my experience, it's pretty easy, assuming you're prepared to pick up some powershell. Some useful resources are - Olivier Grisel's example. https://github.com/ogrisel/python-appveyor-demo - I made a similar example, using conda. https://github.com/rmcgibbo/python-appveyor-conda-example

[Numpy-discussion] Fast sizes for FFT

2014-12-23 Thread Robert McGibbon
Hey, The performance of fftpack depends very strongly on the array size -- sizes that are powers of two are good, but also powers of three, five and seven, or numbers whose only prime factors are from (2,3,5,7). For problems that can use padding, rounding up the size (using np.fft.fft(x,

Re: [Numpy-discussion] Fast sizes for FFT

2014-12-23 Thread Robert McGibbon
Alex Griffing pointed out on github that this feature was recently added to scipy in https://github.com/scipy/scipy/pull/3144. Sweet! -Robert On Tue, Dec 23, 2014 at 6:47 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Tue, Dec 23, 2014 at 7:32 PM, Robert McGibbon rmcgi

Re: [Numpy-discussion] Initializing array from buffer

2014-11-17 Thread Robert McGibbon
The np.ndarray constructor http://docs.scipy.org/doc/numpy/reference/generated/numpy.ndarray.html takes a strides argument argument, and a buffer. Is it not sufficiently flexible? -Robert On Sun, Nov 16, 2014 at 4:27 PM, Sturla Molden sturla.mol...@gmail.com wrote: Andrea Arteaga

Re: [Numpy-discussion] 64-bit windows numpy / scipy wheels for testing

2014-07-27 Thread Robert McGibbon
I forked Olivier's example project to use the same infrastructure for building conda binaries and deploying them to binstar, which might also be useful for some projects. https://github.com/rmcgibbo/python-appveyor-conda-example -Robert On Wed, Jul 9, 2014 at 3:53 PM, Robert McGibbon rmcgi

Re: [Numpy-discussion] 64-bit windows numpy / scipy wheels for testing

2014-07-10 Thread Robert McGibbon
This is an awesome resource for tons of projects. Thanks Olivier! -Robert On Wed, Jul 9, 2014 at 7:00 AM, Olivier Grisel olivier.gri...@ensta.org wrote: Feodor updated the AppVeyor nodes to have the Windows SDK matching MSVC 2008 Express for Python 2. I have updated my sample scripts and

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
Yeah, that's definitely not the right signature for sdot when linked against the Accelerate framework. But what's the purpose of those wrappers in _umath_linalg? The one for sdot, for example, doesn't appear to be used internally, and it isn't available from the python side. While scipy has all

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
, Robert McGibbon rmcgi...@gmail.com wrote: Yeah, that's definitely not the right signature for sdot when linked against the Accelerate framework. But what's the purpose of those wrappers in _umath_linalg? The one for sdot, for example, doesn't appear to be used internally, and it isn't

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
But I can't reproduce #4007 on my machine, so I'm not totally sure. -Robert On Sun, Jun 8, 2014 at 9:07 PM, Robert McGibbon rmcgi...@gmail.com wrote: #4776 is definitely a separate issue. #4007 could be related similar f2c ABI issues, but I don't think so. The difference between the gfotran

Re: [Numpy-discussion] BLAS and LAPACK ABI questions (mostly OSX related)

2014-06-08 Thread Robert McGibbon
observation about the _umath_linalg ABI issues is separate. -Robert [1] https://github.com/numpy/numpy/issues/4007#issuecomment-27708193 On Sun, Jun 8, 2014 at 9:25 PM, Matthew Brett matthew.br...@gmail.com wrote: On Mon, Jun 9, 2014 at 5:08 AM, Robert McGibbon rmcgi...@gmail.com wrote: But I

Re: [Numpy-discussion] Distutils - way to check validity of compiler flag?

2014-05-12 Thread Robert McGibbon
In a couple of my projects, we check for flags by compiling little test files -- autotools style -- to check for SSE, OpenMP, etc. See e.g. https://github.com/rmcgibbo/mdtraj/blob/master/setup.py#L215 If anyone has a better solution, I'm all ears. -Robert On Mon, May 12, 2014 at 12:24 PM,

[Numpy-discussion] segfault from scipy.io.netcdf with scipy-0.14 numpy-0.18

2014-05-08 Thread Robert McGibbon
Hey all, The travis tests for a library I work on just stopped working, and I tracked down the bug to the following test case. The file MDTraj/testing/reference/mdcrd.nc is a netcdf3 file in our repository ( https://github.com/rmcgibbo/mdtraj/tree/master/MDTraj/testing/reference). this script:

[Numpy-discussion] Any numpy core devs on gittip (or similar)?

2014-03-25 Thread Robert McGibbon
Hey, I've just been reading the discussionhttp://code.activestate.com/lists/python-dev/129419/on python-dev about PEP466, the meta-theme of which is that building and maintaining mission-critical software is just really tough. I don't really use SSL from python (the major topic of that