[Numpy-discussion] Scipy build can't find BLAS when using numpy master? (Was: Should arr.diagonal() return a copy or a view? (1.7 compatibility issue))

2012-05-16 Thread Nathaniel Smith
On Wed, May 16, 2012 at 3:15 PM, Robert Kern robert.k...@gmail.com wrote: On Wed, May 16, 2012 at 3:10 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, May 16, 2012 at 3:04 PM, Benjamin Root ben.r...@ou.edu wrote: Just as a sanity check, do the scipy tests run without producing any

Re: [Numpy-discussion] Scipy build can't find BLAS when using numpy master? (Was: Should arr.diagonal() return a copy or a view? (1.7 compatibility issue))

2012-05-16 Thread Nathaniel Smith
On Wed, May 16, 2012 at 4:24 PM, Robert Kern robert.k...@gmail.com wrote: On Wed, May 16, 2012 at 4:21 PM, Nathaniel Smith n...@pobox.com wrote: I built some pristine python 2.7 installs from scratch (no virtualenv, no distro tweaks, etc.). Then I installed some version of numpy in each

Re: [Numpy-discussion] Scipy build can't find BLAS when using numpy master? (Was: Should arr.diagonal() return a copy or a view? (1.7 compatibility issue))

2012-05-16 Thread Nathaniel Smith
On Wed, May 16, 2012 at 4:50 PM, Robert Kern robert.k...@gmail.com wrote: On Wed, May 16, 2012 at 4:35 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, May 16, 2012 at 4:24 PM, Robert Kern robert.k...@gmail.com wrote: On Wed, May 16, 2012 at 4:21 PM, Nathaniel Smith n...@pobox.com wrote: I

Re: [Numpy-discussion] Should arr.diagonal() return a copy or a view? (1.7 compatibility issue)

2012-05-16 Thread Nathaniel Smith
On Wed, May 16, 2012 at 3:04 PM, Benjamin Root ben.r...@ou.edu wrote: On Wed, May 16, 2012 at 9:55 AM, Nathaniel Smith n...@pobox.com wrote: On Tue, May 15, 2012 at 2:49 PM, Frédéric Bastien no...@nouiz.org wrote: Hi, In fact, I would arg to never change the current behavior, but add

Re: [Numpy-discussion] tracing numpy data allocation with python callbacks

2012-05-17 Thread Nathaniel Smith
On Thu, May 17, 2012 at 7:50 PM, Stéfan van der Walt ste...@sun.ac.za wrote: On Wed, May 16, 2012 at 12:34 PM, Thouis Jones thouis.jo...@curie.fr wrote: I wondered, however, if there were a better way to accomplish the same goal, preferably in pure python. Fabien recently posted this; not

Re: [Numpy-discussion] Masked Array for NumPy 1.7

2012-05-19 Thread Nathaniel Smith
On Sat, May 19, 2012 at 4:21 PM, Mark Wiebe mwwi...@gmail.com wrote: The motivation behind splitting the mask out into a separate ndmasked is primarily so that pre-existing code will not silently function on NA-masked arrays and produce incorrect results. This centres around using PyArray_DATA

Re: [Numpy-discussion] Masked Array for NumPy 1.7

2012-05-19 Thread Nathaniel Smith
On Sat, May 19, 2012 at 5:45 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Sat, May 19, 2012 at 10:02 AM, Charles R Harris charlesr.har...@gmail.com wrote: On Sat, May 19, 2012 at 9:21 AM, Mark Wiebe mwwi...@gmail.com wrote: On Sat, May 19, 2012 at 10:00 AM, David Cournapeau

[Numpy-discussion] Separating out the maskna code

2012-05-19 Thread Nathaniel Smith
Hi all, Since Mark's original missingdata branch made so many changes, I figured it would be a useful exercise to figure out what code in master is actually related to masked arrays, and which isn't. The easiest way seemed to be to delete the new fields, then keep removing any code that depended

Re: [Numpy-discussion] Internationalization of numpy/scipy docstrings...

2012-05-19 Thread Nathaniel Smith
On May 19, 2012 11:04 PM, Tim Cera t...@cerazone.net wrote: A user would then install a language kit, maybe something like scikits and access the translated docstring with a new 'np.info'. As near as I can figure, Python 'help' command can't be replaced by something else, so 'help' would always

Re: [Numpy-discussion] Separating out the maskna code

2012-05-20 Thread Nathaniel Smith
On Sun, May 20, 2012 at 6:08 AM, Travis Oliphant tra...@continuum.io wrote: Wow, Nathaniel.   This looks like a nice piece of tedious work. Honestly, it only took a few hours -- M-x grep is awesome. Would still have been better if it'd been separated in the first place, but so it goes. I have

Re: [Numpy-discussion] Separating out the maskna code

2012-05-20 Thread Nathaniel Smith
On Sun, May 20, 2012 at 11:35 AM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Sat, May 19, 2012 at 10:54 PM, Nathaniel Smith n...@pobox.com wrote: Ralf, IIUC merging this and my other outstanding PRs would leave the datetime issues on python3/win32 as the only outstanding blocker

Re: [Numpy-discussion] Separating out the maskna code

2012-05-20 Thread Nathaniel Smith
On Sun, May 20, 2012 at 6:59 PM, Nathaniel Smith n...@pobox.com wrote: I have not reviewed it in detail, but in general I would be very supportive of your plan to commit this to master, make a 1.7 release (without the ReduceWrapper) function and then work on the masked array / ndarray

Re: [Numpy-discussion] Internationalization of numpy/scipy docstrings...

2012-05-21 Thread Nathaniel Smith
On Mon, May 21, 2012 at 10:44 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: Thinking about what languages to translate into would also make sense, since having a bunch of partial translations lying around doesn't help anyone. First thought: Spanish, Chinese. It's not like one can tell

[Numpy-discussion] Trivial pull request: tox support

2012-05-21 Thread Nathaniel Smith
I got tired of juggling virtualenvs, and probably everyone else would soon get tired of pointing out Python 2.4 incompatibilities I'd forgotten to test, so: https://github.com/numpy/numpy/pull/285 - N ___ NumPy-Discussion mailing list

[Numpy-discussion] un-silencing Numpy's deprecation warnings

2012-05-22 Thread Nathaniel Smith
So starting in Python 2.7 and 3.2, the Python developers have made DeprecationWarnings invisible by default: http://docs.python.org/whatsnew/2.7.html#the-future-for-python-2-x http://mail.python.org/pipermail/stdlib-sig/2009-November/000789.html http://bugs.python.org/issue7319 The only way

Re: [Numpy-discussion] Separating out the maskna code

2012-05-22 Thread Nathaniel Smith
PM, Nathaniel Smith wrote: On Sun, May 20, 2012 at 6:59 PM, Nathaniel Smith n...@pobox.com wrote: I have not reviewed it in detail, but in general I would be very supportive of your plan to commit this to master, make a 1.7 release (without the ReduceWrapper) function and then work

Re: [Numpy-discussion] un-silencing Numpy's deprecation warnings

2012-05-22 Thread Nathaniel Smith
On Tue, May 22, 2012 at 11:06 AM, Robert Kern robert.k...@gmail.com wrote: On Tue, May 22, 2012 at 9:27 AM, Nathaniel Smith n...@pobox.com wrote: So starting in Python 2.7 and 3.2, the Python developers have made DeprecationWarnings invisible by default:  http://docs.python.org/whatsnew/2.7

Re: [Numpy-discussion] subclassing ndarray subtleties??

2012-05-22 Thread Nathaniel Smith
On Mon, May 21, 2012 at 6:47 PM, Tom Aldcroft aldcr...@head.cfa.harvard.edu wrote: Over on the scipy-user mailing list there was a question about subclassing ndarray and I was interested to see two responses that seemed to imply that subclassing should be avoided. From Dag and Nathaniel,

Re: [Numpy-discussion] Should arr.diagonal() return a copy or a view? (1.7 compatibility issue)

2012-05-23 Thread Nathaniel Smith
On Wed, May 23, 2012 at 6:06 AM, Travis Oliphant tra...@continuum.io wrote: I just realized that the pull request doesn't do what I thought it did which is just add the flag to warn users who are writing to an array that is a view when it used to be a copy.     It's more cautious and also

Re: [Numpy-discussion] Should arr.diagonal() return a copy or a view? (1.7 compatibility issue)

2012-05-23 Thread Nathaniel Smith
On Wed, May 23, 2012 at 2:11 PM, Frédéric Bastien no...@nouiz.org wrote: +1 Don't forget that many user always update to each version. So they will skip many version. This is especially true for people that rely on the distribution package that skip many version when they update. So this is

Re: [Numpy-discussion] Should arr.diagonal() return a copy or a view? (1.7 compatibility issue)

2012-05-23 Thread Nathaniel Smith
On Wed, May 23, 2012 at 6:29 PM, Travis Oliphant tra...@continuum.io wrote: Then are you suggesting that we need to back out the changes to the casting rules as well, because this will also cause code to stop working.   This is part of my point.   We are not being consistently cautious. I

Re: [Numpy-discussion] Should arr.diagonal() return a copy or a view? (1.7 compatibility issue)

2012-05-23 Thread Nathaniel Smith
On Wed, May 23, 2012 at 10:53 PM, Travis Oliphant tra...@continuum.io wrote: To be clear, I'm not opposed to the change, and it looks like we should go forward. In my mind it's not about developers vs. users as satisfying users is the whole point.   The purpose of NumPy is not to make its

Re: [Numpy-discussion] Checking for views (was: Should arr.diagonal() return a copy or aview?)

2012-05-24 Thread Nathaniel Smith
On Thu, May 24, 2012 at 3:56 PM, Jonathan T. Niehof jnie...@lanl.gov wrote: On 05/23/2012 05:31 PM, T J wrote: It seems that there are a number of ways to check if an array is a view. Do we have a preferred way in the API that is guaranteed to stay available? Or are all of the various methods

Re: [Numpy-discussion] Checking for views (was: Should arr.diagonal() return a copy or aview?)

2012-05-24 Thread Nathaniel Smith
On Thu, May 24, 2012 at 6:07 PM, Larsen, Brian A balar...@lanl.gov wrote: This is the stack overflow discussion mentioned. http://stackoverflow.com/questions/9164269/can-you-tell-if-an-array-is-a-view-of-another I basically implemented the answer from SO.  I feel like the is gives you a good

Re: [Numpy-discussion] .max(0) on reshaped array returns inconsistent results.

2012-05-25 Thread Nathaniel Smith
On Fri, May 25, 2012 at 12:46 PM, Thouis (Ray) Jones tho...@gmail.com wrote: I'm seeing some strange behavior from .max() on a reshaped array in the current master, and wanted to raise it here to make sure it's not something uniquely broken in my setup. This code fails for me, though changing

Re: [Numpy-discussion] Checking for views (was: Should arr.diagonal() return a copy or aview?)

2012-05-25 Thread Nathaniel Smith
On May 25, 2012 2:21 PM, Robert Kern robert.k...@gmail.com wrote: On Thu, May 24, 2012 at 5:52 PM, Robert Kern robert.k...@gmail.com wrote: (Hmm, now that I think about it, the edge cases are when the strides are 0 or negative. 0-stride axes can simply be removed, and I think we should be

Re: [Numpy-discussion] Checking for views (was: Should arr.diagonal() return a copy or aview?)

2012-05-25 Thread Nathaniel Smith
On Fri, May 25, 2012 at 4:59 PM, Robert Kern robert.k...@gmail.com wrote: On Fri, May 25, 2012 at 3:55 PM, Nathaniel Smith n...@pobox.com wrote: On May 25, 2012 2:21 PM, Robert Kern robert.k...@gmail.com wrote: On Thu, May 24, 2012 at 5:52 PM, Robert Kern robert.k...@gmail.com wrote: (Hmm

Re: [Numpy-discussion] [ANN] Cell magics in IPython master

2012-05-27 Thread Nathaniel Smith
Hi Fernando, Excellent work! On Sun, May 27, 2012 at 8:08 AM, Fernando Perez fperez@gmail.com wrote: In a similar spirit, Jonathan Taylor recently created one to call R transparently in the notebook: https://github.com/jonathan-taylor/Rmagic This one hasn't been fully updated to the

Re: [Numpy-discussion] silly isscalar question

2012-05-29 Thread Nathaniel Smith
On Tue, May 29, 2012 at 2:00 PM, Mark Bakker mark...@gmail.com wrote: Why does isscalar('hello') return True? I thought it would check for a number? Numpy 1.6.1 Silly question? Nope, but you're thinking of a different sense of scalar :-). In numpy, scalar means something like anything

Re: [Numpy-discussion] silly isscalar question

2012-05-29 Thread Nathaniel Smith
On Tue, May 29, 2012 at 2:31 PM, Derek Homeier de...@astro.physik.uni-goettingen.de wrote: On 29 May 2012, at 15:00, Mark Bakker wrote: Why does isscalar('hello') return True? I thought it would check for a number? No, it checks for something that is of 'scalar type', which probably can be

Re: [Numpy-discussion] 1.6.2 no more unique for rows

2012-05-30 Thread Nathaniel Smith
On Tue, May 29, 2012 at 7:42 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Mon, May 28, 2012 at 9:18 PM, josef.p...@gmail.com wrote: https://github.com/numpy/numpy/commit/74b9f5eef8fac643bf9012dbb2ac6b4b19f46892 broke return_inverse for structured arrays, because of the use of

Re: [Numpy-discussion] better error message possible?

2012-06-01 Thread Nathaniel Smith
On Fri, Jun 1, 2012 at 10:46 AM, Chris Withers ch...@simplistix.co.uk wrote: Hi All, Any reason why this:   import numpy   numpy.zeros(10)[-123] Traceback (most recent call last):   File stdin, line 1, in module IndexError: index out of bounds ...could say this:  

Re: [Numpy-discussion] some typestrings not recognized anymore

2012-06-03 Thread Nathaniel Smith
On Sun, Jun 3, 2012 at 3:28 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: Hi, Just ran into this: np.__version__ '1.5.1' np.empty((1,), dtype='h2')  # works in 1.6.2 too array([0], dtype=int16) np.__version__ '1.7.0.dev-fd78546' np.empty((1,), dtype='h2') Traceback (most recent

Re: [Numpy-discussion] better error message possible?

2012-06-04 Thread Nathaniel Smith
On Mon, Jun 4, 2012 at 10:00 PM, Thouis (Ray) Jones tho...@gmail.com wrote: On Mon, Jun 4, 2012 at 4:27 PM, Thouis (Ray) Jones tho...@gmail.com wrote: I could look into this.  There are only ~10 places the code generates this error, so it should be a pretty minor change. My initial estimate

[Numpy-discussion] nditer_buffer_flag branch (was: Add data memory allocation tracing facilities. (#284))

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 11:06 AM, Thouis (Ray) Jones wrote: All of the failing tests seem to have been caused by the buffer copy bug, fixed in  https://github.com/mwiebe/numpy/tree/nditer_buffer_flag (but not yet pulled into numpy). I also have a version that implements tracing, with pure C

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 12:55 PM, mark florisson markflorisso...@gmail.com wrote: It would be great if we implement the NEP listed above, but with a few extensions. I think Numpy should handle the lazy evaluation part, and determine when expressions should be evaluated, etc. However, for each

Re: [Numpy-discussion] Changes in PyArray_FromAny between 1.5.x and 1.6.x

2012-06-05 Thread Nathaniel Smith
On Mon, Jun 4, 2012 at 10:12 PM, Dag Sverre Seljebotn d.s.seljeb...@astro.uio.no wrote: On 06/04/2012 09:06 PM, Mike Hansen wrote: On Mon, May 28, 2012 at 3:15 AM, Mike Hansenmhan...@gmail.com  wrote: In trying to upgrade NumPy within Sage, we notices some differences in behavior between 1.5

Re: [Numpy-discussion] commit rights for Nathaniel

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 4:19 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Sun, Jun 3, 2012 at 12:04 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Sun, Jun 3, 2012 at 6:43 PM, Charles R Harris charlesr.har...@gmail.com wrote: Hi All, Numpy is approaching a time of

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 4:12 PM, mark florisson markflorisso...@gmail.com wrote: On 5 June 2012 14:58, Nathaniel Smith n...@pobox.com wrote: On Tue, Jun 5, 2012 at 12:55 PM, mark florisson markflorisso...@gmail.com wrote: It would be great if we implement the NEP listed above, but with a few

Re: [Numpy-discussion] Changes in PyArray_FromAny between 1.5.x and 1.6.x

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 7:47 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Tue, Jun 5, 2012 at 8:41 PM, Zachary Pincus zachary.pin...@yale.edu wrote: There is a fine line here. We do need to make people clean up lax code in order to improve numpy, but hopefully we can keep the

Re: [Numpy-discussion] lazy evaluation

2012-06-05 Thread Nathaniel Smith
On Tue, Jun 5, 2012 at 7:08 PM, mark florisson markflorisso...@gmail.com wrote: On 5 June 2012 17:38, Nathaniel Smith n...@pobox.com wrote: On Tue, Jun 5, 2012 at 4:12 PM, mark florisson markflorisso...@gmail.com wrote: On 5 June 2012 14:58, Nathaniel Smith n...@pobox.com wrote: On Tue, Jun 5

Re: [Numpy-discussion] Incrementing with advanced indexing: why don't repeated indexes repeatedly increment?

2012-06-06 Thread Nathaniel Smith
On Wed, Jun 6, 2012 at 9:48 AM, John Salvatier jsalv...@u.washington.edu wrote: Hello, I've noticed that If you try to increment elements of an array with advanced indexing, repeated indexes don't get repeatedly incremented. For example: In [30]: x = zeros(5) In [31]: idx =

Re: [Numpy-discussion] Incrementing with advanced indexing: why don't repeated indexes repeatedly increment?

2012-06-06 Thread Nathaniel Smith
On Wed, Jun 6, 2012 at 4:30 PM, Robert Cimrman cimrm...@ntc.zcu.cz wrote: On 06/06/2012 05:06 PM, Nathaniel Smith wrote: On Wed, Jun 6, 2012 at 9:48 AM, John Salvatier jsalv...@u.washington.edu  wrote: Hello, I've noticed that If you try to increment elements of an array with advanced

[Numpy-discussion] Pull request: Split maskna support out of mainline into a branch

2012-06-06 Thread Nathaniel Smith
Just submitted this pull request for discussion: https://github.com/numpy/numpy/pull/297 As per earlier discussion on the list, this PR attempts to remove exactly and only the maskna-related code from numpy mainline: http://mail.scipy.org/pipermail/numpy-discussion/2012-May/062417.html The

Re: [Numpy-discussion] Numpy structures

2012-06-08 Thread Nathaniel Smith
On Fri, Jun 8, 2012 at 11:31 AM, Bob Cowdery b...@bobcowdery.plus.com wrote: Hi all, I am reading a datagram which contains within it a type. The type dictates the structure of the datagram. I want to put this into a numpy structure, one of which is:

[Numpy-discussion] Fwd: [numpy] ENH: Initial implementation of a 'neighbor' calculation (#303)

2012-06-09 Thread Nathaniel Smith
[Manual PR notification] -- Forwarded message -- From: timcera Date: Sat, Jun 9, 2012 at 10:13 PM Subject: [numpy] ENH: Initial implementation of a 'neighbor' calculation (#303) To: njsmith n...@pobox.com Each element is assigned the result of a function based on it's neighbors.

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-13 Thread Nathaniel Smith
On Tue, Jun 12, 2012 at 10:27 PM, Bryan Van de Ven bry...@continuum.io wrote: Hi all, It has been some time, but I do have an update regarding this proposed feature. I thought it would be helpful to flesh out some parts of a possible implementation to learn what can be spelled reasonably in

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-13 Thread Nathaniel Smith
On Wed, Jun 13, 2012 at 5:04 PM, Dag Sverre Seljebotn d.s.seljeb...@astro.uio.no wrote: On 06/13/2012 03:33 PM, Nathaniel Smith wrote: I'm inclined to say therefore that we should just drop the open type idea, since it adds complexity but doesn't seem to actually solve the problem it's

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-13 Thread Nathaniel Smith
On Wed, Jun 13, 2012 at 5:44 PM, Bryan Van de Ven bry...@continuum.io wrote: On 6/13/12 8:33 AM, Nathaniel Smith wrote: Hi Bryan, I skimmed over the diff:     https://github.com/bryevdv/numpy/compare/master...enum It was a bit hard to read since it seems like about half the changes

Re: [Numpy-discussion] automatic differentiation with PyAutoDiff

2012-06-14 Thread Nathaniel Smith
On Thu, Jun 14, 2012 at 3:42 PM, Olivier Grisel olivier.gri...@ensta.org wrote: 2012/6/14 James Bergstra bergs...@iro.umontreal.ca: On Thu, Jun 14, 2012 at 4:00 AM, Olivier Grisel olivier.gri...@ensta.org wrote: 2012/6/13 James Bergstra bergs...@iro.umontreal.ca: Further to the recent

Re: [Numpy-discussion] Pull request: Split maskna support out of mainline into a branch

2012-06-14 Thread Nathaniel Smith
On Wed, Jun 6, 2012 at 11:08 PM, Nathaniel Smith n...@pobox.com wrote: Just submitted this pull request for discussion:  https://github.com/numpy/numpy/pull/297 As per earlier discussion on the list, this PR attempts to remove exactly and only the maskna-related code from numpy mainline

Re: [Numpy-discussion] Pull request: Split maskna support out of mainline into a branch

2012-06-14 Thread Nathaniel Smith
On Thu, Jun 14, 2012 at 5:20 PM, David Cournapeau courn...@gmail.com wrote: On Thu, Jun 14, 2012 at 5:17 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, Jun 6, 2012 at 11:08 PM, Nathaniel Smith n...@pobox.com wrote: Just submitted this pull request for discussion:  https://github.com

Re: [Numpy-discussion] automatic differentiation with PyAutoDiff

2012-06-14 Thread Nathaniel Smith
On Thu, Jun 14, 2012 at 7:53 PM, James Bergstra bergs...@iro.umontreal.ca wrote: On Thu, Jun 14, 2012 at 11:01 AM, Nathaniel Smith n...@pobox.com wrote: Indeed that would be great as sympy already has already excellent math expression rendering. An alternative would be to output mathml

Re: [Numpy-discussion] boolean indexing change

2012-06-14 Thread Nathaniel Smith
On Mon, Jun 11, 2012 at 1:31 AM, Travis Oliphant tra...@continuum.io wrote: It is unfortunate that this was committed to master.  This should be backed out and is a blocker for 1.7.   Can someone help me identify which commit made the change? This is a rather significant change and changes

Re: [Numpy-discussion] automatic differentiation with PyAutoDiff

2012-06-14 Thread Nathaniel Smith
On Thu, Jun 14, 2012 at 9:22 PM, srean srean.l...@gmail.com wrote: For example, I wrote a library routine for doing log-linear regression. Doing this required computing the derivative of the likelihood function, which was a huge nitpicky hassle; took me a few hours to work out and debug. But

Re: [Numpy-discussion] Matrix rank default tolerance - is it too low?

2012-06-16 Thread Nathaniel Smith
On Fri, Jun 15, 2012 at 4:10 AM, Charles R Harris charlesr.har...@gmail.com wrote: On Thu, Jun 14, 2012 at 8:06 PM, Matthew Brett matthew.br...@gmail.com wrote: Hi, I noticed that numpy.linalg.matrix_rank sometimes gives full rank for matrices that are numerically rank deficient: If I

[Numpy-discussion] travis-ci support for numpy

2012-06-16 Thread Nathaniel Smith
Thanks to Marc Abramowitz[1], Numpy commits are now being tested by Travis-CI: http://travis-ci.org/#!/numpy/numpy As discussed on the numfocus list[2], this isn't really a complete CI solution, because it only gives test coverage on 64-bit Ubuntu. But, it does cover all supported versions of

Re: [Numpy-discussion] Matrix rank default tolerance - is it too low?

2012-06-16 Thread Nathaniel Smith
On Sat, Jun 16, 2012 at 9:03 PM, Matthew Brett matthew.br...@gmail.com wrote: Hi, On Sat, Jun 16, 2012 at 10:40 AM, Nathaniel Smith n...@pobox.com wrote: On Fri, Jun 15, 2012 at 4:10 AM, Charles R Harris charlesr.har...@gmail.com wrote: On Thu, Jun 14, 2012 at 8:06 PM, Matthew Brett

Re: [Numpy-discussion] Pull request: Split maskna support out of mainline into a branch

2012-06-16 Thread Nathaniel Smith
On Thu, Jun 14, 2012 at 5:20 PM, David Cournapeau courn...@gmail.com wrote: On Thu, Jun 14, 2012 at 5:17 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, Jun 6, 2012 at 11:08 PM, Nathaniel Smith n...@pobox.com wrote: Just submitted this pull request for discussion:  https://github.com

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-17 Thread Nathaniel Smith
On Wed, Jun 13, 2012 at 7:54 PM, Wes McKinney wesmck...@gmail.com wrote: It looks like the levels can only be strings. This is too limited for my needs. Why not support all possible NumPy dtypes? In pandas world, the levels can be any unique Index object It seems like there are three obvious

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-17 Thread Nathaniel Smith
On Sun, Jun 17, 2012 at 9:04 PM, Wes McKinney wesmck...@gmail.com wrote: On Sun, Jun 17, 2012 at 6:10 AM, Nathaniel Smith n...@pobox.com wrote: On Wed, Jun 13, 2012 at 7:54 PM, Wes McKinney wesmck...@gmail.com wrote: It looks like the levels can only be strings. This is too limited for my

Re: [Numpy-discussion] Pull request: Split maskna support out of mainline into a branch

2012-06-17 Thread Nathaniel Smith
On Jun 17, 2012 9:37 PM, David Cournapeau courn...@gmail.com wrote: On Sat, Jun 16, 2012 at 9:39 PM, Nathaniel Smith n...@pobox.com wrote: On Thu, Jun 14, 2012 at 5:20 PM, David Cournapeau courn...@gmail.com wrote: On Thu, Jun 14, 2012 at 5:17 PM, Nathaniel Smith n...@pobox.com wrote

Re: [Numpy-discussion] Enum/Factor NEP (now with code)

2012-06-17 Thread Nathaniel Smith
On Wed, Jun 13, 2012 at 11:06 PM, Bryan Van de Ven bry...@continuum.io wrote: On 6/13/12 1:12 PM, Nathaniel Smith wrote: Yes, of course we *could* write the code to implement these open dtypes, and then write the documentation, examples, tutorials, etc. to help people work around

Re: [Numpy-discussion] What's the most numpythonic way to support multiple types in a C extension?

2012-06-27 Thread Nathaniel Smith
On Tue, Jun 26, 2012 at 10:53 PM, John Salvatier jsalv...@u.washington.edu wrote: I want to support multiple types in the index_increment function that I've written here: https://github.com/jsalvatier/numpy/blob/master/numpy/core/src/multiarray/mapping.c I need to check that the first

Re: [Numpy-discussion] API policy

2012-06-27 Thread Nathaniel Smith
On Tue, Jun 26, 2012 at 10:02 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: I agree with what you're arguing for here (as little impact as possible on existing users), but your view of especially 1.6.x seems to be skewed by regressions and changes that were either unintended or thought to

[Numpy-discussion] Combined versus separate build

2012-06-27 Thread Nathaniel Smith
Currently the numpy build system(s) support two ways of building numpy: either by compiling a giant concatenated C file, or by the more conventional route of first compiling each .c file to a .o file, and then linking those together. I gather from comments in the source code that the former is the

[Numpy-discussion] Non-deterministic test failure in master

2012-06-27 Thread Nathaniel Smith
According to the Travis-CI build logs, this code produces non-deterministic behaviour in master: a = np.arange(5) a[:3] = a[2:] assert_equal(a, [2, 3, 4, 3, 4]) Sometimes 'a' is [2, 3, 4, 3, 4], and sometimes it is [4, 3, 4, 3, 4]. The latter is what you get if the assignment is done

Re: [Numpy-discussion] Combined versus separate build

2012-06-27 Thread Nathaniel Smith
On Wed, Jun 27, 2012 at 7:50 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jun 27, 2012 at 7:17 PM, Nathaniel Smith n...@pobox.com wrote: Currently the numpy build system(s) support two ways of building numpy: either by compiling a giant concatenated C file, or by the more

Re: [Numpy-discussion] Combined versus separate build

2012-06-27 Thread Nathaniel Smith
On Wed, Jun 27, 2012 at 8:29 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jun 27, 2012 at 8:07 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, Jun 27, 2012 at 7:50 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jun 27, 2012 at 7:17 PM, Nathaniel Smith n...@pobox.com wrote

Re: [Numpy-discussion] memory allocation at assignment

2012-06-27 Thread Nathaniel Smith
On Thu, Jun 28, 2012 at 12:38 AM, astronomer shailendra.vi...@gmail.com wrote: Hi All, I am wondering if there any difference in memory overhead between the following code. a=numpy.arange(10) b=numpy.arange(10) c=a+b and a=numpy.arange(10) b=numpy.arange(10) c=numpy.empty_likes(a)

Re: [Numpy-discussion] memory allocation at assignment

2012-06-28 Thread Nathaniel Smith
On Thu, Jun 28, 2012 at 7:04 PM, Chris Barker chris.bar...@noaa.gov wrote: On Thu, Jun 28, 2012 at 9:06 AM, Pierre Haessig On the other hand, just like srean mentionned, I think I also misused the c[:] = a+b syntax. I feel it's a bit confusing since this way of writing the assignment really

Re: [Numpy-discussion] Non-deterministic test failure in master

2012-06-28 Thread Nathaniel Smith
On Thu, Jun 28, 2012 at 7:13 AM, Pierre Haessig pierre.haes...@crans.org wrote: Hi Nathaniel, Le 27/06/2012 20:22, Nathaniel Smith a écrit : According to the Travis-CI build logs, this code produces non-deterministic behaviour in master: You mean non-deterministic across different builds

Re: [Numpy-discussion] Bug in pickling an ndarray?

2012-06-30 Thread Nathaniel Smith
On Sat, Jun 30, 2012 at 9:15 PM, Daniel Hyams dhy...@gmail.com wrote: I am having trouble pickling (and then unpickling) an ndarray. Upon unpickling, the base attribute of the ndarray is set to some very strange string (base was None when the ndarray was pickled, so it should remain None).

Re: [Numpy-discussion] Combined versus separate build

2012-07-01 Thread Nathaniel Smith
On Wed, Jun 27, 2012 at 9:05 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jun 27, 2012 at 8:53 PM, Nathaniel Smith n...@pobox.com wrote: But seriously, what compilers do we support that don't have -fvisibility=hidden? ...Is there even a list of compilers we support available anywhere

Re: [Numpy-discussion] Combined versus separate build

2012-07-01 Thread Nathaniel Smith
On Sun, Jul 1, 2012 at 7:36 PM, David Cournapeau courn...@gmail.com wrote: On Sun, Jul 1, 2012 at 6:36 PM, Nathaniel Smith n...@pobox.com wrote: On Wed, Jun 27, 2012 at 9:05 PM, David Cournapeau courn...@gmail.com wrote: On Wed, Jun 27, 2012 at 8:53 PM, Nathaniel Smith n...@pobox.com wrote

Re: [Numpy-discussion] Change in memmap behaviour

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 3:53 PM, Sveinung Gundersen svein...@gmail.com wrote: Hi, We are developing a large project for genome analysis (http://hyperbrowser.uio.no), where we use memmap vectors as the basic data structure for storage. The stored data are accessed in slices, and used as basis

Re: [Numpy-discussion] import numpy performance

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 8:17 PM, Andrew Dalke da...@dalkescientific.com wrote: In this email I propose a few changes which I think are minor and which don't really affect the external NumPy API but which I think could improve the import numpy performance by at least 40%. This affects me because

Re: [Numpy-discussion] Change in memmap behaviour

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 6:54 PM, Sveinung Gundersen svein...@gmail.com wrote: [snip] Your actual memory usage may not have increased as much as you think, since memmap objects don't necessarily take much memory -- it sounds like you're leaking virtual memory, but your resident set size

Re: [Numpy-discussion] import numpy performance

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 10:06 PM, Robert Kern robert.k...@gmail.com wrote: On Mon, Jul 2, 2012 at 9:43 PM, Benjamin Root ben.r...@ou.edu wrote: On Mon, Jul 2, 2012 at 4:34 PM, Nathaniel Smith n...@pobox.com wrote: I think this ship has sailed, but it'd be worth looking into lazy importing

Re: [Numpy-discussion] import numpy performance

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 10:44 PM, Andrew Dalke da...@dalkescientific.com wrote: On Jul 2, 2012, at 10:34 PM, Nathaniel Smith wrote: I don't have any opinion on how acceptable this would be, but I also don't see a benchmark showing how much this would help? The profile output was lower

Re: [Numpy-discussion] import numpy performance

2012-07-02 Thread Nathaniel Smith
On Mon, Jul 2, 2012 at 11:15 PM, Andrew Dalke da...@dalkescientific.com wrote: On Jul 2, 2012, at 11:38 PM, Fernando Perez wrote: No, that's the wrong thing to test, because it effectively amounts to 'import numpy', sicne the numpy __init__ file is still executed. As David indicated, you must

Re: [Numpy-discussion] Combined versus separate build

2012-07-02 Thread Nathaniel Smith
On Sun, Jul 1, 2012 at 9:17 PM, David Cournapeau courn...@gmail.com wrote: On Sun, Jul 1, 2012 at 8:32 PM, Nathaniel Smith n...@pobox.com wrote: On Sun, Jul 1, 2012 at 7:36 PM, David Cournapeau courn...@gmail.com wrote: On Sun, Jul 1, 2012 at 6:36 PM, Nathaniel Smith n...@pobox.com wrote

Re: [Numpy-discussion] Change in memmap behaviour

2012-07-03 Thread Nathaniel Smith
On Tue, Jul 3, 2012 at 10:35 AM, Thouis (Ray) Jones tho...@gmail.com wrote: On Mon, Jul 2, 2012 at 11:52 PM, Sveinung Gundersen svein...@gmail.com wrote: On 2. juli 2012, at 22.40, Nathaniel Smith wrote: On Mon, Jul 2, 2012 at 6:54 PM, Sveinung Gundersen svein...@gmail.com wrote: [snip

Re: [Numpy-discussion] Change in memmap behaviour

2012-07-04 Thread Nathaniel Smith
On Tue, Jul 3, 2012 at 4:08 PM, Nathaniel Smith n...@pobox.com wrote: On Tue, Jul 3, 2012 at 10:35 AM, Thouis (Ray) Jones tho...@gmail.com wrote: On Mon, Jul 2, 2012 at 11:52 PM, Sveinung Gundersen svein...@gmail.com wrote: On 2. juli 2012, at 22.40, Nathaniel Smith wrote: On Mon, Jul 2

Re: [Numpy-discussion] Option parsing: tox and test-installed-numpy.py

2012-07-08 Thread Nathaniel Smith
On Sun, Jul 8, 2012 at 6:44 PM, Chris Ball s0454...@sms.ed.ac.uk wrote: Hi, When calling tools/test-installed-numpy.py (https://github.com/numpy/numpy/blob/master/tools/test-installed-numpy.py), I can pass options to nose by supplying those options after --, eg: $ python

Re: [Numpy-discussion] Option parsing: tox and test-installed-numpy.py

2012-07-08 Thread Nathaniel Smith
On Sun, Jul 8, 2012 at 7:30 PM, Chris Ball s0454...@sms.ed.ac.uk wrote: On Sun, Jul 8, 2012 at 6:52 PM, Nathaniel Smith n...@pobox.com wrote: On Sun, Jul 8, 2012 at 6:44 PM, Chris Ball s0454...@sms.ed.ac.uk wrote: Hi, When calling tools/test-installed-numpy.py (https://github.com/numpy/numpy

[Numpy-discussion] [ANN] Patsy 0.1.0, a python library for statistical formulas

2012-07-10 Thread Nathaniel Smith
[Apologies for cross-posting. Please direct any replies to pyd...@googlegroups.com.] I'm pleased to announce the first release of Patsy, a Python package for describing statistical models and building design matrices using formulas. Patsy's formulas are inspired by and largely compatible with

Re: [Numpy-discussion] Remove current 1.7 branch?

2012-07-12 Thread Nathaniel Smith
On Thu, Jul 12, 2012 at 12:48 PM, Benjamin Root ben.r...@ou.edu wrote: On Thursday, July 12, 2012, Thouis (Ray) Jones wrote: On Thu, Jul 12, 2012 at 1:28 AM, Charles R Harris charlesr.har...@gmail.com wrote: Hi All, Travis and I agree that it would be appropriate to remove the current

Re: [Numpy-discussion] m-ary logical functions

2012-07-12 Thread Nathaniel Smith
On Thu, Jul 12, 2012 at 4:13 PM, Henry Gomersall h...@cantab.net wrote: On Thu, 2012-07-12 at 10:53 -0400, Neal Becker wrote: I've been bitten several times by this. logical_or (a, b, c) is silently accepted when I really meant logical_or (logical_or (a, b), c) because the logic

Re: [Numpy-discussion] m-ary logical functions

2012-07-12 Thread Nathaniel Smith
On Thu, Jul 12, 2012 at 3:53 PM, Neal Becker ndbeck...@gmail.com wrote: I've been bitten several times by this. logical_or (a, b, c) is silently accepted when I really meant logical_or (logical_or (a, b), c) because the logic functions are binary, where I expected them to be m-ary.

Re: [Numpy-discussion] Code Freeze for NumPy 1.7

2012-07-15 Thread Nathaniel Smith
On Sun, Jul 15, 2012 at 1:08 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Sun, Jul 15, 2012 at 12:45 AM, Travis Oliphant tra...@continuum.io wrote: Hey all, We are nearing a code-freeze for NumPy 1.7. Are there any last-minute changes people are wanting to push into NumPy

[Numpy-discussion] ufunc and nditer flags (was Re: Code Freeze for NumPy 1.7)

2012-07-15 Thread Nathaniel Smith
On Sun, Jul 15, 2012 at 6:18 PM, jay bourque jay.bour...@continuum.io wrote: Just added PR #359. The purpose is to allow the nditer object operand and iter flags to be set for a ufunc to provide better control over how an array is iterated over by a ufunc and how the ufunc uses the operands

Re: [Numpy-discussion] Code Freeze for NumPy 1.7

2012-07-16 Thread Nathaniel Smith
On Mon, Jul 16, 2012 at 3:52 AM, Frédéric Bastien no...@nouiz.org wrote: Hi, there is a PR that I think could be merged before the relase: https://github.com/numpy/numpy/pull/326 It is the addition of the inplace_increment function. It seam good, but I can't review it enough as it use many

[Numpy-discussion] py3 datetime woes (was Re: Code Freeze for NumPy 1.7)

2012-07-16 Thread Nathaniel Smith
On Sun, Jul 15, 2012 at 5:32 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Sun, Jul 15, 2012 at 5:57 PM, Nathaniel Smith n...@pobox.com wrote: On Sun, Jul 15, 2012 at 1:08 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Sun, Jul 15, 2012 at 12:45 AM, Travis Oliphant tra

Re: [Numpy-discussion] Proposed change in genfromtxt(..., comments='#', names=True) behaviour

2012-07-16 Thread Nathaniel Smith
On Mon, Jul 16, 2012 at 8:06 PM, Paul Natsuo Kishimoto m...@paul.kishimoto.name wrote: I've implemented this feature with skip_header=-1 as suggested by Pierre, and in doing so removed the regression. TravisBot seems to like it: https://github.com/numpy/numpy/pull/351 Can we please not use

Re: [Numpy-discussion] Proposed change in genfromtxt(..., comments='#', names=True) behaviour

2012-07-16 Thread Nathaniel Smith
On Mon, Jul 16, 2012 at 9:01 PM, Pierre GM pgmdevl...@gmail.com wrote: Well, as `skip_header` is a number of lines, I don't really see anything particular magical about a `skip_header=-1`. The logic here is: - if names=True, then genfromtext expects the names to be given in the first line, and

Re: [Numpy-discussion] Proposed change in genfromtxt(..., comments='#', names=True) behaviour

2012-07-17 Thread Nathaniel Smith
On Mon, Jul 16, 2012 at 10:39 PM, Pierre GM pgmdevl...@gmail.com wrote: I don't really have any deep issue with `skip_header=True`, besides not really liking having an argument whose type can vary. But that's only a matter of personal taste. And yes, we could always check the type… I guess I

Re: [Numpy-discussion] Pull Requests I'm planning to merge

2012-07-17 Thread Nathaniel Smith
On Tue, Jul 17, 2012 at 9:56 PM, Travis Oliphant tra...@continuum.io wrote: I would like to merge the following pull requests sometime today: * 326 -- inplace increment function -1, for the reasons stated in the comment thread -- we shouldn't lock ourselves into an ugly API when there's

Re: [Numpy-discussion] Symbol table not found compiling numpy from git repository on Windows

2012-07-18 Thread Nathaniel Smith
On Wed, Jul 18, 2012 at 11:38 AM, Ondřej Čertík ondrej.cer...@gmail.com wrote: Now things work and start compiling. Any ideas what is going on here? Why is it trying to build the msvcr library? I believe that it's actually trying to link to the msvcr library (which requires first creating some

Re: [Numpy-discussion] Finished maintenance/1.7.x branch

2012-07-18 Thread Nathaniel Smith
On Wed, Jul 18, 2012 at 7:09 AM, Travis Oliphant tra...@continuum.io wrote: Hey all, We are going to work on a beta release on the 1.7.x branch.The master is open again for changes for 1.8.x. There will be some work on the 1.7.x branch to fix bugs including bugs that are already

<    1   2   3   4   5   6   7   8   9   10   >