Re: [Numpy-discussion] Huge arrays

2009-09-11 Thread Chad Netzer
On Tue, Sep 8, 2009 at 6:41 PM, Charles R Harris charlesr.har...@gmail.com wrote: More precisely, 2GB for windows and 3GB for (non-PAE enabled) linux. And just to further clarify, even with PAE enabled on linux, any individual process has about a 3 GB address limit (there are hacks to raise

[Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread V. Armando Solé
Hello, I have found performance problems under windows when using python 2.6 In my case, they seem to be related to the dot product. The following simple script: import numpy import time a=numpy.arange(100.) a.shape=1000,1000 t0=time.time() b=numpy.dot(a.T,a) print Elapsed time =

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread David Cournapeau
V. Armando Solé wrote: Hello, I have found performance problems under windows when using python 2.6 In my case, they seem to be related to the dot product. The following simple script: import numpy import time a=numpy.arange(100.) a.shape=1000,1000 t0=time.time()

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread V. Armando Solé
David Cournapeau wrote: V. Armando Solé wrote: Hello, I have found performance problems under windows when using python 2.6 In my case, they seem to be related to the dot product. The following simple script: import numpy import time a=numpy.arange(100.) a.shape=1000,1000

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread V. Armando Solé
Hello, It seems to point towards a packaging problem. In python 2.5, I can do: import numpy.core._dotblas as dotblas dotblas.__file__ and I get: C:\\Python25\\lib\\site-packages\\numpy\\core\\_dotblas.pyd In python 2.6: import numpy.core._dotblas as dotblas ... ImportError: No module named

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread Sturla Molden
V. Armando Solé skrev: import numpy import time a=numpy.arange(100.) a.shape=1000,1000 t0=time.time() b=numpy.dot(a.T,a) print Elapsed time = ,time.time()-t0 reports an Elapsed time of 1.4 seconds under python 2.5 and 15 seconds under python 2.6 My computer reports 0.34 seconds

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread David Cournapeau
V. Armando Solé wrote: Hello, It seems to point towards a packaging problem. In python 2.5, I can do: import numpy.core._dotblas as dotblas dotblas.__file__ and I get: C:\\Python25\\lib\\site-packages\\numpy\\core\\_dotblas.pyd That's where the error lies: if you install with

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread Sturla Molden
V. Armando Solé skrev: In python 2.6: import numpy.core._dotblas as dotblas ... ImportError: No module named _dotblas import numpy.core._dotblas as dotblas dotblas.__file__ 'C:\\Python26\\lib\\site-packages\\numpy\\core\\_dotblas.pyd'

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread V. Armando Solé
Sturla Molden wrote: V. Armando Solé skrev: In python 2.6: import numpy.core._dotblas as dotblas ... ImportError: No module named _dotblas import numpy.core._dotblas as dotblas dotblas.__file__ 'C:\\Python26\\lib\\site-packages\\numpy\\core\\_dotblas.pyd' That's

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread V. Armando Solé
David Cournapeau wrote: V. Armando Solé wrote: Hello, It seems to point towards a packaging problem. In python 2.5, I can do: import numpy.core._dotblas as dotblas dotblas.__file__ and I get: C:\\Python25\\lib\\site-packages\\numpy\\core\\_dotblas.pyd That's where the

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread David Cournapeau
V. Armando Solé wrote: David Cournapeau wrote: V. Armando Solé wrote: Hello, It seems to point towards a packaging problem. In python 2.5, I can do: import numpy.core._dotblas as dotblas dotblas.__file__ and I get:

Re: [Numpy-discussion] Dot product performance on python 2.6 (windows)

2009-09-11 Thread josef . pktd
On Fri, Sep 11, 2009 at 5:25 AM, David Cournapeau da...@ar.media.kyoto-u.ac.jp wrote: V. Armando Solé wrote: David Cournapeau wrote: V. Armando Solé wrote: Hello, It seems to point towards a packaging problem. In python 2.5, I can do: import numpy.core._dotblas as dotblas

[Numpy-discussion] Speed of class derived from float64

2009-09-11 Thread Romain Brette
Hi, In our project we define a class derived from numpy.float64 (and we add units) and I noticed that instance creation was very slow. I found out that creating a float64 object is fast, but creating an object from the derived class is almost 10 times slower, even if that class doesn't do

[Numpy-discussion] numpy on OSX 10.6 issues

2009-09-11 Thread Christopher Hanley
Hi, I'm looking for some help getting the svn trunk numpy working on Max OS X 10.6. I've installed my own version of Python 2.6 from python.org. I've got the following flags set: setenv MACOSX_DEPLOYMENT_TARGET 10.6 setenv CFLAGS -arch i386 -arch x86_64 setenv FFLAGS -arch i386 -arch x86_64

Re: [Numpy-discussion] iteration slowing, no increase in memory

2009-09-11 Thread Hans Meine
On Thursday 10 September 2009 19:03:20 John [H2O] wrote: I have a routine that is iterating through a series of directories, loading files, plotting, then moving on... It runs very well for the first few iterations, but then slows tremendously Maybe you collect some data into growing data

[Numpy-discussion] searchsorted for exact matches, not preserving order

2009-09-11 Thread Andrew Jaffe
Dear all, I've got two (integer) arrays, and I want to find the indices in the first one that have entries in the second. I.E. I want all idx s.t. there exists a j with a[idx]=b[j]. Here is my current implementation (with a = pixnums, b=surveypix) import numpy as np def matchPix(pixnums,

Re: [Numpy-discussion] searchsorted for exact matches, not preserving order

2009-09-11 Thread Robert Kern
On Fri, Sep 11, 2009 at 10:24, Andrew Jaffea.h.ja...@gmail.com wrote: Dear all, I've got two (integer) arrays, and I want to find the indices in the first one that have entries in the second. I.E. I want all idx s.t. there exists a j with a[idx]=b[j]. Here is my current implementation (with

Re: [Numpy-discussion] iteration slowing, no increase in memory

2009-09-11 Thread Fernando Perez
On Thu, Sep 10, 2009 at 10:03 AM, John [H2O]washa...@gmail.com wrote: I have a routine that is iterating through a series of directories, loading files, plotting, then moving on... It runs very well for the first few iterations, but then slows tremendously You mention plotting. I'd suggest

[Numpy-discussion] Scientific Computing with Python, September 18, 2009

2009-09-11 Thread Amenity Applewhite
(HTML version of email) Greetings! September is well upon us and it looks like it's already time for another Scientific Computing with Python webinar. Next week, Travis Oliphant will be hosting a presentation on regression analysis in NumPy and SciPy. As you are probably aware, Travis

[Numpy-discussion] Ticket 1216

2009-09-11 Thread Nils Wagner
Hi all, Ticket http://projects.scipy.org/numpy/ticket/1216 can be closed. Cheers, Nils ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

[Numpy-discussion] 64-bit Fedora 9 a=numpy.zeros(0x80000000, dtype='b1')

2009-09-11 Thread Sebastian
Hello, The folks at stsci (Jim T.) are not able to reproduce this error with 1.4.0.dev7362 so I guess there is something wrong with my numpy installation. I also tried '1.4.0.dev7362' and numpy1.3 (stable) but alas, the same error! My system: [r...@siate numpy]# uname -a Linux

Re: [Numpy-discussion] searchsorted for exact matches, not preserving order

2009-09-11 Thread Andrew Jaffe
On 11/09/2009 08:33, Robert Kern wrote: On Fri, Sep 11, 2009 at 10:24, Andrew Jaffea.h.ja...@gmail.com wrote: Dear all, I've got two (integer) arrays, and I want to find the indices in the first one that have entries in the second. I.E. I want all idx s.t. there exists a j with a[idx]=b[j].

Re: [Numpy-discussion] searchsorted for exact matches, not preserving order

2009-09-11 Thread Robert Kern
On Fri, Sep 11, 2009 at 15:46, Andrew Jaffea.h.ja...@gmail.com wrote: On 11/09/2009 08:33, Robert Kern wrote: On Fri, Sep 11, 2009 at 10:24, Andrew Jaffea.h.ja...@gmail.com  wrote: Dear all, I've got two (integer) arrays, and I want to find the indices in the first one that have entries in

Re: [Numpy-discussion] iteration slowing, no increase in memory

2009-09-11 Thread Robert Kern
On Thu, Sep 10, 2009 at 14:39, David Warde-Farleyd...@cs.toronto.edu wrote: On 10-Sep-09, at 1:09 PM, Robert Kern wrote: One thing you can do to verify this is to change the order of iteration. You will also want to profile your code. Then you can see what is taking up so much time.  

Re: [Numpy-discussion] Scientific Computing with Python, September 18, 2009

2009-09-11 Thread Neal Becker
I'd love to participate in these webinars. Problem is, AFAICT, gotomeeting only supports windows. ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailman/listinfo/numpy-discussion

Re: [Numpy-discussion] Scientific Computing with Python, September 18, 2009

2009-09-11 Thread Robert Ferrell
On Sep 11, 2009, at 5:07 PM, Neal Becker wrote: I'd love to participate in these webinars. Problem is, AFAICT, gotomeeting only supports windows. I'm not certain that is correct. I've participated in some of these, and Im' running OS X (10.5). I think those were gotomeeting, although