[Numpy-discussion] how to loop read input over various file with same extension in a folder (newbie question)

2011-03-24 Thread Sachin Kumar Sharma
BB, Currently I am reading a text file and storing the output as an array a1, some arithmetic operation on it and plotting it. I want to do the same over 1000 files. How to loop it and how to store the input in different arrays like a2, a3 and so on. Also advise what is the best way to TAG or

[Numpy-discussion] how to delete a particular column or row from numpy array based on some rule or value

2011-03-24 Thread Sachin Kumar Sharma
BB, In a numpy array of m x n size, I would like to delete few rows when a given element in that row is 'nan' or say any other value. For e.g. as in example given below, if I wish to delete a row when the 3rd element of row is zero, or if 3rd, 4th, 5th element are zero or either of 3rd, 4th

Re: [Numpy-discussion] how to loop read input over various file with same extension in a folder (newbie question)

2011-03-24 Thread Paul Anton Letnes
One way is to use python dicts. Pseudocode: arrays = {} integer = 0 for file in allfiles: integer +=1 data = file.read() arrays['a' + '%d' % integer] = data I would consider using the filename as the key instead of a1, a2, etc. That way you have that information readily

Re: [Numpy-discussion] how to loop read input over various file with same extension in a folder (newbie question)

2011-03-24 Thread Sachin Kumar Sharma
Paul, Appreciate your reply. Cheers Sachin Sachin Kumar Sharma Senior Geomodeler -Original Message- From: numpy-discussion-boun...@scipy.org [mailto:numpy-discussion-boun...@scipy.org] On Behalf Of Paul Anton

Re: [Numpy-discussion] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Pearu Peterson
On Thu, Mar 24, 2011 at 2:04 AM, Derek Homeier de...@astro.physik.uni-goettingen.de wrote: On 24 Mar 2011, at 00:34, Derek Homeier wrote: tests with the fink-installed pythons on MacOS X mostly succeeded, with one failure in python2.4 and a couple of issues seemingly related to PPC

Re: [Numpy-discussion] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Pearu Peterson
On Thu, Mar 24, 2011 at 10:11 AM, Pearu Peterson pearu.peter...@gmail.comwrote: Regarding this test failure, could you hack the numpy/f2py/tests/test_kind.py script by adding the following code for i in range(20): print '%s - %s, %s' % (i, selected_real_kind(i), selectedrealkind(i)) and

Re: [Numpy-discussion] how to delete a particular column or row from numpy array based on some rule or value

2011-03-24 Thread dileep kunjaai
On Thu, Mar 24, 2011 at 1:12 PM, Sachin Kumar Sharma ssharm...@slb.comwrote: BB, In a numpy array of m x n size, I would like to delete few rows when a given element in that row is ‘nan’ or say any other value. For e.g. as in example given below, if I wish to delete a row when the 3

[Numpy-discussion] when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs

2011-03-24 Thread Dmitrey
hi, when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs I tried to install numpy from PYPI where 1.5.1 seesm to be present, but somehow it involves 1.3.0 instead: $ sudo easy_install numpy install_dir /usr/local/lib/python2.6/dist-packages/ Searching

[Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Dmitrey
from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing computations and making text output completely non-readable. from numpy import

Re: [Numpy-discussion] when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs

2011-03-24 Thread Mic J
Isnt [K]Ubuntu updated each 6 month? 2011/3/24 Dmitrey tm...@ukr.net: hi, when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs There will always be bugs, but numpy 1.3 is a stable release, unless there is a bug that affects what your doing right now? If you find a bug

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread eat
Hi 2011/3/24 Dmitrey tm...@ukr.net from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing computations and making text output completely non-readable.

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Dmitrey
Hi 2011/3/24 Dmitrey tm...@ukr.net from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing

Re: [Numpy-discussion] when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs

2011-03-24 Thread Dmitrey
Isnt [K]Ubuntu updated each 6 month? 2011/3/24 Dmitrey tm...@ukr.net : hi, when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs There will always be bugs, but numpy 1.3 is a stable release, unless there is a bug

Re: [Numpy-discussion] [NumPy-Tickets] [NumPy] #971: numpy.memmap 'offset' parameter docs are almost entirely wrong.

2011-03-24 Thread Sebastian Haase
Hi, I got an Internal Error message when trying to log into the Trac page. My comment: Could there at least be a note added to the current memmap doc string, stating that there is a problem with the current doc; also a link to http://projects.scipy.org/numpy/ticket/97 would be much better than

[Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Dmitrey
hi, is there any way to get argmin and argmax of an array w/o nans? Currently I have from numpy import * argmax([10,nan,100]) 1 argmin([10,nan,100]) 1 But it's not the values I would like to get. The walkaround I use: get all indeces of nans, replace them by -inf,

Re: [Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Ralf Gommers
2011/3/24 Dmitrey tm...@ukr.net: hi, is there any way to get argmin and argmax of an array w/o nans? Currently I have from numpy import * argmax([10,nan,100]) 1 argmin([10,nan,100]) 1 But it's not the values I would like to get. The walkaround I use: get all indeces of nans, replace

Re: [Numpy-discussion] when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs

2011-03-24 Thread Mic J
Thanks for all those instructions, however, personally I don't need them, I have sucseeded with my own manipulations and even if I wouldn't I always can build numpy/scipy from sources. I mere care for quality and easibility of numpy installation for ordinary non-skilled users. They may just

Re: [Numpy-discussion] [NumPy-Tickets] [NumPy] #971: numpy.memmap 'offset' parameter docs are almost entirely wrong.

2011-03-24 Thread Ralf Gommers
On Thu, Mar 24, 2011 at 12:38 PM, Sebastian Haase seb.ha...@gmail.com wrote: Hi, I got an Internal Error message when trying to log into the Trac page. That happens a lot, the solution is just to retry. My comment: Could there at least be a note added to the current memmap doc string,

Re: [Numpy-discussion] how to delete a particular column or row from numpy array based on some rule or value

2011-03-24 Thread Derek Homeier
In a numpy array of m x n size, I would like to delete few rows when a given element in that row is ‘nan’ or say any other value. For e.g. as in example given below, if I wish to delete a row when the 3rd element of row is zero, or if 3rd, 4th, 5th element are zero or either of 3rd,

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Ralf Gommers
2011/3/24 Dmitrey tm...@ukr.net: Hi 2011/3/24 Dmitrey tm...@ukr.net from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing computations and making text

Re: [Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Keith Goodman
On Thu, Mar 24, 2011 at 6:19 AM, Ralf Gommers ralf.gomm...@googlemail.com wrote: 2011/3/24 Dmitrey tm...@ukr.net: hi, is there any way to get argmin and argmax of an array w/o nans? Currently I have from numpy import * argmax([10,nan,100]) 1 argmin([10,nan,100]) 1 But it's not the values

Re: [Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Dmitrey
2011/3/24 Dmitrey tm...@ukr.net : hi, is there any way to get argmin and argmax of an array w/o nans? Currently I have from numpy import * argmax([10,nan,100]) 1 argmin([10,nan,100]) 1 But it's not the values I would like

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Skipper Seabold
On Thu, Mar 24, 2011 at 9:45 AM, Ralf Gommers ralf.gomm...@googlemail.com wrote: 2011/3/24 Dmitrey tm...@ukr.net: Hi 2011/3/24 Dmitrey tm...@ukr.net from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread eat
Hi On Thu, Mar 24, 2011 at 4:17 PM, Skipper Seabold jsseab...@gmail.comwrote: On Thu, Mar 24, 2011 at 9:45 AM, Ralf Gommers ralf.gomm...@googlemail.com wrote: 2011/3/24 Dmitrey tm...@ukr.net: Hi 2011/3/24 Dmitrey tm...@ukr.net from numpy import inf, array inf*0 nan (ok)

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Skipper Seabold
On Thu, Mar 24, 2011 at 10:52 AM, eat e.antero.ta...@gmail.com wrote: Hi On Thu, Mar 24, 2011 at 4:17 PM, Skipper Seabold jsseab...@gmail.com snip Also, as Robert pointed out to me before np.errstate is a context-manager for ignoring these warnings. I often wrap optimization code with it.

Re: [Numpy-discussion] [SciPy-Dev] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Ralf Gommers
On Wed, Mar 23, 2011 at 9:29 PM, Ralf Gommers ralf.gomm...@googlemail.com wrote: On Wed, Mar 23, 2011 at 8:32 PM, Pauli Virtanen p...@iki.fi wrote: On Wed, 23 Mar 2011 14:17:20 -0500, Bruce Southey wrote: I can not figure out what is different between git and this version :-( All the paths

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Robert Kern
2011/3/24 Dmitrey tm...@ukr.net: from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing computations and making text output completely non-readable. from numpy

Re: [Numpy-discussion] should get rid of the annoying numpy STDERR output

2011-03-24 Thread Ralf Gommers
On Thu, Mar 24, 2011 at 5:11 PM, Robert Kern robert.k...@gmail.com wrote: 2011/3/24 Dmitrey tm...@ukr.net: from numpy import inf, array inf*0 nan (ok) array(inf) * 0.0 StdErr: Warning: invalid value encountered in multiply nan My cycled calculations yields this thousands times slowing

Re: [Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Dmitrey
On Thu, Mar 24, 2011 at 6:19 AM, Ralf Gommers ralf.gomm...@googlemail.com wrote: 2011/3/24 Dmitrey tm...@ukr.net : hi, is there any way to get argmin and argmax of an array w/o nans? Currently I have from numpy import *

Re: [Numpy-discussion] argmin and argmax without nan

2011-03-24 Thread Robert Kern
2011/3/24 Dmitrey tm...@ukr.net: Are there any plans for merging bottleneck into numpy? No plans, but no particular opposition. bottleneck is a good place to experiment with these optimizations. When they settle, it might be worth folding them back in. Also, are those benchmarks valid for

[Numpy-discussion] Partial least squares

2011-03-24 Thread Nadav Horesh
I am looking for a partial least sqaures code refactoring for two (X,Y) matrices. I found the following, but they not not work for me: 1. MDP: Factors only one matrix (am I wrong?) 2. pychem: Windows only code (I use Linux) 3. chemometrics from Koders: I get a singularity error. 4. pca_module (By

Re: [Numpy-discussion] Partial least squares

2011-03-24 Thread Olivier Grisel
2011/3/24 Nadav Horesh nad...@visionsense.com: I am looking for a partial least sqaures code refactoring for two (X,Y) matrices. I found the following, but they not not work for me: 1. MDP: Factors only one matrix (am I wrong?) 2. pychem: Windows only code (I use Linux) 3. chemometrics from

Re: [Numpy-discussion] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Ralf Gommers
On Thu, Mar 24, 2011 at 12:34 AM, Derek Homeier de...@astro.physik.uni-goettingen.de wrote: Hi again, On 23 Mar 2011, at 17:07, Ralf Gommers wrote: I am pleased to announce the availability of the first beta of NumPy 1.6.0. Due to the extensive changes in the Numpy core for this release,

Re: [Numpy-discussion] when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs

2011-03-24 Thread sam tygier
On 24/03/11 10:00, Dmitrey wrote: hi, when numpy in Linux apt will be updated? It's still 1.3.0 with many bugs I have Linux KUBUNTU 10.10 D. (k)ubuntu 11.04 (to be released in april) will have at numpy 1.5.1 (or possible newer) https://launchpad.net/ubuntu/+source/python-numpy also scipy

Re: [Numpy-discussion] Partial least squares

2011-03-24 Thread Gael Varoquaux
On Thu, Mar 24, 2011 at 12:06:56PM -0700, Nadav Horesh wrote: I am looking for a partial least sqaures code refactoring for two (X,Y) matrices. I found the following, but they not not work for me: We have had a PLS code contributed in the scikits learn very recently:

Re: [Numpy-discussion] Partial least squares

2011-03-24 Thread Gael Varoquaux
On Thu, Mar 24, 2011 at 08:15:12PM +0100, Olivier Grisel wrote: 2011/3/24 Nadav Horesh nad...@visionsense.com: I am looking for a partial least sqaures code refactoring for two (X,Y) matrices. I found the following, but they not not work for me: 1. MDP: Factors only one matrix (am I wrong?)

Re: [Numpy-discussion] Partial least squares

2011-03-24 Thread Nadav Horesh
Yes, he is. I'll work on it early next week, and post any comment I'll have. Documentation quality: The code doc refer to an excellent reference [Wegelin et al. 2000], so no real problem here. If the reference is critical I would suggest on of the following: 1. Put a link to the document. 2. Is

[Numpy-discussion] Question about repeated values in X in A[X] = Y

2011-03-24 Thread Thouis (Ray) Jones
I have done some work on scipy.ndimage.measurements, and was adding to it recently when I noticed I had made use of the idiom A[X] = Y with repeated indices in X, relying on the behavior that the last X,Y pair at each unique X is the one that is assigned in A (last = last by position in X). I

Re: [Numpy-discussion] Partial least squares

2011-03-24 Thread Gael Varoquaux
On Thu, Mar 24, 2011 at 01:57:46PM -0700, Nadav Horesh wrote: The code doc refer to an excellent reference [Wegelin et al. 2000], so no real problem here. If the reference is critical I would suggest on of the following: 1. Put a link to the document. Do you have one? I'd be happy to add

Re: [Numpy-discussion] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Derek Homeier
On 24.03.2011, at 9:11AM, Pearu Peterson wrote: Intel-64bit: ERROR: test_assumed_shape.TestAssumedShapeSumExample.test_all -- Traceback (most recent call last): File /sw/lib/python3.2/site-packages/nose/case.py, line 372,

[Numpy-discussion] Ticket closing policy

2011-03-24 Thread David
Hi Mark, hi all, I noticed you did a lot of cleaning in the bug trackers, thank you for helping there, this is sorely needed. However, I noticed quite a few tickets were closed as wontfix even though they are valid. I understand the concern of getting many languishing tickets, but one should

Re: [Numpy-discussion] ANN: Numpy 1.6.0 beta 1

2011-03-24 Thread Pearu Peterson
On Fri, Mar 25, 2011 at 1:44 AM, Derek Homeier de...@astro.physik.uni-goettingen.de wrote: On 24.03.2011, at 9:11AM, Pearu Peterson wrote: Intel-64bit: ERROR: test_assumed_shape.TestAssumedShapeSumExample.test_all --