[Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Mark Wiebe
First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the discussion has helped clarify the ideas for me. I've renamed and updated the NEP, then placed it into the master NumPy repository so it has a more permanent home here:

Re: [Numpy-discussion] fast numpy i/o

2011-06-27 Thread Robert Kern
On Tue, Jun 21, 2011 at 13:35, Christopher Barker chris.bar...@noaa.gov wrote: Robert Kern wrote: https://raw.github.com/numpy/numpy/master/doc/neps/npy-format.txt Just a note. From that doc:     HDF5 is a complicated format that more or less implements     a hierarchical

Re: [Numpy-discussion] fast numpy i/o

2011-06-27 Thread Robert Kern
On Mon, Jun 27, 2011 at 11:17, Derek Homeier de...@astro.physik.uni-goettingen.de wrote: On 21.06.2011, at 8:35PM, Christopher Barker wrote: Robert Kern wrote: https://raw.github.com/numpy/numpy/master/doc/neps/npy-format.txt Just a note. From that doc:     HDF5 is a complicated format

Re: [Numpy-discussion] fast numpy i/o

2011-06-27 Thread Derek Homeier
On 27.06.2011, at 6:36PM, Robert Kern wrote: Some late comments on the note (I was a bit surprised that HDF5 installation seems to be a serious hurdle to many - maybe I've just been profiting from the fink build system for OS X here - but I also was not aware that the current netCDF is

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Charles R Harris
On Mon, Jun 27, 2011 at 9:55 AM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the discussion has helped clarify the ideas for me. I've renamed and updated the NEP, then placed

Re: [Numpy-discussion] fast numpy i/o

2011-06-27 Thread Nils Becker
Hi, Finally, the former Scientific.IO NetCDF interface is now part of scipy.io, but I assume it only supports netCDF 3 (the documentation is not specific about that). This might be the easiest option for a portable data format (if Matlab supports it). Yes, it is NetCDF 3. In recent

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Matthew Brett
Hi, On Mon, Jun 27, 2011 at 5:53 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Mon, Jun 27, 2011 at 9:55 AM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread eat
Hi, On Mon, Jun 27, 2011 at 6:55 PM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the discussion has helped clarify the ideas for me. I've renamed and updated the NEP, then

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Mark Wiebe
On Mon, Jun 27, 2011 at 12:44 PM, eat e.antero.ta...@gmail.com wrote: Hi, On Mon, Jun 27, 2011 at 6:55 PM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the discussion has

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread eat
On Mon, Jun 27, 2011 at 8:53 PM, Mark Wiebe mwwi...@gmail.com wrote: On Mon, Jun 27, 2011 at 12:44 PM, eat e.antero.ta...@gmail.com wrote: Hi, On Mon, Jun 27, 2011 at 6:55 PM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing,

[Numpy-discussion] histogram2d error with empty inputs

2011-06-27 Thread Benjamin Root
I found another empty input edge case. Somewhat recently, we fixed an issue with np.histogram() and empty inputs (so long as the bins are somehow known). np.histogram([], bins=4) (array([0, 0, 0, 0]), array([ 0. , 0.25, 0.5 , 0.75, 1. ])) However, histogram2d needs the same treatment.

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread josef . pktd
On Mon, Jun 27, 2011 at 2:24 PM, eat e.antero.ta...@gmail.com wrote: On Mon, Jun 27, 2011 at 8:53 PM, Mark Wiebe mwwi...@gmail.com wrote: On Mon, Jun 27, 2011 at 12:44 PM, eat e.antero.ta...@gmail.com wrote: Hi, On Mon, Jun 27, 2011 at 6:55 PM, Mark Wiebe mwwi...@gmail.com wrote: First

Re: [Numpy-discussion] data type specification when using numpy.genfromtxt

2011-06-27 Thread Chao YUE
Hi Derek! I tried with the lastest version of python(x,y) package with numpy version of 1.6.0. I gave the data to you with reduced columns (10 column) and rows. b=np.genfromtxt('99Burn2003all_new.csv',delimiter=';',names=True,usecols=tuple(range(10)),dtype=['S10'] + [ float for n in range(9)])

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Mark Wiebe
On Mon, Jun 27, 2011 at 2:59 PM, josef.p...@gmail.com wrote: On Mon, Jun 27, 2011 at 2:24 PM, eat e.antero.ta...@gmail.com wrote: On Mon, Jun 27, 2011 at 8:53 PM, Mark Wiebe mwwi...@gmail.com wrote: On Mon, Jun 27, 2011 at 12:44 PM, eat e.antero.ta...@gmail.com wrote: Hi, On

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Mark Wiebe
On Mon, Jun 27, 2011 at 12:18 PM, Matthew Brett matthew.br...@gmail.comwrote: Hi, On Mon, Jun 27, 2011 at 5:53 PM, Charles R Harris charlesr.har...@gmail.com wrote: On Mon, Jun 27, 2011 at 9:55 AM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread josef . pktd
On Mon, Jun 27, 2011 at 5:01 PM, Mark Wiebe mwwi...@gmail.com wrote: On Mon, Jun 27, 2011 at 2:59 PM, josef.p...@gmail.com wrote: On Mon, Jun 27, 2011 at 2:24 PM, eat e.antero.ta...@gmail.com wrote: On Mon, Jun 27, 2011 at 8:53 PM, Mark Wiebe mwwi...@gmail.com wrote: On Mon, Jun 27,

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Pierre GM
On Jun 27, 2011, at 9:59 PM, josef.p...@gmail.com wrote: Just a question how things would work with the new model. How can you implement the use keyword from R's cov (or cor), with minimal data copying I think the basic masked array version would (or does) just assign 0 to the missing

Re: [Numpy-discussion] missing data discussion round 2

2011-06-27 Thread Mark Wiebe
On Mon, Jun 27, 2011 at 7:07 PM, Keith Goodman kwgood...@gmail.com wrote: On Mon, Jun 27, 2011 at 8:55 AM, Mark Wiebe mwwi...@gmail.com wrote: First I'd like to thank everyone for all the feedback you're providing, clearly this is an important topic to many people, and the discussion has

[Numpy-discussion] Recommndations for an easy GUI

2011-06-27 Thread Nadav Horesh
I have an application which generates and displays RGB images as rate of several frames/seconds (5-15). Currently I use Tkinter+PIL, but I have a problem that it slows down the rate significantly. I am looking for a fast and easy alternative. Platform: Linux I prefer tools that would work also

Re: [Numpy-discussion] Recommndations for an easy GUI

2011-06-27 Thread Benjamin Root
On Monday, June 27, 2011, Nadav Horesh nad...@visionsense.com wrote: I have an application which generates and displays RGB images as rate of several frames/seconds (5-15). Currently I use Tkinter+PIL, but I have a problem that it slows down the rate significantly. I am looking for a