Re: [Numpy-discussion] Suggestions for GSoC Projects

2014-02-04 Thread Ralf Gommers
On Fri, Jan 31, 2014 at 11:34 AM, Stéfan van der Walt ste...@sun.ac.zawrote: On Fri, 31 Jan 2014 04:31:01 +0530, jennifer stone wrote: 3. As stated earlier, we have spherical harmonic functions (with much scope for dev) we are yet to have elliptical and cylindrical harmonic function,

Re: [Numpy-discussion] Suggestions for GSoC Projects

2014-02-04 Thread Ralf Gommers
On Fri, Jan 31, 2014 at 12:01 AM, jennifer stone jenny.stone...@gmail.comwrote: With GSoC 2014 being round the corner, I hereby put up few projects for discussion that I would love to pursue as a student. Guidance, suggestions are cordially welcome:- 1. If I am not mistaken, contour

Re: [Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread Daniele Nicolodi
On 04/02/2014 16:01, RayS wrote: I was struggling with methods of reading large disk files into numpy efficiently (not FITS or .npy, just raw files of IEEE floats from numpy.tostring()). When loading arbitrarily large files it would be nice to not bother reading more than the plot can display

[Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread RayS
I was struggling with methods of reading large disk files into numpy efficiently (not FITS or .npy, just raw files of IEEE floats from numpy.tostring()). When loading arbitrarily large files it would be nice to not bother reading more than the plot can display before zooming in. There

Re: [Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread RayS
At 07:09 AM 2/4/2014, you wrote: On 04/02/2014 16:01, RayS wrote: I was struggling with methods of reading large disk files into numpy efficiently (not FITS or .npy, just raw files of IEEE floats from numpy.tostring()). When loading arbitrarily large files it would be nice to not bother

Re: [Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread Julian Taylor
On Tue, Feb 4, 2014 at 4:27 PM, RayS r...@blue-cove.com wrote: At 07:09 AM 2/4/2014, you wrote: On 04/02/2014 16:01, RayS wrote: I was struggling with methods of reading large disk files into numpy efficiently (not FITS or .npy, just raw files of IEEE floats from numpy.tostring()).

Re: [Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread RayS
At 07:35 AM 2/4/2014, Julian Taylor wrote: On Tue, Feb 4, 2014 at 4:27 PM, RayS mailto:r...@blue-cove.comr...@blue-cove.com wrote: At 07:09 AM 2/4/2014, you wrote: On 04/02/2014 16:01, RayS wrote: I was struggling with methods of reading large disk files into numpy efficiently (not FITS or

Re: [Numpy-discussion] Memory leak?

2014-02-04 Thread Chris Laumann
Hi all- Thanks for the info re: memory leak. In trying to work around it, I think I’ve discovered another (still using SuperPack). This leaks ~30MB / run: hists = zeros((50,64), dtype=int) for i in range(50):     for j in range(2**13):         hists[i,j%64] += 1 The code leaks using hists[i,j]

Re: [Numpy-discussion] Suggestions for GSoC Projects

2014-02-04 Thread jennifer stone
3. As stated earlier, we have spherical harmonic functions (with much scope for dev) we are yet to have elliptical and cylindrical harmonic function, which may be developed. This sounds very doable. How much work do you think would be involved? As Stefan so rightly pointed out, the

Re: [Numpy-discussion] Memory leak?

2014-02-04 Thread Julian Taylor
On 04.02.2014 18:26, Chris Laumann wrote: Hi all- Thanks for the info re: memory leak. In trying to work around it, I think I’ve discovered another (still using SuperPack). This leaks ~30MB / run: hists = zeros((50,64), dtype=int) for i in range(50): for j in range(2**13):

Re: [Numpy-discussion] Suggestions for GSoC Projects

2014-02-04 Thread jennifer stone
On Fri, Jan 31, 2014 at 11:34 AM, Stéfan van der Walt ste...@sun.ac.zawrote: On Fri, 31 Jan 2014 04:31:01 +0530, jennifer stone wrote: 3. As stated earlier, we have spherical harmonic functions (with much scope for dev) we are yet to have elliptical and cylindrical harmonic function,

Re: [Numpy-discussion] striding through arbitrarily large files

2014-02-04 Thread Sturla Molden
RayS r...@blue-cove.com wrote: Thanks Daniele, I'll be trying mmap with Python64. With 32 bit the mmap method throws MemoryError with 2.5GB files... The idea is that we allow the users to inspect the huge files graphically, then they can zoom into regions of interest and then load a ~100

[Numpy-discussion] ANN: Bokeh 0.4 Release

2014-02-04 Thread Bryan Van de Ven
I am pleased to announce the release of Bokeh version 0.4! Bokeh is a Python library for visualizing large and realtime datasets on the web. Its goal is to provide elegant, concise construction of novel graphics in the style of Protovis/D3, while delivering high-performance interactivity to