Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Wes McKinney
On Monday, October 1, 2012, Chris Barker wrote: Paul, Nice to see someone working on these issues, but: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. But if you do want to improve that, it may be better

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 3. okt. 2012, at 17:48, Wes McKinney wrote: On Monday, October 1, 2012, Chris Barker wrote: Paul, Nice to see someone working on these issues, but: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead.

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 1. okt. 2012, at 21:07, Chris Barker wrote: Paul, Nice to see someone working on these issues, but: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. Oh, there's significant overhead, since we're not

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Chris Barker
On Wed, Oct 3, 2012 at 9:05 AM, Paul Anton Letnes paul.anton.let...@gmail.com wrote: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. Oh, there's significant overhead, since we're not talking of a list - we're

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 3. okt. 2012, at 18:22, Chris Barker wrote: On Wed, Oct 3, 2012 at 9:05 AM, Paul Anton Letnes paul.anton.let...@gmail.com wrote: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. Oh, there's significant

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-01 Thread Chris Barker
Paul, Nice to see someone working on these issues, but: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. But if you do want to improve that, it may be better to change the accumulating method, rather than doing

Re: [Numpy-discussion] memory-efficient loadtxt

2012-09-30 Thread Paul Anton Letnes
For convenience and clarity, this is the diff in question: https://github.com/Dynetrekk/numpy-1/commit/5bde67531a2005ef80a2690a75c65cebf97c9e00 And this is my numpy fork: https://github.com/Dynetrekk/numpy-1/ Paul On Sun, Sep 30, 2012 at 4:14 PM, Paul Anton Letnes paul.anton.let...@gmail.com