Re: [Numpy-discussion] can I mapping a np.darray class with a text file instead of reading the file in to mem?

2010-10-04 Thread Sebastian Haase
Hi, if you have 3 cols of 10 000 000 lines, that should add up 30 Mega-numbers. That is 240 MB for double, and 120 MB for single precision. That should not require a 64bit OS. You probably have a problem because reading from text is using extra memory. Can you not convert the file line-by-line

[Numpy-discussion] can I mapping a np.darray class with a text file instead of reading the file in to mem?

2010-10-02 Thread kee chen
Dear All, I have memory problem in reading data from text file to a np.darray. It is because I have low mem on my pc and the data is too big. Te data is stored as 3 cols text and may have 1000 records look like this 0.64984279 0.587856227 0.827348652 0.33463377 0.210916859 0.608797746