Probably most effective to open an issue on the DataFrames package. On Thu, Apr 16, 2015 at 1:10 PM, Arshak Navruzyan <[email protected]> wrote:
> Trying to read 30GB file into a DataFrame on a machine with 60GB of RAM. I > get the following error > > MemoryError() > while loading In[12], in expression starting on line 1 > > in readtable at /home/ubuntu/.julia/v0.3/DataFrames/src/dataframe/io.jl:833 > in readtable at /home/ubuntu/.julia/v0.3/DataFrames/src/dataframe/io.jl:893 > > > noticed in the code, it's allocating doing this: > > nbytes = 2 * filesize(pathname) > > Is this really necessary? >
