Trying to read 30GB file into a DataFrame on a machine with 60GB of RAM. I
get the following error

MemoryError()
while loading In[12], in expression starting on line 1

 in readtable at /home/ubuntu/.julia/v0.3/DataFrames/src/dataframe/io.jl:833
 in readtable at /home/ubuntu/.julia/v0.3/DataFrames/src/dataframe/io.jl:893


noticed in the code, it's allocating doing this:

nbytes = 2 * filesize(pathname)

Is this really necessary?

Reply via email to