I think you'd be interested in DataStream in DataFrames, which is broken at the moment but let's you handle this case if you have NA's.
If you just want to iterate over a file without NA's, we'd need another abstraction. -- John > On Jan 9, 2014, at 6:59 AM, Iain Dunning <[email protected]> wrote: > > So we have readlines, which loads the file all at once into an array of > strings, and eachline, which allows us to iterate through a file line by line. > > We have readcsv/readdlm, but don't have an iterating version (as far as I > know). This is a bit of a problem because it means I have to manually parse > CSV files that are too big to read in all at once, which is error prone (e.g. > quoted delimiter handling). Is there demand for this, and what would it be > called? > > Cheers, > Iain
