On 01/23/2012 06:14 PM, Mathieu Blondel wrote: > We need a dump utility to incrementally append data to a mem-mapped > array or csr matrix. This way, people would be able to do their > feature extraction in an iterator and create the array / matrix > incrementally. > > Mathieu >
I will implement a couple of functions do something similar, I think. But the best approach for covering seamlessly case of both low scale and hight scale it seems to be the PyTables EArray, which maps the Numpy Array on the Disk. In addition PyTables handles the memory-to-disk and disk-to-memory procedures. So I will do something related to that and send it here in this list. I hope this will help. I hope I understood what you just said. > ------------------------------------------------------------------------------ > Try before you buy = See our experts in action! > The most comprehensive online learning library for Microsoft developers > is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, > Metro Style Apps, more. Free future releases when you subscribe now! > http://p.sf.net/sfu/learndevnow-dev2 > _______________________________________________ > Scikit-learn-general mailing list > [email protected] > https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ Try before you buy = See our experts in action! The most comprehensive online learning library for Microsoft developers is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3, Metro Style Apps, more. Free future releases when you subscribe now! http://p.sf.net/sfu/learndevnow-dev2 _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
