On Thu, Dec 29, 2011 at 10:34:16AM -0800, Josh Bleecher Snyder wrote: > If you want to experiment with more options, you might also play with > blosc (http://blosc.pytables.org/trac). The compression level is not > as good as heavier weight algorithms, but it is really zippy. I ended > up using it as my compressor of choice, since I was willing to > sacrifice a bit of disk space in exchange for faster loading.
Yes, this is on my TODO list, but joblib depends only on numpy and the standard library, as it is meant to be installed in hostile environments and _always_ work. That said, at some point, when I find time, I'll code a pytables backend, for my personnal usage, and I'll use hdf5 and blosc. Thanks for the input Gael PS: I had an idea while walking down from work. I may be able to make things a bit faster :), give me a couple of hours. ------------------------------------------------------------------------------ Ridiculously easy VDI. With Citrix VDI-in-a-Box, you don't need a complex infrastructure or vast IT resources to deliver seamless, secure access to virtual desktops. With this all-in-one solution, easily deploy virtual desktops for less than the cost of PCs and save 60% on VDI infrastructure costs. Try it free! http://p.sf.net/sfu/Citrix-VDIinabox _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
