Awesome - thanks guys!
@Gael: I'll look into the single file storage and submit a PR
2014-02-02 Olivier Grisel <olivier.gri...@ensta.org>:
> I recently contributed a fix to numpy master (to be part of numpy
> 1.9.0) to use nditer API to stream buffers to non-'file' file object:
>
> https://github.com/numpy/numpy/pull/4077
>
> That should make it possible to refactor joblib to stream pickled data
> to GzipFile instances or use the zlib.compressobj API to do to a
> single file compressed joblib.dump without memory copy.
>
> I had ongoing work to fix that issue tracked by
> https://github.com/joblib/joblib/issues/66 . But I had to stop to work
> on getting the threading backend in sklearn first. I plan to resume
> working on joblib/joblib#66 soonish (after Strata and the sklearn 0.15
> release).
>
> There is also this PR that is probably related (although I have not
> reviewed yet in details yet):
>
> https://github.com/joblib/joblib/pull/115
>
> --
> Olivier
>
>
> ------------------------------------------------------------------------------
> WatchGuard Dimension instantly turns raw network data into actionable
> security intelligence. It gives you real-time visual feedback on key
> security issues and trends. Skip the complicated setup - simply import
> a virtual appliance and go from zero to informed in seconds.
>
> http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk
> _______________________________________________
> Scikit-learn-general mailing list
> Scikit-learn-general@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
>
--
Peter Prettenhofer
------------------------------------------------------------------------------
WatchGuard Dimension instantly turns raw network data into actionable
security intelligence. It gives you real-time visual feedback on key
security issues and trends. Skip the complicated setup - simply import
a virtual appliance and go from zero to informed in seconds.
http://pubads.g.doubleclick.net/gampad/clk?id=123612991&iu=/4140/ostg.clktrk
_______________________________________________
Scikit-learn-general mailing list
Scikit-learn-general@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
