We wrestled with exactly this issue for decision trees, so its clear now that a general solution would be very beneficial to scikit-learn.
-----Original Message----- From: Andreas Mueller <[email protected]> Date: Fri, 07 Oct 2011 10:42:17 To: <[email protected]> Reply-To: [email protected] Subject: Re: [Scikit-learn-general] Memory consumption of LinearSVC.fit > However I am pretty sure that it will force a copy of your data to be > double precision (64bit). As you suggested, this is the case for both LinearSVC and SGDClassifier. > If you install cython you can patch the > source code to force single precision instead. > > We might want to add support for single precision for SGDClassifier > and other models in the future although this is not planned yet. > I just wanted to say that we have similar problems in our lab which we "solved" by buying more RAM. It would be great to have single precision implementations of both SGDClassifier and LinearSVC in scikits.learn. ------------------------------------------------------------------------------ All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2dcopy2 _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general ------------------------------------------------------------------------------ All of the data generated in your IT infrastructure is seriously valuable. Why? It contains a definitive record of application performance, security threats, fraudulent activity, and more. Splunk takes this data and makes sense of it. IT sense. And common sense. http://p.sf.net/sfu/splunk-d2dcopy2 _______________________________________________ Scikit-learn-general mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
