> Er, it looks like safe_sparse_dot() returns sparse unless dense_output=True. > And, I'm confused as to how this would result in more memory. Aren't we > allocating more in the lines above for the issparse(X) case? I'm stick right > now because my 40k x 220k CSR matrix can't make it past computing the > reconstruction_err without a MemoryError--with 200GB or RAM free. Any ideas > of how to reduce memory constraints of that calculation?
the reconstruction_err code should allocate in a dense matrix of size n_samples x n_components. But if you use safe_sparse_dot, as W and H are dense, you will allocate a dense matrix of size n_samples x n_features otherwise I messed up Alex ------------------------------------------------------------------------------ Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more! Discover the easy way to master current and previous Microsoft technologies and advance your career. Get an incredible 1,500+ hours of step-by-step tutorial videos with LearnDevNow. Subscribe today and save! http://pubads.g.doubleclick.net/gampad/clk?id=58040911&iu=/4140/ostg.clktrk _______________________________________________ Scikit-learn-general mailing list Scikit-learn-general@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/scikit-learn-general
