Re: svd( ) implementation

2017-07-29 Thread Imran Younus
on driver's memory, and thats why number of columns of A cannot be be very large. (10k x 10k matrix will close to 1 GB). Once you've R, a local SVD implementation will be needed to to compute SVD of R. Now, this is not a very general method, but I think this is good enough for most of the cases. imran

Re: svd( ) implementation

2017-07-28 Thread Janardhan Pulivarthi
t;> https://github.com/apache/systemml/pull/273/files#diff-488f0 > >> > >> 6e290f7a54db2e125f7bc608971R27 > >> > >> ). > >> > >> The idea there was to build up a distributed SVD using invocations > of > >> > svd > >> > >> on your lo

Re: svd( ) implementation

2017-07-25 Thread Nakul Jindal
nd run the spark primitives needed. >> >> Cons: >> - Implementing SVD, whether in DML or C, is a fair amount of work >> - There would not be a straightforward call to the svd gpu library. In >> fact, each of the linear algebra primitives would be accelerated on the >

Re: svd( ) implementation

2017-07-20 Thread Nakul Jindal
: Pros: - Use of GPU libraries (cuSolver) and CPU libraries (Apache Commons Math) can be made, these are already optimized (in case of the GPU) - If a better SVD implementation is available via a library, that can easily be plugged in. Cons: - Would have to come up with an algorithm to imple