Re: matrix inversion in plan ?

2015-10-08 Thread go canal
Unfortunately I do not know much details of these. The steps of these calculation is passed to me from a research team. I am helping them with coding part only. I myself is not good at math :-(  btw,  I think Mahout supports out-of-core SVD, am I correct ? If so, I can get inverse of matrix

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Go, if you'd like to put your research team in touch with the list we may be able to help work through a good approach; let us know. On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote: > Mahout translation (approximation, since ssvd is reduced-rank, not the true > thing):

Re: matrix inversion in plan ?

2015-10-08 Thread Dmitriy Lyubimov
or pseudoinverse really, i guess On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote: > Mahout translation (approximation, since ssvd is reduced-rank, not the > true thing): > > val (drmU, drmV, s) = dssvd(drmA, k = 100) > val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t >

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Yeah, nice trick Ted; here's a how-to for the list: http://www.cse.unr.edu/~bebis/CS791E/Notes/SVD.pdf On Thu, Oct 8, 2015 at 2:31 PM, Ted Dunning wrote: > Yes. You can get the inverse from an SVD or emulate its effect. > > Can you share the actual mathematical

Re: matrix inversion in plan ?

2015-10-08 Thread Andrew Musselman
Totally an approximation; depends on why people are asking for the inverse and whether it'd do. On Thu, Oct 8, 2015 at 4:20 PM, Dmitriy Lyubimov wrote: > or pseudoinverse really, i guess > > On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov > wrote: > > >

Re: matrix inversion in plan ?

2015-10-08 Thread Ted Dunning
Yes. You can get the inverse from an SVD or emulate its effect. Can you share the actual mathematical specification for your problem? If you can't, then there is little we can do to help. On Wed, Oct 7, 2015 at 11:35 PM, go canal wrote: > Unfortunately I do not

Re: matrix inversion in plan ?

2015-10-08 Thread Dmitriy Lyubimov
Mahout translation (approximation, since ssvd is reduced-rank, not the true thing): val (drmU, drmV, s) = dssvd(drmA, k = 100) val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t Still, technically, it is a right inverse as in reality m is rarely the same as n. Also, k must be k<= drmA.nrow min

Re: Exception in thread "main" java.lang.IllegalArgumentException: Unable to read output from "mahout -spark classpath"

2015-10-08 Thread Andrew Palumbo
The Mahout 0.11.0 Shell requires Spark 1.3. Please try with Spark 1.3.1. On 10/08/2015 10:37 PM, go canal wrote: > I tried Spark 1.4.1, same error. Then I saw the same error from shell > command. So I suspect that it is the environment configuration problem. > I have followed this

Re: Exception in thread "main" java.lang.IllegalArgumentException: Unable to read output from "mahout -spark classpath"

2015-10-08 Thread go canal
I tried Spark 1.4.1, same error. Then I saw the same error from shell command. So I suspect that it is the environment configuration problem. I have followed this https://mahout.apache.org/general/downloads.html for Mahout configuration.  So it seems to be a Spark configuration problem, I guess,