Unfortunately I do not know much details of these. The steps of these
calculation is passed to me from a research team. I am helping them with coding
part only. I myself is not good at math :-(
btw, I think Mahout supports out-of-core SVD, am I correct ? If so, I can get
inverse of matrix
Go, if you'd like to put your research team in touch with the list we may
be able to help work through a good approach; let us know.
On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote:
> Mahout translation (approximation, since ssvd is reduced-rank, not the true
> thing):
or pseudoinverse really, i guess
On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov wrote:
> Mahout translation (approximation, since ssvd is reduced-rank, not the
> true thing):
>
> val (drmU, drmV, s) = dssvd(drmA, k = 100)
> val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t
>
Yeah, nice trick Ted; here's a how-to for the list:
http://www.cse.unr.edu/~bebis/CS791E/Notes/SVD.pdf
On Thu, Oct 8, 2015 at 2:31 PM, Ted Dunning wrote:
> Yes. You can get the inverse from an SVD or emulate its effect.
>
> Can you share the actual mathematical
Totally an approximation; depends on why people are asking for the inverse
and whether it'd do.
On Thu, Oct 8, 2015 at 4:20 PM, Dmitriy Lyubimov wrote:
> or pseudoinverse really, i guess
>
> On Thu, Oct 8, 2015 at 3:58 PM, Dmitriy Lyubimov
> wrote:
>
> >
Yes. You can get the inverse from an SVD or emulate its effect.
Can you share the actual mathematical specification for your problem?
If you can't, then there is little we can do to help.
On Wed, Oct 7, 2015 at 11:35 PM, go canal wrote:
> Unfortunately I do not
Mahout translation (approximation, since ssvd is reduced-rank, not the true
thing):
val (drmU, drmV, s) = dssvd(drmA, k = 100)
val drmInvA = drmV %*% diagv(1 /=: s) %*% drmU.t
Still, technically, it is a right inverse as in reality m is rarely the
same as n. Also, k must be k<= drmA.nrow min
The Mahout 0.11.0 Shell requires Spark 1.3. Please try with Spark 1.3.1.
On 10/08/2015 10:37 PM, go canal wrote:
> I tried Spark 1.4.1, same error. Then I saw the same error from shell
> command. So I suspect that it is the environment configuration problem.
> I have followed this
I tried Spark 1.4.1, same error. Then I saw the same error from shell command.
So I suspect that it is the environment configuration problem.
I have followed this https://mahout.apache.org/general/downloads.html for
Mahout configuration.
So it seems to be a Spark configuration problem, I guess,