Re: Large-scale matrix inverse in Spark

2016-09-29 Thread Robineast
w: > http://apache-spark-user-list.1001560.n3.nabble.com/Large-scale-matrix-inverse-in-Spark-tp27796.html > > <http://apache-spark-user-list.1001560.n3.nabble.com/Large-scale-matrix-inverse-in-Spark-tp27796.html> > To start a new topic under Apache Spark User List, email > ml-nod

Re: Large-scale matrix inverse in Spark

2016-09-27 Thread Anastasios Zouzias
ra.com> wrote: > >> I don't recall any code in Spark that computes a matrix inverse. There is >> code that solves linear systems Ax = b with a decomposition. For example >> from looking at the code recently, I think the regression implementation >> actually solves At

Re: Large-scale matrix inverse in Spark

2016-09-27 Thread Edward Fine
at 11:00 PM Sean Owen <so...@cloudera.com> wrote: > I don't recall any code in Spark that computes a matrix inverse. There is > code that solves linear systems Ax = b with a decomposition. For example > from looking at the code recently, I think the regression implementation > ac

Re: Large-scale matrix inverse in Spark

2016-09-27 Thread Sean Owen
I don't recall any code in Spark that computes a matrix inverse. There is code that solves linear systems Ax = b with a decomposition. For example from looking at the code recently, I think the regression implementation actually solves AtAx = Atb using a Cholesky decomposition. But, A = n x k

Large-scale matrix inverse in Spark

2016-09-26 Thread Cooper
ilable. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Large-scale-matrix-inverse-in-Spark-tp27796.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubsc

Matrix Inverse

2015-12-17 Thread Arunkumar Pillai
Hi I want to find matrix inverse of (XTranspose * X). PFB my code. This code does not work for even slight larger dataset. Please help me if the approach is correct. val sqlQuery = "SELECT column1,column2 ,column3 FROM " + tableName val matrixDF` = sqlContext.sql(sqlQuery)

Re: matrix inverse and multiplication

2015-08-14 Thread go canal
Correction: I am not able to convert the Scala statement to java.

matrix inverse and multiplication

2015-08-13 Thread go canal
Hello,I am new to Spark. I am looking for a matrix inverse and multiplication solution. I did a quick search and found a couple of solutions but my requirements are:- large matrix (up to 2 millions x 2 m)- need to support complex double data type- preferably in Java  There is one post  http