[jira] [Comment Edited] (SPARK-8514) LU factorization on BlockMatrix

2015-08-27 Thread Jerome (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717696#comment-14717696
 ] 

Jerome edited comment on SPARK-8514 at 8/27/15 11:03 PM:
-

I have a draft of the LU Decomposition in BlockMatrix.scala

https://github.com/nilmeier/spark/tree/SPARK-8514_LU_factorization
https://github.com/nilmeier/spark/tree/SPARK-8514_LU_factorization/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrix.scala

Only one unit test so far:
https://github.com/nilmeier/spark/tree/SPARK-8514_LU_factorization/mllib/src/test/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrixSuite.scala

The method here is slightly different than the previously proposed method in 
that it preforms large block matrices for large BlockMatrix.multiply 
operations.  I'll be adding documentation shortly to github to describe the 
method.

Cheers, J


was (Author: nilmeier):
I have a draft of the LU Decomposition in BlockMatrix.scala

https://github.com/nilmeier/spark/blob/SPARK-8514_LU_factorization
https://github.com/nilmeier/spark/blob/SPARK-8514_LU_factorization/mllib/src/main/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrix.scala

Only one unit test so far:
https://github.com/nilmeier/spark/blob/SPARK-8514_LU_factorization/mllib/src/test/scala/org/apache/spark/mllib/linalg/distributed/BlockMatrixSuite.scala

The method here is slightly different than the previously proposed method in 
that it preforms large block matrices for large BlockMatrix.multiply 
operations.  I'll be adding documentation shortly to github to describe the 
method.

Cheers, J

 LU factorization on BlockMatrix
 ---

 Key: SPARK-8514
 URL: https://issues.apache.org/jira/browse/SPARK-8514
 Project: Spark
  Issue Type: New Feature
  Components: MLlib
Reporter: Xiangrui Meng
  Labels: advanced
 Attachments: BlockMatrixSolver.pdf, BlockPartitionMethods.py, 
 BlockPartitionMethods.scala, LUBlockDecompositionBasic.pdf, testScript.scala


 LU is the most common method to solve a general linear system or inverse a 
 general matrix. A distributed version could in implemented block-wise with 
 pipelining. A reference implementation is provided in ScaLAPACK:
 http://netlib.org/scalapack/slug/node178.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Comment Edited] (SPARK-8514) LU factorization on BlockMatrix

2015-08-18 Thread Jerome (JIRA)

[ 
https://issues.apache.org/jira/browse/SPARK-8514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14701770#comment-14701770
 ] 

Jerome edited comment on SPARK-8514 at 8/18/15 6:44 PM:


I added a draft of the BlockMatrix LU decomposition...I'm still testing it but 
I'd love to get some feedback as I start to implement it in the spark source  
There are some python notebooks outlining the method.  Cheers, J



was (Author: nilmeier):
I just added a draft of the BlockMatrix LU decomposition...I'm still testing it 
but I'd love to get some feedback as I start to implement it in the spark 
source  There are some python notebooks outlining the method.  Cheers, J


 LU factorization on BlockMatrix
 ---

 Key: SPARK-8514
 URL: https://issues.apache.org/jira/browse/SPARK-8514
 Project: Spark
  Issue Type: New Feature
  Components: MLlib
Reporter: Xiangrui Meng
  Labels: advanced
 Attachments: BlockMatrixSolver.pdf, BlockPartitionMethods.py, 
 BlockPartitionMethods.scala, LUBlockDecompositionBasic.pdf, testScript.scala


 LU is the most common method to solve a general linear system or inverse a 
 general matrix. A distributed version could in implemented block-wise with 
 pipelining. A reference implementation is provided in ScaLAPACK:
 http://netlib.org/scalapack/slug/node178.html



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org