[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14553769#comment-14553769 ] Manoj Kumar commented on SPARK-7785: ping [~josephkb] Add missing items to pyspark.mllib.linalg.Matrices -- Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type: Sub-task Components: MLlib, PySpark Reporter: Manoj Kumar For DenseMatrices. Class Methods __str__, transpose Object Methods zeros, ones, eye, rand, randn, diag For SparseMatrices Class Methods __str__, transpose Object Methods, fromCoo, speye, sprand, sprandn, spdiag, Matrices Methods, horzcat, vertcat -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555280#comment-14555280 ] Joseph K. Bradley commented on SPARK-7785: -- Ping [~brkyvz] [~mengxr] to weigh in on how many linalg methods we want to add to our PySpark classes Add missing items to pyspark.mllib.linalg.Matrices -- Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type: Sub-task Components: MLlib, PySpark Reporter: Manoj Kumar For DenseMatrices. Class Methods __str__, transpose Object Methods zeros, ones, eye, rand, randn, diag For SparseMatrices Class Methods __str__, transpose Object Methods, fromCoo, speye, sprand, sprandn, spdiag, Matrices Methods, horzcat, vertcat -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555313#comment-14555313 ] Burak Yavuz commented on SPARK-7785: My belief on the Python linalg api so far has been that in Python, you have two beautiful libraries called numpy and scipy. The overhead of serialization-deserialization is not worth the implementation of wrappers, because numpy and scipy are backed by C and have vectorization and such. For linalg, we have been leveraging Breeze for a long time, only adding stuff for when the performance can be greatly improved. If we can obtain better performance from numpy and scipy, then let's just leverage them. Most of these methods were already named very similar to numpy and scipy anyway. Add missing items to pyspark.mllib.linalg.Matrices -- Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type: Sub-task Components: MLlib, PySpark Reporter: Manoj Kumar For DenseMatrices. Class Methods __str__, transpose Object Methods zeros, ones, eye, rand, randn, diag For SparseMatrices Class Methods __str__, transpose Object Methods, fromCoo, speye, sprand, sprandn, spdiag, Matrices Methods, horzcat, vertcat -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-7785) Add missing items to pyspark.mllib.linalg.Matrices
[ https://issues.apache.org/jira/browse/SPARK-7785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14555310#comment-14555310 ] Xiangrui Meng commented on SPARK-7785: -- In PySpark, we should delegate all local linear algebra operations to numpy and scipy. For the factory methods, users should use numpy/scipy directly. Add missing items to pyspark.mllib.linalg.Matrices -- Key: SPARK-7785 URL: https://issues.apache.org/jira/browse/SPARK-7785 Project: Spark Issue Type: Sub-task Components: MLlib, PySpark Reporter: Manoj Kumar For DenseMatrices. Class Methods __str__, transpose Object Methods zeros, ones, eye, rand, randn, diag For SparseMatrices Class Methods __str__, transpose Object Methods, fromCoo, speye, sprand, sprandn, spdiag, Matrices Methods, horzcat, vertcat -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
