GitHub user johnc1231 opened a pull request:
https://github.com/apache/spark/pull/17459
[SPARK-20109][MLlib] Added toBlockMatrixDense to IndexedRowMatrix
## What changes were proposed in this pull request?
-I added the method `toBlockMatrixDense` to the IndexedRowMatrix class. The
current implementation of `toBlockMatrix` is insufficient for users with
relatively dense IndexedRowMatrix objects, since it assumes sparsity.
## How was this patch tested?
I used the same tests already written for `toBlockMatrix()` to test this
method. I also added a new additional unit test for an edge case that was not
adequately tested by current test suite.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/johnc1231/spark johnc-fix-ir-to-block
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/17459.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #17459
----
commit 0614ebc102eaf05769cb10d38c9328be3ce517f8
Author: John Compitello <[email protected]>
Date: 2017-03-23T17:46:00Z
Wrote alternative toBlockMatrix method for IndexedRowMatrix
commit c3b9b8ae6bf87c333d64a51cfe049b82534a0d34
Author: John Compitello <[email protected]>
Date: 2017-03-27T20:58:03Z
Added to tests, cleaned up code for clarity
commit 25f4989c02bb71ab6ce0714cc9f9c3f448b7baea
Author: John Compitello <[email protected]>
Date: 2017-03-28T15:14:09Z
Added toBlockMatrixDense with no arguments
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
