GitHub user andy327 opened a pull request:
https://github.com/apache/spark/pull/1698
Add normalizeByCol method to mllib.util.MLUtils.
Adds the ability to compute the mean and standard deviations of each vector
(LabeledPoint) component and normalize each vector in the RDD, using only RDD
transformations. The result is an RDD of Vectors where each column has a mean
of zero and standard deviation of one.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/tresata/spark feat-normalize-cols
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/1698.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #1698
----
commit 89e538b2a0ba65e9b7829ba3a5f706373211f3c8
Author: Andres Perez <[email protected]>
Date: 2014-07-31T16:35:44Z
Add normalizeByCol method to mllib.util.MLUtils.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
