GitHub user brkyvz opened a pull request:
https://github.com/apache/spark/pull/5825
[SPARK-7240][SQL] Single pass covariance calculation for dataframes
Added the calculation of covariance between two columns to DataFrames.
cc @mengxr @rxin
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/brkyvz/spark df-cov
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/5825.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #5825
----
commit 408cb77839d469c4738c506f8a3dfa856e46a7d0
Author: Burak Yavuz <[email protected]>
Date: 2015-04-30T22:00:56Z
initial commit
make progress
make progress2
finished cov implementation. Waiting for freqItems to be merged
trying to debug
added cov
commit 7dc6dbca2fa7f990c30bb605727025fa1a34c7a0
Author: Burak Yavuz <[email protected]>
Date: 2015-05-01T04:14:13Z
reorder imports
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
