GitHub user JihongMA opened a pull request:
https://github.com/apache/spark/pull/6297
SPARK-6548 Adding stddev to DataFrame functions
Adding STDDEV support for DataFrame using 1-pass online /parallel algorithm
to compute variance. Please review the code change.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/JihongMA/spark-1 SPARK-SQL
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/6297.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #6297
----
commit a399aa626d4a5b89ebaab0b56036aac2d11c372f
Author: Jihong MA <[email protected]>
Date: 2015-05-06T04:17:48Z
SPARK-7265 Improving documentation for Spark SQL Hive support
commit 9c846951131ed9078db6927a143115028a641dbe
Author: Jihong MA <[email protected]>
Date: 2015-05-06T15:15:09Z
SPARK-7265 address review comment
commit 7b842e678f510e4ca808cd4a1c05fd4590db1b19
Author: Jihong MA <[email protected]>
Date: 2015-05-07T04:18:26Z
Merge remote-tracking branch 'upstream/master'
commit d5bf3f5da4f0ee630fd65b103e9d0a6734046db6
Author: Jihong MA <[email protected]>
Date: 2015-05-09T05:24:53Z
Merge remote-tracking branch 'upstream/master'
commit 9ea083235da394484a88f358615f78513e61b951
Author: Jihong MA <[email protected]>
Date: 2015-05-11T18:04:12Z
Merge remote-tracking branch 'upstream/master'
commit ace454d5aa004753ab30b46a7e3c90091c32246f
Author: Jihong MA <[email protected]>
Date: 2015-05-12T21:32:06Z
SPARK-7265 take out PySpark on YARN limitation
commit dfaa971559dd6106c48d266230501981843b09e2
Author: Jihong MA <[email protected]>
Date: 2015-05-12T21:41:11Z
SPARK-7265 minor fix of the content
commit a38e9f2f0baafcbc1438a4dbd776fe2372bf6ff7
Author: Jihong MA <[email protected]>
Date: 2015-05-13T18:39:45Z
Merge remote-tracking branch 'upstream/master'
commit 125f3aee4e12369d8077957d6699dff93ce50f5a
Author: Jihong MA <[email protected]>
Date: 2015-05-16T17:52:42Z
SPARK-6548 add stddev for datafram api
commit 634d6a7a729853ac2951e3852f1f8636ed92dbd8
Author: Jihong MA <[email protected]>
Date: 2015-05-16T22:22:55Z
SPARK-6548 Add stddev for DataFrame
commit 213c60e19cd8f89d92accde63e6ea211a4b17ce8
Author: Jihong MA <[email protected]>
Date: 2015-05-16T22:25:37Z
Merge remote-tracking branch 'upstream/master'
commit 3e7d889f133636cfc86d31efdd51cd1d7bb78de4
Author: Jihong MA <[email protected]>
Date: 2015-05-16T22:38:57Z
SPARK-6548 minor fix
commit c40701aee4c3251bcde5d68423168f5e19c34b20
Author: Jihong MA <[email protected]>
Date: 2015-05-16T22:40:50Z
SPARK-6548 minor fix
commit 9d9bdcfc79bdb333ae7a181d35af946fb997955f
Author: Jihong MA <[email protected]>
Date: 2015-05-18T03:38:21Z
Merge remote-tracking branch 'upstream/master'
commit 7adc7a37174c0aecbb7738c362a8f8d002d0faa4
Author: JihongMa <[email protected]>
Date: 2015-05-18T21:51:16Z
Merge remote branch 'upstream/master'
commit c7125689d7f18273a0d19ad4243ee4ac4f633580
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:08:35Z
Revert "SPARK-6548 minor fix"
This reverts commit c40701aee4c3251bcde5d68423168f5e19c34b20.
commit 665ce35a799f9842d5251ee2eb2d85af4deff824
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:09:43Z
Revert "SPARK-6548 minor fix"
This reverts commit 3e7d889f133636cfc86d31efdd51cd1d7bb78de4.
commit 319bd23c460ae3b57ca705a993978a0cac098795
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:15:53Z
Revert "SPARK-6548 Add stddev for DataFrame"
This reverts commit 634d6a7a729853ac2951e3852f1f8636ed92dbd8.
commit f7843584d56b33b038c881ed55fd7e3f61d735d8
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:16:25Z
Revert "SPARK-6548 add stddev for datafram api"
This reverts commit 125f3aee4e12369d8077957d6699dff93ce50f5a.
commit e7d2c0de241d1899feadfd0ed80d9596ac741d0d
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:17:56Z
Revert "SPARK-7265 minor fix of the content"
This reverts commit dfaa971559dd6106c48d266230501981843b09e2.
commit 2ed39213d9bd87a66987ba681c9384eaa71d6bdb
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:18:23Z
Revert "SPARK-7265 take out PySpark on YARN limitation"
This reverts commit ace454d5aa004753ab30b46a7e3c90091c32246f.
commit 430bcfce8f9be7ac8b3f3ce690226c15d68a95e5
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:23:45Z
Revert "SPARK-7265 address review comment"
This reverts commit 9c846951131ed9078db6927a143115028a641dbe.
Conflicts:
docs/running-on-yarn.md
commit 379085568f700af9e96d58aa7f027166f05c7a40
Author: JihongMa <[email protected]>
Date: 2015-05-18T22:29:39Z
Revert "SPARK-7265 Improving documentation for Spark SQL Hive support"
This reverts commit a399aa626d4a5b89ebaab0b56036aac2d11c372f.
Conflicts:
docs/running-on-yarn.md
commit e11ea50eee66ccb56369db92d704ce18a7c9cb9f
Author: JihongMa <[email protected]>
Date: 2015-05-18T23:24:53Z
Merge remote branch 'upstream/master'
commit 1c871fff14ac171e6d45a4cd30eef080c1003665
Author: JihongMa <[email protected]>
Date: 2015-05-18T23:28:00Z
fix running-on-yarn.md
commit 3ee3c0300e01f7c7229018c0ef2c8738e0bf69aa
Author: JihongMa <[email protected]>
Date: 2015-05-18T23:30:07Z
merging runnin-on-yarn.md
commit 82044107c45923ca7de8560b12081efe70556d33
Author: JihongMa <[email protected]>
Date: 2015-05-20T02:02:00Z
Merge remote branch 'upstream/master'
commit a73f041310c59389320bdb685cc1687514bcbd96
Author: JihongMa <[email protected]>
Date: 2015-05-20T21:35:57Z
SPARK-6548 Add Stddev support as Catalyst expression in DataFrame
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
