spark git commit: [SPARK-16508][SPARKR] Split docs for arrange and orderBy methods

mit: 564fe614c11deb657e0ac9e6b75e65370c48b7fe Parents: 3d8bfe7 Author: Junyang Qian Authored: Mon Aug 15 11:03:03 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Aug 15 11:03:03 2016 -0700 -- .gitignore | 1 + R/pkg/R/DataFrame.R |

spark git commit: [SPARK-16579][SPARKR] add install.spark function

- can install spark when not found in `SPARK_HOME` Manual tests, running the check-cran.sh script added in #14173. Author: Junyang Qian Closes #14258 from junyangq/SPARK-16579. (cherry picked from commit 214ba66a030bc3a718c567a742b0db44bf911d61) Signed-off-by: Shivaram Venkataraman Proj

spark git commit: [SPARK-16579][SPARKR] add install.spark function

1 Parents: d4a9122 Author: Junyang Qian Authored: Wed Aug 10 11:18:23 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 10 11:18:23 2016 -0700 -- R/check-cran.sh | 2 +- R/pkg/DE

spark git commit: [SPARK-16710][SPARKR][ML] spark.glm should support weightCol

mit: d4a9122430d6c3aeaaee32aa09d314016ff6ddc7 Parents: 19af298 Author: Yanbo Liang Authored: Wed Aug 10 10:53:48 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Aug 10 10:53:48 2016 -0700 -- R/pkg/R/mlli

spark git commit: [SPARKR][DOCS] fix broken url in doc

786213920.png) ## How was this patch tested? manual test Author: Felix Cheung Closes #14329 from felixcheung/rdoclinkfix. (cherry picked from commit b73defdd790cb823a4f9958ca89cec06fd198051) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commi

spark git commit: [SPARKR][DOCS] fix broken url in doc

sf/spark/tree/b73defdd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b73defdd Branch: refs/heads/master Commit: b73defdd790cb823a4f9958ca89cec06fd198051 Parents: 7ea6d28 Author: Felix Cheung Authored: Mon Jul 25 11:25:41 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 25 11:25:

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman Clo

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

s a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman Closes #14

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

Repository: spark Updated Branches: refs/heads/branch-2.0 33d92f7f3 -> 7889585cc [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

Repository: spark Updated Branches: refs/heads/master 96e9afaae -> 75f0efe74 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

924 Parents: a529fc9 Author: krishnakalyan3 Authored: Mon Jul 18 09:46:23 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 18 09:46:23 2016 -0700 -- R/pkg/R/sparkR.R | 4 1 file changed, 4 inserti

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

mit 8ea3f4eaec65ee4277f9943063fcc9488d3fa924) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/085f3cc8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/085f3cc8 Diff: http://git-

spark git commit: [SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

ted? unit tests shivaram Author: Felix Cheung Closes #14177 from felixcheung/rsessiontest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d27fe9ba Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d27fe9ba Diff: h

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman Closes #14173 from shivaram/sparkr-cran-changes. (cherry picked from commit c33e4b0d96d424568963c7e716c20f02949c72d1) Signed-off-by: Shivaram Venkataraman Project: http

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

Repository: spark Updated Branches: refs/heads/master 416730483 -> c33e4b0d9 http://git-wip-us.apache.org/repos/asf/spark/blob/c33e4b0d/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index 8416e5c..e

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

Repository: spark Updated Branches: refs/heads/branch-2.0 8c2ec443b -> c527e9ed4 http://git-wip-us.apache.org/repos/asf/spark/blob/c527e9ed/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index 8416e5

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman Closes #14173 from shivaram/sparkr-cran-changes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

9 Author: Narine Kokhlikyan Authored: Sat Jul 16 16:56:16 2016 -0700 Committer: Shivaram Venkataraman Committed: Sat Jul 16 16:56:16 2016 -0700 -- docs/sparkr.md | 138 ++-- 1 file

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

m commit 416730483643a0a92dbd6ae4ad07e80ceb3c5285) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c2ec443 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8c2ec443 Diff: http://git-wip-us.apache.org/repos/a

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

be Spark 2.0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung Closes #14206 from felixcheung/rroutetests. (cherry picked from commit 611a8ca5895357059f1e7c035d946e0718b26a5a) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.ap

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

rk 2.0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung Closes #14206 from felixcheung/rroutetests. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/611a8ca5 Tree: http:/

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung Closes #14195 from felixcheung/rroutedefault. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/12005c88 Tree: http://git-

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung Closes #14195 from felixcheung/rroutedefault. (cherry picked from commit 12005c88fb24168d57b577cff73eddcd9d8963fc) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.

spark git commit: [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

ree: http://git-wip-us.apache.org/repos/asf/spark/tree/093ebbc6 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/093ebbc6 Branch: refs/heads/master Commit: 093ebbc628699b40f091b5b7083c119fffa9314b Parents: 56183b8 Author: Sun Rui Authored: Thu Jul 14 09:38:42 2016 -0700 Committer: Shiva

spark git commit: [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

to windowPartitionBy and windowOrderBy to pass CRAN package check. ## How was this patch tested? SparkR unit tests. Author: Sun Rui Closes #14192 from sun-rui/SPARK-16509. (cherry picked from commit 093ebbc628699b40f091b5b7083c119fffa9314b) Signed-off-by: Shivaram Venkataraman Project: http://

spark git commit: [SPARKR][DOCS][MINOR] R programming guide to include csv data source example

to "sparkR.init" ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #14178 from felixcheung/rcsvprogrammingguide. (cherry picked from commit fb2e8eeb0b1e56bea535165f7a3bec6558b3f4a3) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.

spark git commit: [SPARKR][DOCS][MINOR] R programming guide to include csv data source example

to "sparkR.init" ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #14178 from felixcheung/rcsvprogrammingguide. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/fb2e8eeb Tree: http://git-wip-

spark git commit: [SPARKR][MINOR] R examples and test updates

Repository: spark Updated Branches: refs/heads/master 51a6706b1 -> b4baf086c [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #14171 f

spark git commit: [SPARKR][MINOR] R examples and test updates

Repository: spark Updated Branches: refs/heads/branch-2.0 86adc5cfb -> 18255a934 [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #14171 f

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

2) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cb463b6d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cb463b6d Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/cb463b

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

Cheung Authored: Mon Jul 11 14:34:48 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 11 14:34:48 2016 -0700 -- R/pkg/R/generics.R | 2 -- R/pkg/R/mllib.R| 36 ++-- 2 files change

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

the generated docs. Author: Yanbo Liang Closes #14011 from yanboliang/r-user-guide-update. (cherry picked from commit 2ad031be67c7a0f0c4895c084c891330a9ec935e) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/re

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

wip-us.apache.org/repos/asf/spark/diff/2ad031be Branch: refs/heads/master Commit: 2ad031be67c7a0f0c4895c084c891330a9ec935e Parents: 840853e Author: Yanbo Liang Authored: Mon Jul 11 14:31:11 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jul 11 14:31:11 2016 -0

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

;boolean", df$waiting==79) > summary(df) SparkDataFrame[summary:string, eruptions:string, waiting:string] ``` ## How was this patch tested? Pass the Jenkins with a updated testcase. Author: Dongjoon Hyun Closes #14096 from dongjoon-hyun/SPARK-16425. (cherry picked from commit 6aa7d09f4e126f4

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

Author: Dongjoon Hyun Authored: Thu Jul 7 17:47:29 2016 -0700 Committer: Shivaram Venkataraman Committed: Thu Jul 7 17:47:29 2016 -0700 -- R/pkg/R/DataFrame.R | 3 +-- R/pkg/inst/tests/testthat/te

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

tat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested? unit

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

meter. https://stat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

ONE === Tests passed. ``` Author: Dongjoon Hyun Closes #14019 from dongjoon-hyun/SPARK-16233. (cherry picked from commit d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

iff: http://git-wip-us.apache.org/repos/asf/spark/diff/d17e5f2f Branch: refs/heads/master Commit: d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4 Parents: d601894 Author: Dongjoon Hyun Authored: Fri Jul 1 15:35:19 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Jul 1 15:35:19 2016 -0

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

mit e4fa58c43ce2bf8d76bffb0d9dc1132f8d0eae6a) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d6588115 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d6588115 Diff: http://git-wip-us.apache.org/repos/asf/spark/d

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

Sun Rui Authored: Fri Jul 1 14:37:03 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Jul 1 14:37:03 2016 -0700 -- R/pkg/inst/worker/daemon.R | 2 +- 1 file changed, 1 insertion(+), 1 delet

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

tch tested? Added test cases for gapplyCollect similar to dapplyCollect Author: Narine Kokhlikyan Closes #13760 from NarineK/gapplyCollect. (cherry picked from commit 26afb4ce4099e7942f8db1ead3817ed8fbf71ce3) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/sp

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

org/repos/asf/spark/tree/26afb4ce Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/26afb4ce Branch: refs/heads/master Commit: 26afb4ce4099e7942f8db1ead3817ed8fbf71ce3 Parents: c553976 Author: Narine Kokhlikyan Authored: Fri Jul 1 13:55:13 2016 -0700 Committer: Shivaram Venkataraman Committed:

spark git commit: [SPARKR] add csv tests

ung/rcsv. (cherry picked from commit 823518c2b5259c8a954431467639198c808c9198) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d7a59f1f Tree: http://git-wip-us.apache.org/repos/asf/spark/t

spark git commit: [SPARKR] add csv tests

mit: 823518c2b5259c8a954431467639198c808c9198 Parents: 5545b79 Author: Felix Cheung Authored: Tue Jun 28 17:08:28 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Jun 28 17:08:28 2016 -0700 -- R/pkg/inst/tests/testt

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

Author: WeichenXu Closes #13946 from WeichenXu123/sparkR_comment_update_sparkSession. (cherry picked from commit d59ba8e30751bbf91d49f5530b8242a12bbfb569) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

it-wip-us.apache.org/repos/asf/spark/diff/d59ba8e3 Branch: refs/heads/master Commit: d59ba8e30751bbf91d49f5530b8242a12bbfb569 Parents: 26252f7 Author: WeichenXu Authored: Tue Jun 28 12:12:20 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Jun 28 12:12:20 2016

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

iver" $spark.home [1] "/opt/spark-2.0.0-bin-hadoop2.6" $spark.master [1] "local[*]" $spark.sql.catalogImplementation [1] "hive" $spark.submit.deployMode [1] "client" > conf("spark.master") $spark.master [1] "local[*]" ``` Author: Felix Cheu

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

h: refs/heads/master Commit: 30b182bcc088aef161585211c517f473b9ee6632 Parents: e877415 Author: Felix Cheung Authored: Sun Jun 26 13:10:43 2016 -0700 Committer: Shivaram Venkataraman Committed: Sun Jun 26 13:10:43 2016 -0700 --

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

700 Committer: Shivaram Venkataraman Committed: Thu Jun 23 09:45:01 2016 -0700 -- R/pkg/R/DataFrame.R | 1 - R/pkg/R/context.R| 10 +--- R/pkg/R/sparkR.R |

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

as parameter. Also updated roxygen2 doc and R programming guide on deprecations. ## How was this patch tested? unit tests Author: Felix Cheung Closes #13838 from felixcheung/rjobgroup. (cherry picked from commit b5a997667f4c0e514217da6df5af37b8b849dfdf) Signed-off-by: Shivaram Venkatara

spark git commit: [SPARK-16096][SPARKR] add union and deprecate unionAll

mit: dbfdae4e41a900de01b48639d6554d32edbb2e0b Parents: 918c919 Author: Felix Cheung Authored: Tue Jun 21 13:36:50 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Jun 21 13:36:50 2016 -0700 -- R/pkg/NAMESPACE |

spark git commit: [SPARK-16096][SPARKR] add union and deprecate unionAll

rry picked from commit dbfdae4e41a900de01b48639d6554d32edbb2e0b) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/aeda9a15 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/aeda9a15 D

spark git commit: [SPARK-16109][SPARKR][DOC] R more doc fixes

put html Author: Felix Cheung Closes #13803 from felixcheung/rdocrd. (cherry picked from commit 57746295e6fb705f8393a00ab1cc570ddb7da44e) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/com

spark git commit: [SPARK-16109][SPARKR][DOC] R more doc fixes

pos/asf/spark/diff/57746295 Branch: refs/heads/master Commit: 57746295e6fb705f8393a00ab1cc570ddb7da44e Parents: 2d6919b Author: Felix Cheung Authored: Tue Jun 21 11:01:42 2016 -0700 Committer: Shivaram Venkataraman Committed: Tue Jun 21 11:01:42 2016 -0

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

on which function. ## How was this patch tested? Build doc Author: Felix Cheung Author: felixcheung Closes #13109 from felixcheung/rstatdoc. (cherry picked from commit 843a1eba8ec9d5a7beac0c74b54d24cb3c41b45a) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/re

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

wip-us.apache.org/repos/asf/spark/tree/843a1eba Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/843a1eba Branch: refs/heads/master Commit: 843a1eba8ec9d5a7beac0c74b54d24cb3c41b45a Parents: 09f4cea Author: Felix Cheung Authored: Tue Jun 21 00:19:09 2016 -0700 Committer: Shivaram Venkataraman Commit

spark git commit: [SPARKR][DOCS] R code doc cleanup

to be cleaned up. ## How was this patch tested? manual tests Author: Felix Cheung Closes #13798 from felixcheung/rdocseealso. (cherry picked from commit 09f4ceaeb0a99874f774e09d868fdf907ecf256f) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/r

spark git commit: [SPARKR][DOCS] R code doc cleanup

asf/spark/tree/09f4ceae Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/09f4ceae Branch: refs/heads/master Commit: 09f4ceaeb0a99874f774e09d868fdf907ecf256f Parents: 41e0ffb Author: Felix Cheung Authored: Mon Jun 20 23:51:08 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/10c476fc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/10c476fc Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/10c476fc Branch: refs/he

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

Jun 20 21:09:39 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20 21:09:39 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/generics.R| 4 +++ R/pkg/R/grou

spark git commit: remove duplicated docs in dapply

d from commit e2b7eba87cdf67fa737c32f5f6ca075445ff28cb) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f5731769 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/f5731769 Diff: http://git-wip-us.apa

spark git commit: remove duplicated docs in dapply

f28cb Parents: a42bf55 Author: Narine Kokhlikyan Authored: Mon Jun 20 19:36:51 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20 19:36:51 2016 -0700 -- R/pkg/R/DataFrame.R | 4 +++- R/pkg/R/generics.R | 2 +- 2 fil

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

Repository: spark Updated Branches: refs/heads/branch-2.0 f90b2ea1d -> 54aef1c14 http://git-wip-us.apache.org/repos/asf/spark/blob/54aef1c1/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index 2127dae..d6ff2a

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

Repository: spark Updated Branches: refs/heads/master 92514232e -> d0eddb80e http://git-wip-us.apache.org/repos/asf/spark/blob/d0eddb80/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index 2127dae..d6ff2aa 10

[2/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

/ ## How was this patch tested? Manual. Author: Dongjoon Hyun Closes #13734 from dongjoon-hyun/SPARK-14995. (cherry picked from commit d0eddb80eca04e4f5f8af3b5143096cf67200277) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip

[2/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

/d0eddb80 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d0eddb80 Branch: refs/heads/master Commit: d0eddb80eca04e4f5f8af3b5143096cf67200277 Parents: 9251423 Author: Dongjoon Hyun Authored: Mon Jun 20 14:24:41 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20 14:24:41 2016 -0700

spark git commit: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, programming guide, example updates

tch tested? manual checks shivaram Author: Felix Cheung Closes #13751 from felixcheung/rsparksessiondoc. (cherry picked from commit 359c2e827d5682249c009e83379a5ee8e5aa4e89) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-15159][SPARKR] SparkSession roxygen2 doc, programming guide, example updates

ted? manual checks shivaram Author: Felix Cheung Closes #13751 from felixcheung/rsparksessiondoc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/359c2e82 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/359c2e82 D

spark git commit: [SPARK-16053][R] Add `spark_partition_id` in SparkR

tested? Pass the Jenkins tests (including new testcase). Author: Dongjoon Hyun Closes #13768 from dongjoon-hyun/SPARK-16053. (cherry picked from commit b0f2fb5b9729b38744bf784f2072f5ee52314f87) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit

spark git commit: [SPARK-16053][R] Add `spark_partition_id` in SparkR

s/asf/spark/tree/b0f2fb5b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b0f2fb5b Branch: refs/heads/master Commit: b0f2fb5b9729b38744bf784f2072f5ee52314f87 Parents: aee1420 Author: Dongjoon Hyun Authored: Mon Jun 20 13:41:03 2016 -0700 Committer: Shivaram Venkatara

spark git commit: [SPARKR] fix R roxygen2 doc for count on GroupedData

Repository: spark Updated Branches: refs/heads/branch-2.0 d2c94e6a4 -> dfa920204 [SPARKR] fix R roxygen2 doc for count on GroupedData ## What changes were proposed in this pull request? fix code doc ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #13782 f

spark git commit: [SPARKR] fix R roxygen2 doc for count on GroupedData

Repository: spark Updated Branches: refs/heads/master 46d98e0a1 -> aee1420ec [SPARKR] fix R roxygen2 doc for count on GroupedData ## What changes were proposed in this pull request? fix code doc ## How was this patch tested? manual shivaram Author: Felix Cheung Closes #13782 f

spark git commit: [SPARK-16028][SPARKR] spark.lapply can work with active context

Repository: spark Updated Branches: refs/heads/branch-2.0 ead872e49 -> d2c94e6a4 [SPARK-16028][SPARKR] spark.lapply can work with active context ## What changes were proposed in this pull request? spark.lapply and setLogLevel ## How was this patch tested? unit test shivaram thunte

spark git commit: [SPARK-16028][SPARKR] spark.lapply can work with active context

Repository: spark Updated Branches: refs/heads/master c44bf137c -> 46d98e0a1 [SPARK-16028][SPARKR] spark.lapply can work with active context ## What changes were proposed in this pull request? spark.lapply and setLogLevel ## How was this patch tested? unit test shivaram thunterdb Aut

spark git commit: [SPARK-16051][R] Add `read.orc/write.orc` to SparkR

iff: http://git-wip-us.apache.org/repos/asf/spark/diff/c44bf137 Branch: refs/heads/master Commit: c44bf137c7ca649e0c504229eb3e6ff7955e9a53 Parents: 36e812d Author: Dongjoon Hyun Authored: Mon Jun 20 11:30:26 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20 11:30:26 2016 -0

spark git commit: [SPARK-16051][R] Add `read.orc/write.orc` to SparkR

the Jenkins tests (with new testcases). Author: Dongjoon Hyun Closes #13763 from dongjoon-hyun/SPARK-16051. (cherry picked from commit c44bf137c7ca649e0c504229eb3e6ff7955e9a53) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

nit tests shivaram liancheng Author: Felix Cheung Closes #13753 from felixcheung/rdroptempview. (cherry picked from commit 36e812d4b695566437c6bac991ef06a0f81fb1c5) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.

spark git commit: [SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

sts shivaram liancheng Author: Felix Cheung Closes #13753 from felixcheung/rdroptempview. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/36e812d4 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/36e812d4 Diff: http://

spark git commit: [SPARK-16059][R] Add `monotonically_increasing_id` function in SparkR

9774f20) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/bb80d1c2 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/bb80d1c2 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/bb80d1

spark git commit: [SPARK-16059][R] Add `monotonically_increasing_id` function in SparkR

yun Authored: Mon Jun 20 11:12:41 2016 -0700 Committer: Shivaram Venkataraman Committed: Mon Jun 20 11:12:41 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/functions.R | 27 +++

spark git commit: [SPARK-15159][SPARKR] SparkR SparkSession API

[ ] Separate PR - update all roxygen2 doc coding example - [ ] Separate PR - update SparkR programming guide ## How was this patch tested? unit tests, manual tests shivaram sun-rui rxin Author: Felix Cheung Author: felixcheung Closes #13635 from felixcheung/rsparksession. Project: http://gi

spark git commit: [SPARK-15159][SPARKR] SparkR SparkSession API

tests - [ ] Separate PR - update all roxygen2 doc coding example - [ ] Separate PR - update SparkR programming guide ## How was this patch tested? unit tests, manual tests shivaram sun-rui rxin Author: Felix Cheung Author: felixcheung Closes #13635 from felixcheung/rsparksession. (cherry p

spark git commit: [SPARK-16005][R] Add `randomSplit` to SparkR

wip-us.apache.org/repos/asf/spark/diff/7d65a0db Branch: refs/heads/master Commit: 7d65a0db4a231882200513836f2720f59b35f364 Parents: ef3cc4f Author: Dongjoon Hyun Authored: Fri Jun 17 16:07:33 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Jun 17 16:07:33 2016 -0

spark git commit: [SPARK-16005][R] Add `randomSplit` to SparkR

ith new testcase.) Author: Dongjoon Hyun Closes #13721 from dongjoon-hyun/SPARK-16005. (cherry picked from commit 7d65a0db4a231882200513836f2720f59b35f364) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/re

spark git commit: [SPARK-15925][SPARKR] R DataFrame add back registerTempTable, add tests

nit tests shivaram liancheng Author: Felix Cheung Closes #13722 from felixcheung/rregistertemptable. (cherry picked from commit ef3cc4fc096e831823d62af4fd2a12ae88d434b4) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-15925][SPARKR] R DataFrame add back registerTempTable, add tests

nit tests shivaram liancheng Author: Felix Cheung Closes #13722 from felixcheung/rregistertemptable. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ef3cc4fc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ef3cc4fc D

spark git commit: [SPARK-15908][R] Add varargs-type dropDuplicates() function in SparkR

to https://issues.apache.org/jira/browse/SPARK-15807, too. ## How was this patch tested? Pass the Jenkins tests with new testcases. Author: Dongjoon Hyun Closes #13684 from dongjoon-hyun/SPARK-15908. (cherry picked from commit 513a03e41e27d9c5f70911faccc5d3aecd8bdde9) Signed-off-by: Shiva

spark git commit: [SPARK-15908][R] Add varargs-type dropDuplicates() function in SparkR

:35:17 2016 -0700 Committer: Shivaram Venkataraman Committed: Thu Jun 16 20:35:17 2016 -0700 -- R/pkg/R/DataFrame.R | 25 +++-- R/pkg/R/generics.R| 7 ++- R/

spark git commit: [SPARK-15996][R] Fix R examples by removing deprecated functions

icked from commit a865f6e05297f6121bb2fde717860f9edeed263e) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a2291cd Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0a2291cd Diff:

spark git commit: [SPARK-15996][R] Fix R examples by removing deprecated functions

de717860f9edeed263e Parents: 9ea0d5e Author: Dongjoon Hyun Authored: Thu Jun 16 12:46:25 2016 -0700 Committer: Shivaram Venkataraman Committed: Thu Jun 16 12:46:25 2016 -0700 -- examples/src/main/r/data-manipulation.R | 8 ++

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

n 3. Compute average by a group Author: Narine Kokhlikyan Author: NarineK Closes #12836 from NarineK/gapply2. (cherry picked from commit 7c6c6926376c93acc42dd56a399d816f4838f28c) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

iff: http://git-wip-us.apache.org/repos/asf/spark/diff/7c6c6926 Branch: refs/heads/master Commit: 7c6c6926376c93acc42dd56a399d816f4838f28c Parents: b75f454 Author: Narine Kokhlikyan Authored: Wed Jun 15 21:42:05 2016 -0700 Committer: Shivaram Venkataraman Committed: Wed Jun 15 21:42:05 2016 -0

spark git commit: [SPARK-15637][SPARK-15931][SPARKR] Fix R masked functions checks

tch tested? unit tests shivaram Author: Felix Cheung Closes #13636 from felixcheung/rendswith. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d30b7e66 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/d30b7e66 Diff: h

spark git commit: [SPARK-15637][SPARK-15931][SPARKR] Fix R masked functions checks

his patch tested? unit tests shivaram Author: Felix Cheung Closes #13636 from felixcheung/rendswith. (cherry picked from commit d30b7e6696e20f1014c7f26aadbc051da0fac578) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-

spark git commit: [SPARK-15925][SQL][SPARKR] Replaces registerTempTable with createOrReplaceTempView

s a follow-up task of #12945. ## How was this patch tested? Existing SparkR tests. Author: Cheng Lian Closes #13644 from liancheng/spark-15925-temp-view-for-r. (cherry picked from commit ced8d669b359d6465c3bf476af0f68cc4db04a25) Signed-off-by: Shivaram Venkataraman Project: http://git-

spark git commit: [SPARK-15925][SQL][SPARKR] Replaces registerTempTable with createOrReplaceTempView

ttp://git-wip-us.apache.org/repos/asf/spark/tree/ced8d669 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ced8d669 Branch: refs/heads/master Commit: ced8d669b359d6465c3bf476af0f68cc4db04a25 Parents: c4b1ad0 Author: Cheng Lian Authored: Mon Jun 13 15:46:50 2016 -0700 Committer: Shiva

spark git commit: [SPARK-15766][SPARKR] R should export is.nan

the NAMESPACE. ## How was this patch tested? Manual tests. Author: wm...@hotmail.com Closes #13508 from wangmiao1981/unused. (cherry picked from commit 2c8f40cea113b597fbaf1cdd80a5b8bdd66155fb) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Com

spark git commit: [SPARK-15766][SPARKR] R should export is.nan

ark/tree/2c8f40ce Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2c8f40ce Branch: refs/heads/master Commit: 2c8f40cea113b597fbaf1cdd80a5b8bdd66155fb Parents: 2413fce Author: wm...@hotmail.com Authored: Fri Jun 10 12:46:22 2016 -0700 Committer: Shivaram Venkataraman Committed: Fri Jun 10 12

spark git commit: [SPARK-15684][SPARKR] Not mask startsWith and endsWith in R

rry picked from commit 3ec4461c46e2959f4c640df0292cfcacfe0f727f) Signed-off-by: Shivaram Venkataraman Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ead3bbda Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ead3bbda D

<    1   2   3   4   5   6   >