spark git commit: [SPARK-16029][SPARKR] SparkR add dropTempView and deprecate dropTempTable

2016-06-20 Thread shivaram
nit tests shivaram liancheng Author: Felix Cheung <felixcheun...@hotmail.com> Closes #13753 from felixcheung/rdroptempview. (cherry picked from commit 36e812d4b695566437c6bac991ef06a0f81fb1c5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.a

spark git commit: [SPARK-16051][R] Add `read.orc/write.orc` to SparkR

2016-06-20 Thread shivaram
ass the Jenkins tests (with new testcases). Author: Dongjoon Hyun <dongj...@apache.org> Closes #13763 from dongjoon-hyun/SPARK-16051. (cherry picked from commit c44bf137c7ca649e0c504229eb3e6ff7955e9a53) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

2016-06-20 Thread shivaram
Dongjoon Hyun <dongj...@apache.org> Authored: Mon Jun 20 21:09:39 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 21:09:39 2016 -0700 -- R/pkg/NAMESPACE

spark git commit: [SPARK-15294][R] Add `pivot` to SparkR

2016-06-20 Thread shivaram
9ad7344ee) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/10c476fc Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/10c476fc Diff: http://git-wip-us.a

spark git commit: remove duplicated docs in dapply

2016-06-20 Thread shivaram
er Commit: e2b7eba87cdf67fa737c32f5f6ca075445ff28cb Parents: a42bf55 Author: Narine Kokhlikyan <nar...@slice.com> Authored: Mon Jun 20 19:36:51 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jun 20 19:36:51 2016 -0700 --

spark git commit: remove duplicated docs in dapply

2016-06-20 Thread shivaram
cked from commit e2b7eba87cdf67fa737c32f5f6ca075445ff28cb) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/f5731769 Tree: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

2016-06-21 Thread shivaram
ion is on which function. ## How was this patch tested? Build doc Author: Felix Cheung <felixcheun...@hotmail.com> Author: felixcheung <felixcheun...@hotmail.com> Closes #13109 from felixcheung/rstatdoc. (cherry picked from commit 843a1eba8ec9d5a7beac0c74b54d24cb3c41b45a) Signed-o

spark git commit: [SPARK-15319][SPARKR][DOCS] Fix SparkR doc layout for corr and other DataFrame stats functions

2016-06-21 Thread shivaram
eun...@hotmail.com> Authored: Tue Jun 21 00:19:09 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun 21 00:19:09 2016 -0700 -- R/pkg/R/generics.R | 8 --

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

2016-06-15 Thread shivaram
: Wed Jun 15 21:42:05 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jun 15 21:42:05 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/DataFrame.R

spark git commit: [SPARK-12922][SPARKR][WIP] Implement gapply() on DataFrame in SparkR

2016-06-15 Thread shivaram
n 3. Compute average by a group Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Author: NarineK <narine.kokhlik...@us.ibm.com> Closes #12836 from NarineK/gapply2. (cherry picked from commit 7c6c6926376c93acc42dd56a399d816f4838f28c) Signed-off-by: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-15908][R] Add varargs-type dropDuplicates() function in SparkR

2016-06-16 Thread shivaram
un <dongj...@apache.org> Authored: Thu Jun 16 20:35:17 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jun 16 20:35:17 2016 -0700 -- R/pkg/R/DataFrame.R

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

2016-06-23 Thread shivaram
t;felixcheun...@hotmail.com> Authored: Thu Jun 23 09:45:01 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jun 23 09:45:01 2016 -0700 -- R/pkg/R/DataFrame.R | 1

spark git commit: [SPARK-16088][SPARKR] update setJobGroup, cancelJobGroup, clearJobGroup

2016-06-23 Thread shivaram
igned-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/9f18c8f3 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/9f18c8f3 Diff: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-11031][SPARKR] Method str() on a DataFrame

2016-01-15 Thread shivaram
he.org/repos/asf/spark/tree/ba4a6419 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ba4a6419 Branch: refs/heads/master Commit: ba4a641902f95c5a9b3a6bebcaa56039eca2720d Parents: 96fb894 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Fri Jan 15 07:37:54 2016 -0800

spark git commit: [SPARK-11031][SPARKR] Method str() on a DataFrame

2016-01-15 Thread shivaram
<oscar.lara.ye...@us.ibm.com> Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.attlocal.net> Closes #9613 from olarayej/SPARK-11031. (cherry picked from commit ba4a641902f95c5a9b3a6bebcaa56039eca2720d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http:

spark git commit: [SPARK-12862][SPARKR] Jenkins does not run R tests

2016-01-17 Thread shivaram
Repository: spark Updated Branches: refs/heads/master cede7b2a1 -> 92502703f [SPARK-12862][SPARKR] Jenkins does not run R tests Slight correction: I'm leaving sparkR as-is (ie. R file not supported) and fixed only run-tests.sh as shivaram described. I also assume we are going to cover

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
xcheun...@hotmail.com> Closes #13885 from felixcheung/rconf. (cherry picked from commit 30b182bcc088aef161585211c517f473b9ee6632) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/r

spark git commit: [SPARK-16184][SPARKR] conf API for SparkSession

2016-06-26 Thread shivaram
spark/diff/30b182bc Branch: refs/heads/master Commit: 30b182bcc088aef161585211c517f473b9ee6632 Parents: e877415 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Sun Jun 26 13:10:43 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Jun 26

spark git commit: [SPARK-12629][SPARKR] Fixes for DataFrame saveAsTable method

2016-02-02 Thread shivaram
nks! Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Closes #10580 from NarineK/sparkrSavaAsRable. (cherry picked from commit 8a88e121283472c26e70563a4e04c109e9b183b3) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos

spark git commit: [SPARK-12204][SPARKR] Implement drop method for DataFrame in SparkR.

2016-01-20 Thread shivaram
: Sun Rui <rui@intel.com> Authored: Wed Jan 20 21:08:15 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jan 20 21:08:15 2016 -0800 -- R/pkg/NAMESPACE

spark git commit: [SPARK-12910] Fixes : R version for installing sparkR

2016-01-20 Thread shivaram
hor: Shubhanshu Mishra <smish...@illinois.edu> Authored: Wed Jan 20 18:06:06 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Jan 20 18:06:06 2016 -0800 -- R/README.md | 10 ++

spark git commit: [SPARK-12629][SPARKR] Fixes for DataFrame saveAsTable method

2016-01-22 Thread shivaram
e121 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8a88e121 Branch: refs/heads/master Commit: 8a88e121283472c26e70563a4e04c109e9b183b3 Parents: e13c147 Author: Narine Kokhlikyan <narine.kokhlik...@gmail.com> Authored: Fri Jan 22 10:35:02 2016 -0800 Committer: Shivaram Venk

spark git commit: [SPARK-12337][SPARKR] Implement dropDuplicates() method of DataFrame in SparkR.

2016-01-19 Thread shivaram
a6 Author: Sun Rui <rui@intel.com> Authored: Tue Jan 19 16:37:18 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jan 19 16:37:18 2016 -0800 -- R/pkg/NAMESPACE

spark git commit: [SPARK-12168][SPARKR] Add automated tests for conflicted function in R

2016-01-19 Thread shivaram
rg/repos/asf/spark/tree/37fefa66 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/37fefa66 Branch: refs/heads/master Commit: 37fefa66cbd61bc592aba42b0ed3aefc0cf3abb0 Parents: 3e84ef0 Author: felixcheung <felixcheun...@hotmail.com> Authored: Tue Jan 19 16:33:48 2016 -0800 Committer: Shi

spark git commit: [SPARK-12232][SPARKR] New R API for read.table to avoid name conflict

2016-01-19 Thread shivaram
Repository: spark Updated Branches: refs/heads/master beda90142 -> 488bbb216 [SPARK-12232][SPARKR] New R API for read.table to avoid name conflict shivaram sorry it took longer to fix some conflicts, this is the change to add an alias for `table` Author: felixcheung <feli

spark git commit: [SPARK-12903][SPARKR] Add covar_samp and covar_pop for SparkR

2016-01-26 Thread shivaram
ion at stats.R which masks ```stats::cov``` already, but may bring to breaking API change. cc sun-rui felixcheung shivaram Author: Yanbo Liang <yblia...@gmail.com> Closes #10829 from yanboliang/spark-12903. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.a

spark git commit: [SPARK-13389][SPARKR] SparkR support first/last with ignore NAs

2016-03-10 Thread shivaram
Repository: spark Updated Branches: refs/heads/master c3a6269ca -> 4d535d1f1 [SPARK-13389][SPARKR] SparkR support first/last with ignore NAs ## What changes were proposed in this pull request? SparkR support first/last with ignore NAs cc sun-rui felixcheung shivaram ##

spark git commit: [SPARK-13327][SPARKR] Added parameter validations for colnames<-

2016-03-10 Thread shivaram
Branch: refs/heads/master Commit: 416e71af4d26e67afb715ea1d625341cdea4873d Parents: 88fa866 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.attlocal.net> Authored: Thu Mar 10 17:10:23 2016 -0800 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed:

spark git commit: [SPARK-13327][SPARKR] Added parameter validations for colnames<-

2016-03-10 Thread shivaram
Closes #11220 from olarayej/SPARK-13312-3. (cherry picked from commit 416e71af4d26e67afb715ea1d625341cdea4873d) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/co

spark git commit: [SPARK-13812][SPARKR] Fix SparkR lint-r test errors.

2016-03-13 Thread shivaram
pache.org/repos/asf/spark/tree/c7e68c39 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c7e68c39 Branch: refs/heads/master Commit: c7e68c3968357268f705dee1477c448472c21547 Parents: 515e4af Author: Sun Rui <rui@intel.com> Authored: Sun Mar 13 14:30:44 2016 -0700 Committer: Shivar

spark git commit: [SPARK-13178] RRDD faces with concurrency issue in case of rdd.zip(rdd).count().

2016-04-22 Thread shivaram
Rui <rui@intel.com> Authored: Fri Apr 22 11:19:52 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Apr 22 11:19:52 2016 -0700 -- R/pkg/inst/tests/testthat/test_mllib.R | 2

spark git commit: [SPARK-13734][SPARKR] Added histogram function

2016-04-26 Thread shivaram
ee/0c99c23b Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/0c99c23b Branch: refs/heads/master Commit: 0c99c23b7d9f0c3538cd2b062d551411712a2bcc Parents: 75879ac Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Tue Apr 26 15:34:30 2016 -0700 Commi

spark git commit: [SPARK-13436][SPARKR] Added parameter drop to subsetting operator [

2016-04-27 Thread shivaram
repos/asf/spark/diff/e4bfb4aa Branch: refs/heads/master Commit: e4bfb4aa7382cb9c5e4eb7e2211551d5da716a61 Parents: 3757511 Author: Oscar D. Lara Yejas <odlar...@oscars-mbp.usca.ibm.com> Authored: Wed Apr 27 15:47:54 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs

spark git commit: [SPARK-14883][DOCS] Fix wrong R examples and make them up-to-date

2016-04-24 Thread shivaram
Parents: 35319d3 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Sun Apr 24 22:10:27 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun Apr 24 22:10:27 2016 -0700 -- R/pkg/R/

spark git commit: [SPARK-14594][SPARKR] check execution return status code

2016-04-23 Thread shivaram
2 Branch: refs/heads/master Commit: 39d3bc62a7ba16c646bed8d524cf9b929374a790 Parents: 6acc72a Author: felixcheung <felixcheun...@hotmail.com> Authored: Sat Apr 23 11:08:19 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Apr 2

spark git commit: [SPARK-12919][SPARKR] Implement dapply() on DataFrame in SparkR.

2016-04-29 Thread shivaram
/asf/spark/diff/4ae9fe09 Branch: refs/heads/master Commit: 4ae9fe091c2cb8388c581093d62d3deaef40993e Parents: d78fbcc Author: Sun Rui <rui@intel.com> Authored: Fri Apr 29 16:41:07 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri

spark git commit: [SPARK-12235][SPARKR] Enhance mutate() to support replace existing columns.

2016-04-28 Thread shivaram
er Commit: 9e785079b6ed4ea691c3c14c762a7f73fb6254bf Parents: 23256be Author: Sun Rui <rui@intel.com> Authored: Thu Apr 28 09:33:58 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Apr 28 09:33:58 2016 -0700 --

spark git commit: [MINOR][SPARKR][DOC] Add a description for running unit tests in Windows

2016-05-23 Thread shivaram
tch tested? On a bare machine (Window 7, 32bits), this was manually built and tested. Author: hyukjinkwon <gurwls...@gmail.com> Closes #13217 from HyukjinKwon/minor-r-doc. (cherry picked from commit a8e97d17b91684e68290d9f18a43622232aa94e7) Signed-off-by: Shivaram Venkataram

spark git commit: [MINOR][SPARKR][DOC] Add a description for running unit tests in Windows

2016-05-23 Thread shivaram
3 17:20:29 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon May 23 17:20:29 2016 -0700 -- R/README.md | 8 +++- R/WINDOWS.md | 20 2 files changed, 27 inse

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
<sunrui2...@gmail.com> Authored: Thu May 12 17:50:55 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu May 12 17:50:55 2016 -0700 -- R/pkg/NAMESPACE | 1 +

spark git commit: [SPARK-15202][SPARKR] add dapplyCollect() method for DataFrame in SparkR.

2016-05-12 Thread shivaram
c) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/54c04aa5 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/54c04aa5 Diff: http://git-wip-us.apache.org/

spark git commit: [SPARK-11395][SPARKR] Support over and window specification in SparkR.

2016-05-05 Thread shivaram
pec objects. 3. Implement over() of Column class. Author: Sun Rui <rui@intel.com> Author: Sun Rui <sunrui2...@gmail.com> Closes #10094 from sun-rui/SPARK-11395. (cherry picked from commit 157a49aa410dc1870cd171148d317084c5a90d23) Signed-off-by: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-05-03 Thread shivaram
hat version 1.0.1 ## How was this patch tested? SparkR unit test cases. Author: Sun Rui <sunrui2...@gmail.com> Closes #12867 from sun-rui/SPARK-15091. (cherry picked from commit 8b6491fc0b49b4e363887ae4b452ba69fe0290d5) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARK-15091][SPARKR] Fix warnings and a failure in SparkR test cases with testthat version 1.0.1

2016-05-03 Thread shivaram
//git-wip-us.apache.org/repos/asf/spark/tree/8b6491fc Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/8b6491fc Branch: refs/heads/master Commit: 8b6491fc0b49b4e363887ae4b452ba69fe0290d5 Parents: d26f7cb Author: Sun Rui <sunrui2...@gmail.com> Authored: Tue May 3 09:29:49 2016 -0700 Comm

spark git commit: [SPARK-12224][SPARKR] R support for JDBC source

2016-04-19 Thread shivaram
mail.com> Closes #10480 from felixcheung/rreadjdbc. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ecd877e8 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ecd877e8 Diff: http://git-wip-us.a

spark git commit: [SPARK-12479][SPARKR] sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread shivaram
refs/heads/master Commit: 454ba4d67e782369627dfe60261e6648a27b91a0 Parents: 6e268b9 Author: Sun Rui <sunrui2...@gmail.com> Authored: Sun May 8 00:17:36 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sun May 8 00:17:36 2016 -0700 --

spark git commit: [SPARK-12479][SPARKR] sparkR collect on GroupedData throws R error "missing value where TRUE/FALSE needed"

2016-05-08 Thread shivaram
RK-12479. (cherry picked from commit 454ba4d67e782369627dfe60261e6648a27b91a0) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cf156e61 Tree: http://git-wi

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14195 from felixcheung/rroutedefault. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit

spark git commit: [SPARK-16538][SPARKR] fix R call with namespace operator on SparkSession functions

2016-07-14 Thread shivaram
rkR::createDataFrame` ## How was this patch tested? manual, unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14195 from felixcheung/rroutedefault. (cherry picked from commit 12005c88fb24168d57b577cff73eddcd9d8963fc) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16509][SPARKR] Rename window.partitionBy and window.orderBy to windowPartitionBy and windowOrderBy.

2016-07-14 Thread shivaram
red: Thu Jul 14 09:38:42 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jul 14 09:38:42 2016 -0700 -- R/pkg/NAMESPACE | 4 +- R/pkg/R/WindowSpec.R

spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
t-wip-us.apache.org/repos/asf/spark/tree/b73defdd Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/b73defdd Branch: refs/heads/master Commit: b73defdd790cb823a4f9958ca89cec06fd198051 Parents: 7ea6d28 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Jul 25 11:25:41 2016

spark git commit: [SPARKR][DOCS] fix broken url in doc

2016-07-25 Thread shivaram
786213920.png) ## How was this patch tested? manual test Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14329 from felixcheung/rdoclinkfix. (cherry picked from commit b73defdd790cb823a4f9958ca89cec06fd198051) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu>

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
- can install spark when not found in `SPARK_HOME` Manual tests, running the check-cran.sh script added in #14173. Author: Junyang Qian <junya...@databricks.com> Closes #14258 from junyangq/SPARK-16579. (cherry picked from commit 214ba66a030bc3a718c567a742b0db44bf911d61) Signed-o

spark git commit: [SPARK-16579][SPARKR] add install.spark function

2016-08-10 Thread shivaram
s/master Commit: 214ba66a030bc3a718c567a742b0db44bf911d61 Parents: d4a9122 Author: Junyang Qian <junya...@databricks.com> Authored: Wed Aug 10 11:18:23 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 10 11:18:23 2016 -0700 --

spark git commit: [SPARK-16710][SPARKR][ML] spark.glm should support weightCol

2016-08-10 Thread shivaram
er Commit: d4a9122430d6c3aeaaee32aa09d314016ff6ddc7 Parents: 19af298 Author: Yanbo Liang <yblia...@gmail.com> Authored: Wed Aug 10 10:53:48 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Wed Aug 1

spark git commit: [SPARKR][DOCS][MINOR] R programming guide to include csv data source example

2016-07-13 Thread shivaram
nce to "sparkR.init" ## How was this patch tested? manual shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14178 from felixcheung/rcsvprogrammingguide. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/c

spark git commit: [SPARKR][MINOR] R examples and test updates

2016-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 51a6706b1 -> b4baf086c [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung <felixcheun...@hotma

spark git commit: [SPARKR][MINOR] R examples and test updates

2016-07-13 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 86adc5cfb -> 18255a934 [SPARKR][MINOR] R examples and test updates ## What changes were proposed in this pull request? Minor example updates ## How was this patch tested? manual shivaram Author: Felix Cheung <feli

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
er Commit: 8ea3f4eaec65ee4277f9943063fcc9488d3fa924 Parents: a529fc9 Author: krishnakalyan3 <krishnakaly...@gmail.com> Authored: Mon Jul 18 09:46:23 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jul 1

spark git commit: [SPARK-16055][SPARKR] warning added while using sparkPackages with spark-submit

2016-07-18 Thread shivaram
(cherry picked from commit 8ea3f4eaec65ee4277f9943063fcc9488d3fa924) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/085f3cc8 Tree: http://git-wip-us.apach

spark git commit: [SPARK-16027][SPARKR] Fix R tests SparkSession init/stop

2016-07-17 Thread shivaram
ted? unit tests shivaram Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14177 from felixcheung/rsessiontest. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d27fe9ba Tree: http://git-wip-us.apache.org/repos/

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14173 from shivaram/sparkr-cran-changes. (cherry picked from commit c33e4b0d96d424568963c7e716c20f02949c72d1) Signed-off-by: Sh

[2/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
fixes ## How was this patch tested? SparkR unit tests, running the above mentioned script Author: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Closes #14173 from shivaram/sparkr-cran-changes. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apac

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 416730483 -> c33e4b0d9 http://git-wip-us.apache.org/repos/asf/spark/blob/c33e4b0d/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

[1/2] spark git commit: [SPARK-16507][SPARKR] Add a CRAN checker, fix Rd aliases

2016-07-16 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 8c2ec443b -> c527e9ed4 http://git-wip-us.apache.org/repos/asf/spark/blob/c527e9ed/R/pkg/R/generics.R -- diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R index

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

2016-07-16 Thread shivaram
5 Parents: 5ec0d69 Author: Narine Kokhlikyan <nar...@slice.com> Authored: Sat Jul 16 16:56:16 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Sat Jul 16 16:56:16 2016 -0700 --

spark git commit: [SPARK-16112][SPARKR] Programming guide for gapply/gapplyCollect

2016-07-16 Thread shivaram
om commit 416730483643a0a92dbd6ae4ad07e80ceb3c5285) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/8c2ec443 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/8c2e

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 96e9afaae -> 75f0efe74 [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARKR][DOCS] minor code sample update in R programming guide

2016-07-18 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 33d92f7f3 -> 7889585cc [SPARKR][DOCS] minor code sample update in R programming guide ## What changes were proposed in this pull request? Fix code style from ad hoc review of RC4 doc ## How was this patch tested? manual shiva

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman <

spark git commit: [SPARK-10683][SPARK-16510][SPARKR] Move SparkR include jar test to SparkSubmitSuite

2016-07-19 Thread shivaram
ses a dynamically compiled jar. This helps us remove the binary jar from the R package and solves both the CRAN warnings and the lack of source being available for this jar. ## How was this patch tested? SparkR unit tests, SparkSubmitSuite, check-cran.sh Author: Shivaram Venkataraman <

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

2016-07-15 Thread shivaram
ark 2.0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14206 from felixcheung/rroutetests. (cherry picked from commit 611a8ca5895357059f1e7c035d946e0718b26a5a) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16538][SPARKR] Add more tests for namespace call to SparkSession functions

2016-07-15 Thread shivaram
0.1 or 2.1.0. ## How was this patch tested? unit tests shivaram dongjoon-hyun Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14206 from felixcheung/rroutetests. Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spa

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

2016-07-11 Thread shivaram
eck the generated docs. Author: Yanbo Liang <yblia...@gmail.com> Closes #14011 from yanboliang/r-user-guide-update. (cherry picked from commit 2ad031be67c7a0f0c4895c084c891330a9ec935e) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/

spark git commit: [SPARKR][DOC] SparkR ML user guides update for 2.0

2016-07-11 Thread shivaram
/2ad031be Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2ad031be Branch: refs/heads/master Commit: 2ad031be67c7a0f0c4895c084c891330a9ec935e Parents: 840853e Author: Yanbo Liang <yblia...@gmail.com> Authored: Mon Jul 11 14:31:11 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-11 Thread shivaram
d031b Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Mon Jul 11 14:34:48 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Jul 11 14:34:48 2016 -0700 -- R/pkg/R/gen

spark git commit: [SPARK-16144][SPARKR] update R API doc for mllib

2016-07-11 Thread shivaram
from commit 7f38b9d5f469b2550bc481cbf9adb9acc3779712) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/cb463b6d Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/cb463b6d Di

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

2016-06-28 Thread shivaram
Author: WeichenXu <weichenxu...@outlook.com> Closes #13946 from WeichenXu123/sparkR_comment_update_sparkSession. (cherry picked from commit d59ba8e30751bbf91d49f5530b8242a12bbfb569) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/re

spark git commit: [MINOR][SPARKR] update sparkR DataFrame.R comment

2016-06-28 Thread shivaram
59ba8e3 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d59ba8e3 Branch: refs/heads/master Commit: d59ba8e30751bbf91d49f5530b8242a12bbfb569 Parents: 26252f7 Author: WeichenXu <weichenxu...@outlook.com> Authored: Tue Jun 28 12:12:20 2016 -0700 Committer: Shivaram Venkataraman <shi

spark git commit: [SPARKR] add csv tests

2016-06-28 Thread shivaram
2 Branch: refs/heads/master Commit: 823518c2b5259c8a954431467639198c808c9198 Parents: 5545b79 Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Jun 28 17:08:28 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Jun 2

spark git commit: [SPARKR] add csv tests

2016-06-28 Thread shivaram
il.com> Closes #13904 from felixcheung/rcsv. (cherry picked from commit 823518c2b5259c8a954431467639198c808c9198) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
meter. https://stat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested? un

spark git commit: [SPARK-16310][SPARKR] R na.string-like default for csv source

2016-07-07 Thread shivaram
tat.ethz.ch/R-manual/R-devel/library/utils/html/read.table.html na.strings = "NA" An user passing a csv file with NA value should get the same behavior with SparkR read.df(... source = "csv") (couldn't open JIRA, will do that later) ## How was this patch tested? unit test

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
commit 6aa7d09f4e126f42e41085dec169c813379ed354) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/73c764a0 Tree: http://git-wip-us.apache.org/repos/asf/spark/tree

spark git commit: [SPARK-16425][R] `describe()` should not fail with non-numeric columns

2016-07-07 Thread shivaram
9c813379ed354 Parents: f4767bc Author: Dongjoon Hyun <dongj...@apache.org> Authored: Thu Jul 7 17:47:29 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Thu Jul 7 17:47:29 2016 -0700 -- R/pkg

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

2016-07-01 Thread shivaram
om commit e4fa58c43ce2bf8d76bffb0d9dc1132f8d0eae6a) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wip-us.apache.org/repos/asf/spark/repo Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/d6588115 Tree: http://git-wip-us.apache.org/repos/asf/spark/tre

spark git commit: [SPARK-16299][SPARKR] Capture errors from R workers in daemon.R to avoid deletion of R session temporary directory.

2016-07-01 Thread shivaram
f8d0eae6a Parents: 26afb4c Author: Sun Rui <sunrui2...@gmail.com> Authored: Fri Jul 1 14:37:03 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Jul 1 14:37:03 2016 -0700 -- R/pkg/inst/work

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

2016-07-01 Thread shivaram
asf/spark/tree/d17e5f2f Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d17e5f2f Branch: refs/heads/master Commit: d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4 Parents: d601894 Author: Dongjoon Hyun <dongj...@apache.org> Authored: Fri Jul 1 15:35:19 2016 -0700 Committer: Shivaram Venk

spark git commit: [SPARK-16233][R][TEST] ORC test should be enabled only when HiveContext is available.

2016-07-01 Thread shivaram
ONE === Tests passed. ``` Author: Dongjoon Hyun <dongj...@apache.org> Closes #14019 from dongjoon-hyun/SPARK-16233. (cherry picked from commit d17e5f2f123eecd5a7a1d87f5ce75a0fc44552b4) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: http://git-wi

[2/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
/ ## How was this patch tested? Manual. Author: Dongjoon Hyun <dongj...@apache.org> Closes #13734 from dongjoon-hyun/SPARK-14995. (cherry picked from commit d0eddb80eca04e4f5f8af3b5143096cf67200277) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Project: ht

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/master 92514232e -> d0eddb80e http://git-wip-us.apache.org/repos/asf/spark/blob/d0eddb80/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index 2127dae..d6ff2aa

[1/2] spark git commit: [SPARK-14995][R] Add `since` tag in Roxygen documentation for SparkR API methods

2016-06-20 Thread shivaram
Repository: spark Updated Branches: refs/heads/branch-2.0 f90b2ea1d -> 54aef1c14 http://git-wip-us.apache.org/repos/asf/spark/blob/54aef1c1/R/pkg/R/mllib.R -- diff --git a/R/pkg/R/mllib.R b/R/pkg/R/mllib.R index

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

2016-07-01 Thread shivaram
tch tested? Added test cases for gapplyCollect similar to dapplyCollect Author: Narine Kokhlikyan <nar...@slice.com> Closes #13760 from NarineK/gapplyCollect. (cherry picked from commit 26afb4ce4099e7942f8db1ead3817ed8fbf71ce3) Signed-off-by: Shivaram Venkataraman <shiva...@cs.berkeley.ed

spark git commit: [SPARK-16012][SPARKR] Implement gapplyCollect which will apply a R function on each group similar to gapply and collect the result back to R data.frame

2016-07-01 Thread shivaram
-0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Fri Jul 1 13:55:13 2016 -0700 -- R/pkg/NAMESPACE | 1 + R/pkg/R/DataFrame.R | 111 +

spark git commit: [MINOR][SPARKR] spark.glm weightCol should in the signature.

2016-08-16 Thread shivaram
/d37ea3c0 Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/d37ea3c0 Branch: refs/heads/master Commit: d37ea3c09c054f2cc1305b2520ff46b2c0e58704 Parents: 12a89e5 Author: Yanbo Liang <yblia...@gmail.com> Authored: Tue Aug 16 10:52:35 2016 -0700 Committer: Shivaram Venkataraman <shiva.

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
ons (hence the problem) so after the renames we need to add new generics, for now. unit tests Author: Felix Cheung <felixcheun...@hotmail.com> Closes #14626 from felixcheung/rrddfunctions. (cherry picked from commit c34b546d674ce186f13db97977bc281cfedf) Signed-off-by: Shivaram Venkataram

spark git commit: [SPARK-16508][SPARKR] Split docs for arrange and orderBy methods

2016-08-15 Thread shivaram
er Commit: 564fe614c11deb657e0ac9e6b75e65370c48b7fe Parents: 3d8bfe7 Author: Junyang Qian <junya...@databricks.com> Authored: Mon Aug 15 11:03:03 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Mon Aug 1

spark git commit: [SPARK-16519][SPARKR] Handle SparkR RDD generics that create warnings in R CMD check

2016-08-16 Thread shivaram
er Commit: c34b546d674ce186f13db97977bc281cfedf Parents: d37ea3c Author: Felix Cheung <felixcheun...@hotmail.com> Authored: Tue Aug 16 11:19:18 2016 -0700 Committer: Shivaram Venkataraman <shiva...@cs.berkeley.edu> Committed: Tue Aug 16 11:19:18 2016 -0700

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
ache.org/repos/asf/spark/commit/a7ab6f9a Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7ab6f9a Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/a7ab6f9a Branch: refs/heads/master Commit: a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223 Parents: 385d738 Author: Felix Cheung <felixcheun...

spark git commit: [SPARK-19324][SPARKR] Spark VJM stdout output is getting dropped in SparkR

2017-01-27 Thread shivaram
xamples with calls of `println` in Scala/JVM side, that are getting dropped. ## How was this patch tested? manual Author: Felix Cheung <felixcheun...@hotmail.com> Closes #16670 from felixcheung/rjvmstdout. (cherry picked from commit a7ab6f9a8fdfb927f0bcefdc87a92cc82fac4223) Signed-off-by: Shi

<    1   2   3   4   5   >