: 98944a9734389cd4400516a1eb3afa5376f44927
Parents: 6f701ff
Author: Evan Sparks evan.spa...@gmail.com
Authored: Thu May 8 13:07:30 2014 -0700
Committer: Shivaram Venkataraman shiva...@eecs.berkeley.edu
Committed: Thu May 8 16:49:33 2014 -0700
: 5c5e7d5809d337ce41a7a90eb9201e12803aba48
Parents: c3f8b78
Author: Evan Sparks evan.spa...@gmail.com
Authored: Thu May 8 13:07:30 2014 -0700
Committer: Shivaram Venkataraman shiva...@eecs.berkeley.edu
Committed: Thu May 8 13:07:30 2014 -0700
--
examples
but are
currently missed from the JobLogger output. This patch adds these two fields.
~~Since this is a small change, I didn't create a JIRA. Let me know if I should
do that.~~
cc kayousterhout
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #1869 from shivaram/job-logger and squashes
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/2aca97c7
Branch: refs/heads/master
Commit: 2aca97c7cfdefea8b6f9dbb88951e9acdfd606d9
Parents: 76386e1
Author: Nicholas Chammas nicholas.cham...@gmail.com
Authored: Mon Nov 3 09:02:35 2014 -0800
Committer: Shivaram Venkataraman shiva
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Nov 5 20:45:35 2014 -0800
--
ec2/spark-ec2| 8 ++--
ec2/spark_ec2.py | 12 +++-
2 files changed, 17 insertions(+), 3 deletions
deploy.generic path absolutely
bcdf6a5 [Nicholas Chammas] fix typo
77871a2 [Nicholas Chammas] add clarifying comment
ce071fc [Nicholas Chammas] don't change working dir
(cherry picked from commit db45f5ad0368760dbeaa618a04f66ae9b2bed656)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
: 0ba3fdd5992cf09bd38303ebff34d2ed19e5e09b
Parents: b45059d
Author: hlin09 hlin0...@gmail.com
Authored: Mon Apr 13 20:43:24 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Apr 13 20:43:24 2015 -0700
--
R/pkg/R/RDD.R | 16
/diff/73db132b
Branch: refs/heads/master
Commit: 73db132bf503341c7a5cf9409351c282a8464175
Parents: 6220d93
Author: Sun Rui rui@intel.com
Authored: Thu Apr 23 16:08:14 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Thu Apr 23 16:08:14 2015 -0700
/spark/tree/ebb77b2a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ebb77b2a
Branch: refs/heads/master
Commit: ebb77b2aff085e71906b5de9d266ded89051af82
Parents: 6e57d57
Author: Sun Rui rui@intel.com
Authored: Fri Apr 24 11:00:19 2015 -0700
Committer: Shivaram Venkataraman shiva
-us.apache.org/repos/asf/spark/tree/caf0136e
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/caf0136e
Branch: refs/heads/master
Commit: caf0136ec5838cf5bf61f39a5b3474a505a6ae11
Parents: ebb77b2
Author: Sun Rui rui@intel.com
Authored: Fri Apr 24 12:52:07 2015 -0700
Committer: Shivaram Venkataraman
: 7078f6028bf012235c664b02ec3541cbb0a248a7
Parents: 998aac2
Author: Jeff Harrison jeffrharri...@gmail.com
Authored: Mon Apr 27 13:38:25 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Apr 27 13:38:25 2015 -0700
/ca9f4ebb
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/ca9f4ebb
Branch: refs/heads/master
Commit: ca9f4ebb8e510e521bf4df0331375ddb385fb9d2
Parents: ef82bdd
Author: hlin09 hlin0...@gmail.com
Authored: Mon Apr 27 15:04:37 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
/asf/spark/diff/008a60dd
Branch: refs/heads/master
Commit: 008a60dd371e76819d8e08ab638cac7b3a48c9fc
Parents: 65afd3c
Author: hqzizania qian.hu...@intel.com
Authored: Fri May 8 11:25:04 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Fri May 8 11:25:04 2015 -0700
Repository: spark
Updated Branches:
refs/heads/branch-1.4 75fed0ca4 - 4f01f5b56
http://git-wip-us.apache.org/repos/asf/spark/blob/4f01f5b5/R/pkg/R/generics.R
--
diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R
index
Repository: spark
Updated Branches:
refs/heads/master 65afd3ce8 - 008a60dd3
http://git-wip-us.apache.org/repos/asf/spark/blob/008a60dd/R/pkg/R/generics.R
--
diff --git a/R/pkg/R/generics.R b/R/pkg/R/generics.R
index
[hqzizania] remove the RDD docs from being built as a part of roxygen
(cherry picked from commit 008a60dd371e76819d8e08ab638cac7b3a48c9fc)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos
/asf/spark/tree/1c78f686
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1c78f686
Branch: refs/heads/master
Commit: 1c78f6866ebbcfb41d9875bfa3c0b9fa23b188bf
Parents: 35c9599
Author: Brendan Collins bcoll...@blueraster.com
Authored: Fri May 8 15:59:34 2015 -0700
Committer: Shivaram Venkataraman
/50da9e89
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/50da9e89
Branch: refs/heads/master
Commit: 50da9e89161faa0ecdc1feb3ffee6c822a742034
Parents: 9b6cf28
Author: qhuang qian.hu...@intel.com
Authored: Fri May 15 14:06:16 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
2a7d121 [qhuang] use a function name more familiar to R users
07aa72e [qhuang] Support math functions in R DataFrame
(cherry picked from commit 50da9e89161faa0ecdc1feb3ffee6c822a742034)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf
Repository: spark
Updated Branches:
refs/heads/master ef3fb801a - 55f553a97
[SPARK-6855] [SPARKR] Set R includes to get the right collate order.
This prevents tools like devtools::document creating invalid collate orders
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #5462
and StructField.
Author: cafreeman cfree...@alteryx.com
Author: Davies Liu dav...@databricks.com
Author: Zongheng Yang zonghen...@gmail.com
Author: Shivaram Venkataraman shivaram.venkatara...@gmail.com
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Author: Sun Rui rui@intel.com
Closes #5436
/diff/68ecdb7f
Branch: refs/heads/master
Commit: 68ecdb7f99ae30f7c04c33a47ab7f59a3836f2a4
Parents: 4740d6a
Author: Davies Liu dav...@databricks.com
Authored: Fri Apr 10 15:35:45 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Fri Apr 10 15:35:45 2015 -0700
+#' @aliases take,RDD,numeric-method
+setMethod(take,
+ signature(x = RDD, num = numeric),
+ function(x, num) {
+resList - list()
+index - -1
+jrdd - getJRDD(x)
+numPartitions - numPartitions(x)
+
+# TODO(shivaram): Collect more
improvements
Shivaram Venkataraman (shivaram) - RDD API, JVM Backend, Worker Internals
Zongheng Yang (concretevitamin) - RDD API, Pipelined RDDs, Examples and EC2
guide
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Author: Shivaram Venkataraman shivaram.venkatara...@gmail.com
Author: Zongheng Yang
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/NAMESPACE
--
diff --git a/R/pkg/NAMESPACE b/R/pkg/NAMESPACE
new file mode 100644
index 000..a354cdc
--- /dev/null
+++ b/R/pkg/NAMESPACE
@@ -0,0 +1,182 @@
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/R/pkg/R/context.R
--
diff --git a/R/pkg/R/context.R b/R/pkg/R/context.R
new file mode 100644
index 000..2fc0bb2
--- /dev/null
+++ b/R/pkg/R/context.R
@@ -0,0 +1,225 @@
Repository: spark
Updated Branches:
refs/heads/master 1b2aab8d5 - 2fe0a1aae
http://git-wip-us.apache.org/repos/asf/spark/blob/2fe0a1aa/core/src/main/scala/org/apache/spark/api/r/SerDe.scala
--
diff --git
May 19 16:45:52 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Tue May 19 16:45:52 2015 -0700
--
ec2/spark_ec2.py | 6 +-
1 file changed, 5 insertions(+), 1 deletion
Repository: spark
Updated Branches:
refs/heads/master ba4f8ca0d - 1a7b9ce80
[MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts
cc pwendell
P.S: I can't believe this was outdated all along ?
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6215 from shivaram/update-ec2-map
Repository: spark
Updated Branches:
refs/heads/branch-1.4 671a6bca5 - 0ed376afa
[MINOR] Add 1.3, 1.3.1 to master branch EC2 scripts
cc pwendell
P.S: I can't believe this was outdated all along ?
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6215 from shivaram/update-ec2
/repos/asf/spark/tree/708c63bb
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/708c63bb
Branch: refs/heads/master
Commit: 708c63bbbe9580eb774fe47e23ef61338103afda
Parents: d2a86eb
Author: Sun Rui rui@intel.com
Authored: Wed Jun 3 11:56:35 2015 -0700
Committer: Shivaram Venkataraman shiva
commits:
51ca48b [Sun Rui] [SPARK-8063][SPARKR] Spark master URL conflict between MASTER
env variable and --master command line option.
(cherry picked from commit 708c63bbbe9580eb774fe47e23ef61338103afda)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip
Repository: spark
Updated Branches:
refs/heads/branch-1.4 16748694b - c2c129073
[SPARK-8084] [SPARKR] Make SparkR scripts fail on error
cc shaneknapp pwendell JoshRosen
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6623 from shivaram/SPARK-8084 and squashes the following
Repository: spark
Updated Branches:
refs/heads/master 51898b515 - 0576c3c4f
[SPARK-8084] [SPARKR] Make SparkR scripts fail on error
cc shaneknapp pwendell JoshRosen
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6623 from shivaram/SPARK-8084 and squashes the following
/repos/asf/spark/diff/a5c52c1a
Branch: refs/heads/master
Commit: a5c52c1a3488b69bec19e460d2d1fdb0c9ada58d
Parents: 82870d5
Author: hqzizania qian.hu...@intel.com
Authored: Mon Jun 8 21:40:12 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Jun 8 21:40:12 2015 -0700
Repository: spark
Updated Branches:
refs/heads/branch-1.4 0ef2e9d35 - 3e3151e75
[SPARK-8085] [SPARKR] Support user-specified schema in read.df
cc davies sun-rui
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6620 from shivaram/sparkr-read-schema and squashes the following
Related to discussion in #6567
cc pwendell srowen -- Let me know if this looks better
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6593 from shivaram/sparkr-pom-cleanup and squashes the following
commits:
b282241 [Shivaram Venkataraman] Remove sparkr-docs from release script
to discussion in #6567
cc pwendell srowen -- Let me know if this looks better
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6593 from shivaram/sparkr-pom-cleanup and squashes the following
commits:
b282241 [Shivaram Venkataraman] Remove sparkr-docs from release script as well
Authored: Mon Jun 22 11:45:31 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Jun 22 11:45:31 2015 -0700
--
ec2/spark_ec2.py | 16 ++--
1 file changed, 14 insertions(+), 2 deletions
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Authored: Mon Jun 22 14:35:38 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Jun 22 14:35:38 2015 -0700
--
R/pkg/.lintr | 2 +-
1 file changed, 1
-Pro.local
Authored: Tue Jun 23 12:47:55 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Tue Jun 23 12:47:55 2015 -0700
--
R/pkg/inst/profile/shell.R | 16 +++-
1 file changed, 15
as the first argument. There does
not seem to be a good way to test these in R.
cc shivaram and davies
Author: Hossein hoss...@databricks.com
Closes #6889 from falaki/SPARK-8452 and squashes the following commits:
9ce9f1e [Hossein] Added basic tests to verify methods can be called and won't
throw errors
Repository: spark
Updated Branches:
refs/heads/branch-1.4 13802163d - 6abb4fc8a
[SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName
cc cafreeman
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #7022 from shivaram/sparkr-init-hotfix and squashes
Repository: spark
Updated Branches:
refs/heads/master 2519dcc33 - c392a9efa
[SPARK-8637] [SPARKR] [HOTFIX] Fix packages argument, sparkSubmitBinName
cc cafreeman
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #7022 from shivaram/sparkr-init-hotfix and squashes the following
: 42a1f716fa35533507784be5e9117a984a03e62d
Parents: 0818fde
Author: Stefano Parmesan s.parme...@gmail.com
Authored: Mon Jun 22 11:43:10 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Jun 22 11:43:10 2015 -0700
--
ec2
files
(cherry picked from commit 44fa7df64daa55bd6eb1f2c219a9701b34e1c2a3)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/25017948
Tree: http://git-wip-us.apache.org
: 44fa7df64daa55bd6eb1f2c219a9701b34e1c2a3
Parents: c4d2343
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Authored: Mon Jun 22 20:55:38 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Mon Jun 22 20:55:38 2015 -0700
: 78b31a2a630c2178987322d0221aeea183ec565f
Parents: 6abb4fc
Author: cafreeman cfree...@alteryx.com
Authored: Fri Jun 26 10:07:35 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Fri Jun 26 10:07:35 2015 -0700
--
R/pkg/inst/tests
78b31a2a630c2178987322d0221aeea183ec565f)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a56516fc
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a56516fc
Diff: http
Repository: spark
Updated Branches:
refs/heads/master 7a3c424ec - 004f57374
[SPARK-8495] [SPARKR] Add a `.lintr` file to validate the SparkR files and the
`lint-r` script
Thank Shivaram Venkataraman for your support. This is a prototype script to
validate the R files.
Author: Yu ISHIKAWA
: 31f48e5af887a9ccc9cea0218c36bf52bbf49d24
Parents: bba6699
Author: Nicholas Chammas nicholas.cham...@gmail.com
Authored: Wed Jun 24 11:20:51 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Jun 24 11:20:51 2015 -0700
--
ec2
/diff/43e66192
Branch: refs/heads/master
Commit: 43e66192f45a23f7232116e9f664158862df5015
Parents: 1173483
Author: Holden Karau hol...@pigscanfly.ca
Authored: Wed Jun 24 11:55:20 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Jun 24 11:55:20 2015 -0700
] refactor for testing
c818556 [Holden Karau] Add pakages to R
(cherry picked from commit 43e66192f45a23f7232116e9f664158862df5015)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf
://issues.apache.org/jira/browse/SPARK-5185).
cc shivaram
Author: cafreeman cfree...@alteryx.com
Closes #7001 from cafreeman/branch-1.4 and squashes the following commits:
8f81194 [cafreeman] Add missing license
31aedcf [cafreeman] Refactor test to call an external R script
2c22073 [cafreeman] Merge branch
://issues.apache.org/jira/browse/SPARK-5185).
cc shivaram
Author: cafreeman cfree...@alteryx.com
Closes #7001 from cafreeman/branch-1.4 and squashes the following commits:
8f81194 [cafreeman] Add missing license
31aedcf [cafreeman] Refactor test to call an external R script
2c22073 [cafreeman] Merge branch
Author: shivaram
Date: Thu Jun 11 16:59:48 2015
New Revision: 1684946
URL: http://svn.apache.org/r1684946
Log:
Add some more SparkR contributors
Modified:
spark/releases/_posts/2015-06-11-spark-release-1-4-0.md
spark/site/releases/spark-release-1-4-0.html
Modified: spark/releases/_posts
Repository: spark
Updated Branches:
refs/heads/master 1191c3efc - c8d551d54
[SPARK-8310] [EC2] Updates the master branch EC2 versions
Will send another PR for `branch-1.4`
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6764 from shivaram/SPARK-8310 and squashes the following
, REPL) use.
1. We should be consistent
2. I don't want to reconfigure Jenkins to accept a different file
shivaram
Author: andrewor14 and...@databricks.com
Author: Andrew Or and...@databricks.com
Closes #6807 from andrewor14/r-logs and squashes the following commits:
96005d2 [andrewor14] Nest
Author: shivaram
Date: Mon Jun 15 16:05:17 2015
New Revision: 1685612
URL: http://svn.apache.org/r1685612
Log:
Add html for R update
Modified:
spark/site/index.html
Modified: spark/site/index.html
URL:
http://svn.apache.org/viewvc/spark/site/index.html?rev=1685612r1=1685611r2=1685612view
Author: shivaram
Date: Mon Jun 15 16:04:31 2015
New Revision: 1685610
URL: http://svn.apache.org/r1685610
Log:
Add R to list of supported languages
Modified:
spark/index.md
Modified: spark/index.md
URL:
http://svn.apache.org/viewvc/spark/index.md?rev=1685610r1=1685609r2=1685610view=diff
Authored: Fri Jun 12 10:28:30 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Fri Jun 12 10:28:30 2015 -0700
--
ec2/spark_ec2.py | 3 ++-
1 file changed, 2 insertions(+), 1 deletion
to readMap(). Add alias na.omit() for
dropna().
41cf725 [Sun Rui] [SPARK-7227][SPARKR] Support fillna / dropna in R DataFrame.
(cherry picked from commit 46576ab303e50c54c3bd464f8939953efe644574)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org
/spark/tree/46576ab3
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/46576ab3
Branch: refs/heads/master
Commit: 46576ab303e50c54c3bd464f8939953efe644574
Parents: 866652c
Author: Sun Rui rui@intel.com
Authored: Sun May 31 15:01:21 2015 -0700
Committer: Shivaram Venkataraman shiva
Repository: spark
Updated Branches:
refs/heads/branch-1.4 f5a9833f3 - cbfb682ab
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
This prevents the spark.jars from being cleared while using `--packages` or
`--jars`
cc pwendell davies brkyvz
Author: Shivaram Venkataraman shiva
Repository: spark
Updated Branches:
refs/heads/master 15d7c90ae - 6b44278ef
[SPARK-8028] [SPARKR] Use addJar instead of setJars in SparkR
This prevents the spark.jars from being cleared while using `--packages` or
`--jars`
cc pwendell davies brkyvz
Author: Shivaram Venkataraman shiva
for building the release. Let me know if you
need help with that.
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6567 from shivaram/SPARK-8027 and squashes the following commits:
8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also
use that profile in create
for building the release. Let me know if you
need help with that.
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6567 from shivaram/SPARK-8027 and squashes the following commits:
8dc8ecf [Shivaram Venkataraman] Add maven profile to build R package docs Also
use that profile
@intel.com
Authored: Wed Jul 1 09:50:12 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Jul 1 09:50:12 2015 -0700
--
R/pkg/inst/tests/test_binaryFile.R | 2 +-
R/pkg/inst/tests
. Warmerdam vincentwarmer...@gmail.com
Authored: Sun Jun 28 13:33:33 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Sun Jun 28 13:33:33 2015 -0700
--
ec2/spark_ec2.py | 2 ++
1 file changed, 2 insertions
-0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Sun Jul 5 20:50:02 2015 -0700
--
R/pkg/R/generics.R | 3 ++-
R/pkg/R/pairRDD.R | 12 ++--
R/pkg/R/sparkR.R
Repository: spark
Updated Branches:
refs/heads/branch-1.4 8d6d8a538 - fbc4480d9
[HOTFIX] Copy SparkR lib if it exists in make-distribution
This is to fix an issue reported in #6373 where the `cp` would fail if
`-Psparkr` was not used in the build
cc dragos pwendell
Author: Shivaram
Repository: spark
Updated Branches:
refs/heads/master 2b7e63585 - b231baa24
[HOTFIX] Copy SparkR lib if it exists in make-distribution
This is to fix an issue reported in #6373 where the `cp` would fail if
`-Psparkr` was not used in the build
cc dragos pwendell
Author: Shivaram
(CentOS), Windows VM and
vice-versa (built on Linux run on Mac)
I will also test this with YARN soon and update this PR.
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6373 from shivaram/sparkr-binary and squashes the following commits:
ae41b5c [Shivaram Venkataraman] Remove native
(CentOS), Windows VM and
vice-versa (built on Linux run on Mac)
I will also test this with YARN soon and update this PR.
Author: Shivaram Venkataraman shiva...@cs.berkeley.edu
Closes #6373 from shivaram/sparkr-binary and squashes the following commits:
ae41b5c [Shivaram Venkataraman] Remove
Repository: spark
Updated Branches:
refs/heads/branch-1.4 b928db4fe - c636b87dc
[SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide
sqlCtx - sqlContext
You can check the docs by:
```
$ cd docs
$ SKIP_SCALADOC=1 jekyll serve
```
cc shivaram
Author: Davies Liu dav
Repository: spark
Updated Branches:
refs/heads/master 4583cf4be - 7af3818c6
[SPARK-6806] [SPARKR] [DOCS] Fill in SparkR examples in programming guide
sqlCtx - sqlContext
You can check the docs by:
```
$ cd docs
$ SKIP_SCALADOC=1 jekyll serve
```
cc shivaram
Author: Davies Liu dav
to binary mode
(cherry picked from commit 83a621a5a8f8a2991c4cfa687279589e5c623d46)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/70beb808
Tree: http://git-wip
/branch-1.4
Commit: 83a621a5a8f8a2991c4cfa687279589e5c623d46
Parents: bf8b47d
Author: Simon Hafner hafnersi...@gmail.com
Authored: Tue Jul 7 09:42:59 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Tue Jul 7 09:42:59 2015 -0700
Repository: spark
Updated Branches:
refs/heads/master 8cb415a4b - 712f5b7a9
[SPARK-9318] [SPARK-9320] [SPARKR] Aliases for merge and summary functions on
DataFrames
This PR adds synonyms for ```merge``` and ```summary``` in SparkR DataFrame API.
cc shivaram
Author: Hossein hoss
yuu.ishik...@gmail.com
Authored: Wed Aug 12 18:33:27 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Aug 12 18:33:27 2015 -0700
--
R/pkg/DESCRIPTION| 1 +
R/pkg/R/column.R
)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/ca39c9e9
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/ca39c9e9
Diff: http://git-wip-us.apache.org/repos/asf
Repository: spark
Updated Branches:
refs/heads/master d7053bea9 - 2fb4901b7
[SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands
from codebase
sparkr.zip is now built by SparkSubmit on a need-to-build basis.
cc shivaram
Author: Burak Yavuz brk...@gmail.com
Repository: spark
Updated Branches:
refs/heads/branch-1.5 af470a757 - 3d1b9f007
[SPARK-9916] [BUILD] [SPARKR] removed left-over sparkr.zip copy/create commands
from codebase
sparkr.zip is now built by SparkSubmit on a need-to-build basis.
cc shivaram
Author: Burak Yavuz brk...@gmail.com
: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Sun Aug 16 00:30:02 2015 -0700
--
R/pkg/R/deserialize.R| 16 ++--
R/pkg/inst/tests/test_sparkSQL.R | 20
2 files changed, 30
) {
does not take into consideration the case where numRows = 0.
Will add unit test case.
Author: Sun Rui rui@intel.com
Closes #7419 from sun-rui/SPARK-8844.
(cherry picked from commit 5f9ce738fe6bab3f0caffad0df1d3876178cf469)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
: 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c
Parents: f3e1779
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Authored: Wed Aug 19 10:41:14 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Aug 19 10:41:14 2015 -0700
--
R/pkg/NAMESPACE
commit 2fcb9cb9552dac1d78dcca5d4d5032b4fa6c985c)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a8e88081
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a8e88081
/spark/diff/d898c33f
Branch: refs/heads/master
Commit: d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58
Parents: 28a9846
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Authored: Wed Aug 19 12:39:37 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Wed Aug 19 12:39:37 2015 -0700
yuu.ishik...@gmail.com
Closes #8303 from yu-iskw/SPARK-10106.
(cherry picked from commit d898c33f774b9a3db2fb6aa8f0cb2c2ac6004b58)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf
-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/0a1385e3
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/0a1385e3
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff
...@gmail.com
Authored: Tue Aug 18 19:18:05 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Tue Aug 18 19:18:05 2015 -0700
--
R/pkg/R/functions.R | 4 +++-
1 file changed, 3 insertions(+), 1 deletion
doesn't support a feature like method chaining,
`otherwise(when(condition, value), value)` style is a little annoying for me.
If `%otherwise%` looks strange for shivaram, I can remove it. What do you think?
### JIRA
[[SPARK-10075] Add `when` expressino function in SparkR - ASF
JIRA](https
doesn't support a feature like method chaining,
`otherwise(when(condition, value), value)` style is a little annoying for me.
If `%otherwise%` looks strange for shivaram, I can remove it. What do you think?
### JIRA
[[SPARK-10075] Add `when` expressino function in SparkR - ASF
JIRA](https
39e91fe2fd43044cc734d55625a3c03284b69f09)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/a7027e6d
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/a7027e6d
Diff: http://git-wip
: Alex Shkurenko ashkure...@enova.com
Authored: Thu Aug 20 10:16:38 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Thu Aug 20 10:16:38 2015 -0700
--
core/src/main/scala/org/apache/spark/api/r
Repository: spark
Updated Branches:
refs/heads/master badf7fa65 - 04e0fea79
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein hoss...@databricks.com
Closes #8291 from falaki
Repository: spark
Updated Branches:
refs/heads/branch-1.5 4ee225af8 - 9b42e2404
Bump SparkR version string to 1.5.0
This patch is against master, but we need to apply it to 1.5 branch as well.
cc shivaram and rxin
Author: Hossein hoss...@databricks.com
Closes #8291 from falaki
/1968276a
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/1968276a
Branch: refs/heads/master
Commit: 1968276af0f681fe51328b7dd795bd21724a5441
Parents: 5723d26
Author: Yuu ISHIKAWA yuu.ishik...@gmail.com
Authored: Tue Aug 18 09:10:59 2015 -0700
Committer: Shivaram Venkataraman shiva
://issues.apache.org/jira/browse/SPARK-10007)
Author: Yuu ISHIKAWA yuu.ishik...@gmail.com
Closes #8277 from yu-iskw/SPARK-10007.
(cherry picked from commit 1968276af0f681fe51328b7dd795bd21724a5441)
Signed-off-by: Shivaram Venkataraman shiva...@cs.berkeley.edu
Project: http://git-wip-us.apache.org/repos/asf
-us.apache.org/repos/asf/spark/diff/fc0e57e5
Branch: refs/heads/master
Commit: fc0e57e5aba82a3f227fef05a843283e2ec893fc
Parents: 6bba750
Author: Yu ISHIKAWA yuu.ishik...@gmail.com
Authored: Fri Jul 31 09:33:38 2015 -0700
Committer: Shivaram Venkataraman shiva...@cs.berkeley.edu
Committed: Fri Jul 31
1 - 100 of 491 matches
Mail list logo