Repository: spark
Updated Branches:
refs/heads/branch-2.2 105ae8680 -> 7022ef800
[SPARK-23038][TEST] Update docker/spark-test (JDK/OS)
## What changes were proposed in this pull request?
This PR aims to update the followings in `docker/spark-test`.
- JDK7 -> JDK8
Spark 2.2+ supports JDK8 onl
Repository: spark
Updated Branches:
refs/heads/branch-2.3 1f4a08b15 -> a335a49ce
[SPARK-23038][TEST] Update docker/spark-test (JDK/OS)
## What changes were proposed in this pull request?
This PR aims to update the followings in `docker/spark-test`.
- JDK7 -> JDK8
Spark 2.2+ supports JDK8 onl
Repository: spark
Updated Branches:
refs/heads/master c3548d11c -> 7a3d0aad2
[SPARK-23038][TEST] Update docker/spark-test (JDK/OS)
## What changes were proposed in this pull request?
This PR aims to update the followings in `docker/spark-test`.
- JDK7 -> JDK8
Spark 2.2+ supports JDK8 only.
Author: pwendell
Date: Sun Jan 14 06:15:18 2018
New Revision: 24186
Log:
Apache Spark 2.3.1-SNAPSHOT-2018_01_13_22_01-1f4a08b docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master afae8f2bc -> c3548d11c
[SPARK-23063][K8S] K8s changes for publishing scripts (and a couple of other
misses)
## What changes were proposed in this pull request?
Including the `-Pkubernetes` flag in a few places it was missed.
## How was t
Repository: spark
Updated Branches:
refs/heads/branch-2.3 bcd87ae07 -> 1f4a08b15
[SPARK-23063][K8S] K8s changes for publishing scripts (and a couple of other
misses)
## What changes were proposed in this pull request?
Including the `-Pkubernetes` flag in a few places it was missed.
## How w
Author: pwendell
Date: Sun Jan 14 04:15:42 2018
New Revision: 24185
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_01_13_20_01-afae8f2 docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 0066d6f6f -> afae8f2bc
[SPARK-22959][PYTHON] Configuration to select the modules for daemon and worker
in PySpark
## What changes were proposed in this pull request?
We are now forced to use `pyspark/daemon.py` and `pyspark/worker.py` in
Author: pwendell
Date: Sun Jan 14 00:15:02 2018
New Revision: 24183
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_01_13_16_01-0066d6f docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Sat Jan 13 22:15:04 2018
New Revision: 24182
Log:
Apache Spark 2.3.1-SNAPSHOT-2018_01_13_14_01-bcd87ae docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/branch-2.3 0fc5533e5 -> bcd87ae07
[SPARK-21213][SQL][FOLLOWUP] Use compatible types for comparisons in
compareAndGetNewStats
## What changes were proposed in this pull request?
This pr fixed code to compare values in `compareAndGetNewStats`.
The
Repository: spark
Updated Branches:
refs/heads/master ba891ec99 -> 0066d6f6f
[SPARK-21213][SQL][FOLLOWUP] Use compatible types for comparisons in
compareAndGetNewStats
## What changes were proposed in this pull request?
This pr fixed code to compare values in `compareAndGetNewStats`.
The test
Author: pwendell
Date: Sat Jan 13 20:15:01 2018
New Revision: 24181
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_01_13_12_01-ba891ec docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/branch-2.3 8d32ed5f2 -> 0fc5533e5
[SPARK-22790][SQL] add a configurable factor to describe HadoopFsRelation's size
## What changes were proposed in this pull request?
as per discussion in
https://github.com/apache/spark/pull/19864#discussion_r15
Repository: spark
Updated Branches:
refs/heads/master bd4a21b48 -> ba891ec99
[SPARK-22790][SQL] add a configurable factor to describe HadoopFsRelation's size
## What changes were proposed in this pull request?
as per discussion in
https://github.com/apache/spark/pull/19864#discussion_r156847
Repository: spark
Updated Branches:
refs/heads/master fc6fe8a1d -> bd4a21b48
[SPARK-23036][SQL][TEST] Add withGlobalTempView for testing
## What changes were proposed in this pull request?
Add withGlobalTempView when create global temp view, like withTempView and
withView.
And correct some i
Repository: spark
Updated Branches:
refs/heads/branch-2.3 801ffd799 -> 8d32ed5f2
[SPARK-23036][SQL][TEST] Add withGlobalTempView for testing
## What changes were proposed in this pull request?
Add withGlobalTempView when create global temp view, like withTempView and
withView.
And correct so
Author: pwendell
Date: Sat Jan 13 18:15:26 2018
New Revision: 24180
Log:
Apache Spark 2.3.1-SNAPSHOT-2018_01_13_10_01-801ffd7 docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Author: pwendell
Date: Sat Jan 13 16:17:43 2018
New Revision: 24179
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_01_13_08_01-628a1ca docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Repository: spark
Updated Branches:
refs/heads/master 628a1ca5a -> fc6fe8a1d
[SPARK-22870][CORE] Dynamic allocation should allow 0 idle time
## What changes were proposed in this pull request?
This pr to make `0` as a valid value for
`spark.dynamicAllocation.executorIdleTimeout`.
For details
Repository: spark
Updated Branches:
refs/heads/branch-2.3 ca27d9cb5 -> 801ffd799
[SPARK-22870][CORE] Dynamic allocation should allow 0 idle time
## What changes were proposed in this pull request?
This pr to make `0` as a valid value for
`spark.dynamicAllocation.executorIdleTimeout`.
For det
Repository: spark
Updated Branches:
refs/heads/master cd9f49a2a -> 628a1ca5a
[SPARK-23043][BUILD] Upgrade json4s to 3.5.3
## What changes were proposed in this pull request?
Spark still use a few years old version 3.2.11. This change is to upgrade
json4s to 3.5.3.
Note that this change does
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/histogram.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/histogram.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/histogram.html Sat Jan 13 10:29:47
2018
@@ -0,0 +1,1
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/spark.glm.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/spark.glm.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/spark.glm.html Sat Jan 13 10:29:47
2018
@@ -0,0 +1,2
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/read.jdbc.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/read.jdbc.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/read.jdbc.html Sat Jan 13 10:29:47
2018
@@ -0,0 +1,1
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/eq_null_safe.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/eq_null_safe.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/eq_null_safe.html Sat Jan 13 10:29:47
2018
@@
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/column_datetime_functions.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/column_datetime_functions.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/column_datetime_funct
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/createOrReplaceTempView.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/createOrReplaceTempView.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/createOrReplaceTempView.h
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/mutate.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/mutate.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/mutate.html Sat Jan 13 10:29:47 2018
@@ -0,0 +1,135 @@
+htt
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/selectExpr.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/selectExpr.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/selectExpr.html Sat Jan 13 10:29:47
2018
@@ -0,0 +
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/toJSON.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/toJSON.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/toJSON.html Sat Jan 13 10:29:47 2018
@@ -0,0 +1,117 @@
+htt
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/awaitTermination.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/awaitTermination.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/awaitTermination.html Sat Jan 13
10:29
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/sparkR.conf.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/sparkR.conf.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/sparkR.conf.html Sat Jan 13 10:29:47
2018
@@ -0,
Added: dev/spark/v2.3.0-rc1-docs/_site/api/R/write.parquet.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/write.parquet.html (added)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/write.parquet.html Sat Jan 13
10:29:47 2018
Author: sameerag
Date: Sat Jan 13 10:29:47 2018
New Revision: 24178
Log:
Update R docs
Added:
dev/spark/v2.3.0-rc1-docs/_site/api/R/AFTSurvivalRegressionModel-class.html
dev/spark/v2.3.0-rc1-docs/_site/api/R/ALSModel-class.html
dev/spark/v2.3.0-rc1-docs/_site/api/R/BisectingKMeansMode
Author: pwendell
Date: Sat Jan 13 10:15:27 2018
New Revision: 24177
Log:
Apache Spark 2.3.1-SNAPSHOT-2018_01_13_02_01-ca27d9c docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/scheduler/SparkListener.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/scheduler/SparkListener.html
(original)
+++
dev/spark/v2.
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/expressions/javalang/package-summary.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/expressions/javalang/package-summary.h
Modified: dev/spark/v2.3.0-rc1-docs/_site/api/R/00Index.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/00Index.html (original)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/00Index.html Sat Jan 13 09:42:26 2018
@@ -19,5 +19,
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/classification/Classifier.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/classification/Classifier.html
(original)
+++
dev
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/streaming/api/java/package-tree.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/streaming/api/java/package-tree.html
(original)
++
Modified: dev/spark/v2.3.0-rc1-docs/_site/api/DESCRIPTION
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/DESCRIPTION (original)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/DESCRIPTION Sat Jan 13 09:42:26 2018
@@ -57,6 +57,6 @@ Col
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/param/shared/HasTol.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/param/shared/HasTol.html
(original)
+++
dev/spark/v2.3.
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/random/LogNormalGenerator.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/random/LogNormalGenerator.html
(original)
++
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/scala/org/apache/spark/internal/Logging.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/scala/org/apache/spark/internal/Logging.html
(original)
+++
dev/spark/v2.3.0-rc1-docs
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/sources/v2/SessionConfigSupport.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/sources/v2/SessionConfigSupport.html
(orig
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/feature/ChiSqSelector.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/feature/ChiSqSelector.html
(original)
+++
dev/s
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/types/ObjectType.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/sql/types/ObjectType.html
(original)
+++
dev/spark/v2.3.0-rc
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/graphx/util/BytecodeUtils.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/graphx/util/BytecodeUtils.html
(original)
+++
dev/spark
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/storage/BlockManagerMessages.GetLocations$.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/storage/BlockManagerMessages.GetLocation
Author: sameerag
Date: Sat Jan 13 09:42:26 2018
New Revision: 24176
Log:
Apache Spark v2.3.0-rc1 docs
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/DESCRIPTION
dev/spark/v2.3.0-rc1-docs/_site/api/R/00Index.html
dev/spark/v2.3.0-rc1-docs/_site/api/R/00frame_toc.html
dev/spark/v2.3.
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/security/GroupMappingServiceProvider.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/security/GroupMappingServiceProvider.html
(or
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/scala/org/apache/spark/sql/SparkSession$implicits$.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/scala/org/apache/spark/sql/SparkSession$implicits$.html
(original)
+++
dev
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/tree/impurity/Impurities.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/mllib/tree/impurity/Impurities.html
(original)
+++
Modified: dev/spark/v2.3.0-rc1-docs/_site/api/R/00frame_toc.html
==
--- dev/spark/v2.3.0-rc1-docs/_site/api/R/00frame_toc.html (original)
+++ dev/spark/v2.3.0-rc1-docs/_site/api/R/00frame_toc.html Sat Jan 13 09:42:26
2018
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/feature/RFormulaParser.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/feature/RFormulaParser.html
(original)
+++
dev/spark
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/api/java/JavaHadoopRDD.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/api/java/JavaHadoopRDD.html
(original)
+++
dev/spark/v2.3.
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/tree/impl/package-tree.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/ml/tree/impl/package-tree.html
(original)
+++
dev/spark
Modified:
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/util/MemoryParam.html
==
---
dev/spark/v2.3.0-rc1-docs/_site/api/java/org/apache/spark/util/MemoryParam.html
(original)
+++
dev/spark/v2.3.0-rc1-docs/_
Author: pwendell
Date: Sat Jan 13 08:16:25 2018
New Revision: 24175
Log:
Apache Spark 2.4.0-SNAPSHOT-2018_01_13_00_01-cd9f49a docs
[This commit notification would consist of 1440 parts,
which exceeds the limit of 50 ones, so it was shortened to the summary.]
---
60 matches
Mail list logo