spark git commit: [SPARK-17807][CORE] split test-tags into test-JAR

Repository: spark Updated Branches: refs/heads/branch-2.0 2d72160d3 -> 30e6d460d [SPARK-17807][CORE] split test-tags into test-JAR Remove spark-tag's compile-scope dependency (and, indirectly, spark-core's compile-scope transitive-dependency) on scalatest by splitting test-oriented tags

spark git commit: [SPARK-18972][CORE] Fix the netty thread names for RPC

Repository: spark Updated Branches: refs/heads/branch-2.0 542be408a -> 2d72160d3 [SPARK-18972][CORE] Fix the netty thread names for RPC ## What changes were proposed in this pull request? Right now the name of threads created by Netty for Spark RPC are `shuffle-client-**` and

spark git commit: [SPARK-18972][CORE] Fix the netty thread names for RPC

Repository: spark Updated Branches: refs/heads/branch-2.1 5e8010349 -> 1857acc71 [SPARK-18972][CORE] Fix the netty thread names for RPC ## What changes were proposed in this pull request? Right now the name of threads created by Netty for Spark RPC are `shuffle-client-**` and

spark git commit: [SPARK-18972][CORE] Fix the netty thread names for RPC

Repository: spark Updated Branches: refs/heads/master 2246ce88a -> f252cb5d1 [SPARK-18972][CORE] Fix the netty thread names for RPC ## What changes were proposed in this pull request? Right now the name of threads created by Netty for Spark RPC are `shuffle-client-**` and

spark git commit: [SPARK-18985][SS] Add missing @InterfaceStability.Evolving for Structured Streaming APIs

Repository: spark Updated Branches: refs/heads/master ce99f51d2 -> 2246ce88a [SPARK-18985][SS] Add missing @InterfaceStability.Evolving for Structured Streaming APIs ## What changes were proposed in this pull request? Add missing InterfaceStability.Evolving for Structured Streaming APIs ##

spark git commit: [SPARK-18985][SS] Add missing @InterfaceStability.Evolving for Structured Streaming APIs

Repository: spark Updated Branches: refs/heads/branch-2.1 132f22971 -> 5e8010349 [SPARK-18985][SS] Add missing @InterfaceStability.Evolving for Structured Streaming APIs ## What changes were proposed in this pull request? Add missing InterfaceStability.Evolving for Structured Streaming APIs

spark git commit: [SPARK-17807][CORE] split test-tags into test-JAR

Repository: spark Updated Branches: refs/heads/branch-2.1 f6853b3e5 -> 132f22971 [SPARK-17807][CORE] split test-tags into test-JAR Remove spark-tag's compile-scope dependency (and, indirectly, spark-core's compile-scope transitive-dependency) on scalatest by splitting test-oriented tags

[14/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index.html -- diff --git a/site/docs/2.1.0/api/java/index.html b/site/docs/2.1.0/api/java/index.html new file mode 100644 index

[43/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/crossJoin.html -- diff --git a/site/docs/2.1.0/api/R/crossJoin.html b/site/docs/2.1.0/api/R/crossJoin.html new file mode 100644 index

[15/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/index-all.html -- diff --git a/site/docs/2.1.0/api/java/index-all.html b/site/docs/2.1.0/api/java/index-all.html new file mode 100644

[47/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/approxCountDistinct.html -- diff --git a/site/docs/2.1.0/api/R/approxCountDistinct.html b/site/docs/2.1.0/api/R/approxCountDistinct.html new

[01/51] [partial] spark-website git commit: Add docs for 2.1.0

Repository: spark-website Updated Branches: refs/heads/asf-site a82adf043 -> 066dfa274 http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkJobInfo.html -- diff

[05/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/RangePartitioner.html

[31/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/randomSplit.html -- diff --git a/site/docs/2.1.0/api/R/randomSplit.html b/site/docs/2.1.0/api/R/randomSplit.html new file mode 100644 index

[25/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/sparkR.callJStatic.html -- diff --git a/site/docs/2.1.0/api/R/sparkR.callJStatic.html b/site/docs/2.1.0/api/R/sparkR.callJStatic.html new

[16/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/constant-values.html -- diff --git a/site/docs/2.1.0/api/java/constant-values.html b/site/docs/2.1.0/api/java/constant-values.html new

[39/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/floor.html -- diff --git a/site/docs/2.1.0/api/R/floor.html b/site/docs/2.1.0/api/R/floor.html new file mode 100644 index 000..2dfc290

[04/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkConf.html

[38/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/greatest.html -- diff --git a/site/docs/2.1.0/api/R/greatest.html b/site/docs/2.1.0/api/R/greatest.html new file mode 100644 index

[20/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.df.html -- diff --git a/site/docs/2.1.0/api/R/write.df.html b/site/docs/2.1.0/api/R/write.df.html new file mode 100644 index

[06/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/JobExecutionStatus.html

[02/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkEnv.html

[35/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/locate.html -- diff --git a/site/docs/2.1.0/api/R/locate.html b/site/docs/2.1.0/api/R/locate.html new file mode 100644 index

[44/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/conv.html -- diff --git a/site/docs/2.1.0/api/R/conv.html b/site/docs/2.1.0/api/R/conv.html new file mode 100644 index 000..b7f1a82 ---

[49/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00Index.html -- diff --git a/site/docs/2.1.0/api/R/00Index.html b/site/docs/2.1.0/api/R/00Index.html new file mode 100644 index

[10/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/CleanAccum.html

[34/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/merge.html -- diff --git a/site/docs/2.1.0/api/R/merge.html b/site/docs/2.1.0/api/R/merge.html new file mode 100644 index 000..9ebbee4

[40/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/explain.html -- diff --git a/site/docs/2.1.0/api/R/explain.html b/site/docs/2.1.0/api/R/explain.html new file mode 100644 index

[07/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/InternalAccumulator.html

[13/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/lib/jquery.js -- diff --git a/site/docs/2.1.0/api/java/lib/jquery.js b/site/docs/2.1.0/api/java/lib/jquery.js new file mode 100644 index

[19/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/write.parquet.html -- diff --git a/site/docs/2.1.0/api/R/write.parquet.html b/site/docs/2.1.0/api/R/write.parquet.html new file mode 100644

[37/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ifelse.html -- diff --git a/site/docs/2.1.0/api/R/ifelse.html b/site/docs/2.1.0/api/R/ifelse.html new file mode 100644 index

[17/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-noframe.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-noframe.html

[21/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/var_pop.html -- diff --git a/site/docs/2.1.0/api/R/var_pop.html b/site/docs/2.1.0/api/R/var_pop.html new file mode 100644 index

[23/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/summary.html -- diff --git a/site/docs/2.1.0/api/R/summary.html b/site/docs/2.1.0/api/R/summary.html new file mode 100644 index

[42/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/datediff.html -- diff --git a/site/docs/2.1.0/api/R/datediff.html b/site/docs/2.1.0/api/R/datediff.html new file mode 100644 index

[48/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/00frame_toc.html -- diff --git a/site/docs/2.1.0/api/R/00frame_toc.html b/site/docs/2.1.0/api/R/00frame_toc.html new file mode 100644 index

[11/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/AccumulatorParam.IntAccumulatorParam$.html -- diff --git

[41/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/dropDuplicates.html -- diff --git a/site/docs/2.1.0/api/R/dropDuplicates.html b/site/docs/2.1.0/api/R/dropDuplicates.html new file mode

[24/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/struct.html -- diff --git a/site/docs/2.1.0/api/R/struct.html b/site/docs/2.1.0/api/R/struct.html new file mode 100644 index

[18/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/allclasses-frame.html -- diff --git a/site/docs/2.1.0/api/java/allclasses-frame.html b/site/docs/2.1.0/api/java/allclasses-frame.html new

[22/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/translate.html -- diff --git a/site/docs/2.1.0/api/R/translate.html b/site/docs/2.1.0/api/R/translate.html new file mode 100644 index

[50/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/README.md -- diff --git a/site/docs/2.1.0/README.md b/site/docs/2.1.0/README.md new file mode 100644 index 000..ffd3b57 --- /dev/null +++

[45/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/ceil.html -- diff --git a/site/docs/2.1.0/api/R/ceil.html b/site/docs/2.1.0/api/R/ceil.html new file mode 100644 index 000..7c1c73c ---

[30/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/registerTempTable-deprecated.html -- diff --git a/site/docs/2.1.0/api/R/registerTempTable-deprecated.html

[46/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/attach.html -- diff --git a/site/docs/2.1.0/api/R/attach.html b/site/docs/2.1.0/api/R/attach.html new file mode 100644 index

[12/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/Accumulable.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/Accumulable.html

[03/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/SparkContext.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/SparkContext.html

[08/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/ExecutorRemoved.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/ExecutorRemoved.html

[36/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/join.html -- diff --git a/site/docs/2.1.0/api/R/join.html b/site/docs/2.1.0/api/R/join.html new file mode 100644 index 000..b01ef1c ---

[09/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/java/org/apache/spark/ComplexFutureAction.html -- diff --git a/site/docs/2.1.0/api/java/org/apache/spark/ComplexFutureAction.html

[26/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/spark.gaussianMixture.html -- diff --git a/site/docs/2.1.0/api/R/spark.gaussianMixture.html

[27/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/show.html -- diff --git a/site/docs/2.1.0/api/R/show.html b/site/docs/2.1.0/api/R/show.html new file mode 100644 index 000..5adbc9a ---

[29/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/rpad.html -- diff --git a/site/docs/2.1.0/api/R/rpad.html b/site/docs/2.1.0/api/R/rpad.html new file mode 100644 index 000..6f6f15f ---

[28/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/select.html -- diff --git a/site/docs/2.1.0/api/R/select.html b/site/docs/2.1.0/api/R/select.html new file mode 100644 index

[32/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/persist.html -- diff --git a/site/docs/2.1.0/api/R/persist.html b/site/docs/2.1.0/api/R/persist.html new file mode 100644 index

[33/51] [partial] spark-website git commit: Add docs for 2.1.0

http://git-wip-us.apache.org/repos/asf/spark-website/blob/066dfa27/site/docs/2.1.0/api/R/nanvl.html -- diff --git a/site/docs/2.1.0/api/R/nanvl.html b/site/docs/2.1.0/api/R/nanvl.html new file mode 100644 index 000..3bceb0c

svn commit: r17546 - /dev/spark/spark-2.1.0/ /release/spark/spark-2.1.0/

Author: rxin Date: Thu Dec 22 22:03:22 2016 New Revision: 17546 Log: Spark 2.1.0 Added: release/spark/spark-2.1.0/ - copied from r17545, dev/spark/spark-2.1.0/ Removed: dev/spark/spark-2.1.0/ - To unsubscribe,

svn commit: r17545 - /dev/spark/spark-2.1.0/

Author: rxin Date: Thu Dec 22 21:58:11 2016 New Revision: 17545 Log: add spark 2.1.0 Added: dev/spark/spark-2.1.0/ dev/spark/spark-2.1.0/spark-2.1.0-bin-hadoop2.3.tgz (with props) dev/spark/spark-2.1.0/spark-2.1.0-bin-hadoop2.3.tgz.asc

spark git commit: [SPARK-18537][WEB UI] Add a REST api to serve spark streaming information

Repository: spark Updated Branches: refs/heads/master 31da755c8 -> ce99f51d2 [SPARK-18537][WEB UI] Add a REST api to serve spark streaming information ## What changes were proposed in this pull request? This PR is an inheritance from #16000, and is a completion of #15904. **Description** -

spark git commit: [SPARK-18975][CORE] Add an API to remove SparkListener

Repository: spark Updated Branches: refs/heads/master 261510005 -> 31da755c8 [SPARK-18975][CORE] Add an API to remove SparkListener ## What changes were proposed in this pull request? In current Spark we could add customized SparkListener through `SparkContext#addListener` API, but there's

spark git commit: [SPARK-18973][SQL] Remove SortPartitions and RedistributeData

Repository: spark Updated Branches: refs/heads/branch-2.1 ec0d6e21e -> f6853b3e5 [SPARK-18973][SQL] Remove SortPartitions and RedistributeData ## What changes were proposed in this pull request? SortPartitions and RedistributeData logical operators are not actually used and can be removed.

spark git commit: [SPARK-18973][SQL] Remove SortPartitions and RedistributeData

Repository: spark Updated Branches: refs/heads/master 76622c661 -> 261510005 [SPARK-18973][SQL] Remove SortPartitions and RedistributeData ## What changes were proposed in this pull request? SortPartitions and RedistributeData logical operators are not actually used and can be removed. Note

spark git commit: [SPARK-18031][TESTS] Fix flaky test ExecutorAllocationManagerSuite.basic functionality

Repository: spark Updated Branches: refs/heads/branch-2.0 080ac37fb -> 542be408a [SPARK-18031][TESTS] Fix flaky test ExecutorAllocationManagerSuite.basic functionality ## What changes were proposed in this pull request? The failure is because in `test("basic functionality")`, it doesn't

spark git commit: [SPARK-16975][SQL][FOLLOWUP] Do not duplicately check file paths in data sources implementing FileFormat

Repository: spark Updated Branches: refs/heads/master 4186aba63 -> 76622c661 [SPARK-16975][SQL][FOLLOWUP] Do not duplicately check file paths in data sources implementing FileFormat ## What changes were proposed in this pull request? This PR cleans up duplicated checking for file paths in

spark git commit: [SPARK-18922][TESTS] Fix more resource-closing-related and path-related test failures in identified ones on Windows

Repository: spark Updated Branches: refs/heads/master f489339c7 -> 4186aba63 [SPARK-18922][TESTS] Fix more resource-closing-related and path-related test failures in identified ones on Windows ## What changes were proposed in this pull request? There are several tests failing due to

spark git commit: [SPARK-18953][CORE][WEB UI] Do now show the link to a dead worker on the master page

Repository: spark Updated Branches: refs/heads/master 2e861df96 -> f489339c7 [SPARK-18953][CORE][WEB UI] Do now show the link to a dead worker on the master page ## What changes were proposed in this pull request? For a dead worker, we will not be able to see its worker page anyway. This PR