[GitHub] packtpartner commented on issue #172: Update documentation.md

2019-01-16 Thread GitBox
packtpartner commented on issue #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172#issuecomment-454746306 We have added a new book listing like the previous ones. This is an automated message

[spark] 01/01: Preparing Spark release v2.3.3-rc1

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to tag v2.3.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit b5ea9330e3072e99841270b10dc1d2248127064b Author: Takeshi Yamamuro AuthorDate: Wed Jan 16 13:21:25 2019 +

[spark] tag v2.3.3-rc1 deleted (was 2e01a70)

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to tag v2.3.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git. *** WARNING: tag v2.3.3-rc1 was deleted! *** was 2e01a70 Preparing Spark release v2.3.3-rc1 The revisions that were

[spark] 01/01: Preparing development version 2.3.4-SNAPSHOT

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 8319ba736c8909aa944e28d1c8de501926e9f50f Author: Takeshi Yamamuro AuthorDate: Wed Jan 16 13:22:01 2019 +

[spark] branch branch-2.3 updated (18c138b -> 8319ba7)

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git. from 18c138b Revert "[SPARK-26576][SQL] Broadcast hint not applied to partitioned table" add b5ea933

[spark] branch branch-2.3 updated (1979712 -> 18c138b)

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git. omit 1979712 [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests omit

[spark] 02/02: Revert "[SPARK-26576][SQL] Broadcast hint not applied to partitioned table"

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 18c138bf01cd43edc6db7115b90c4e7ae7126392 Author: Takeshi Yamamuro AuthorDate: Wed Jan 16 21:56:39 2019 +0900

[spark] 01/02: [SPARK-26120][TESTS][SS][SPARKR] Fix a streaming query leak in Structured Streaming R tests

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 2a82295bd4b904f50d42a7585a72f91fff75353d Author: Shixiong Zhu AuthorDate: Wed Nov 21 09:31:12 2018 +0800

[spark] tag v2.3.3-rc1 created (now b5ea933)

2019-01-16 Thread yamamuro
This is an automated email from the ASF dual-hosted git repository. yamamuro pushed a change to tag v2.3.3-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git. at b5ea933 (commit) This tag includes the following new commits: new b5ea933 Preparing Spark release

[spark] branch branch-2.3 updated: [SPARK-26629][SS] Fixed error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread zsxwing
This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new 5a50ae3 [SPARK-26629][SS] Fixed error

[spark] branch master updated: [SPARK-26629][SS] Fixed error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread zsxwing
This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 06d5b17 [SPARK-26629][SS] Fixed error with

svn commit: r31990 - in /dev/spark/2.3.4-SNAPSHOT-2019_01_16_08_01-8319ba7-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 16:16:52 2019 New Revision: 31990 Log: Apache Spark 2.3.4-SNAPSHOT-2019_01_16_08_01-8319ba7 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch branch-2.3 updated: Revert "[SPARK-26629][SS] Fixed error with multiple file stream in a query + restart on a batch that has no data for one file stream"

2019-01-16 Thread zsxwing
This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch branch-2.3 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.3 by this push: new c0fc6d0 Revert "[SPARK-26629][SS]

[spark] branch branch-2.4 updated: [SPARK-26615][CORE] Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 22ab94f [SPARK-26615][CORE] Fixing

svn commit: r31991 - in /dev/spark/2.4.1-SNAPSHOT-2019_01_16_08_02-3337477-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 16:18:15 2019 New Revision: 31991 Log: Apache Spark 2.4.1-SNAPSHOT-2019_01_16_08_02-3337477 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch master updated: [SPARK-26550][SQL] New built-in datasource - noop

2019-01-16 Thread hvanhovell
This is an automated email from the ASF dual-hosted git repository. hvanhovell pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 190814e [SPARK-26550][SQL] New built-in

[spark] branch branch-2.4 updated: [MINOR][PYTHON] Fix SQLContext to SparkSession in Python API main page

2019-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new e52acc2 [MINOR][PYTHON] Fix

[spark] branch master updated: [MINOR][PYTHON] Fix SQLContext to SparkSession in Python API main page

2019-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new e92088d [MINOR][PYTHON] Fix SQLContext to

[spark] branch master updated: [SPARK-26615][CORE] Fixing transport server/client resource leaks in the core unittests

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 819e5ea [SPARK-26615][CORE] Fixing transport

[spark] branch branch-2.4 updated: [SPARK-25992][PYTHON] Document SparkContext cannot be shared for multiprocessing

2019-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 3337477 [SPARK-25992][PYTHON]

[spark] branch branch-2.4 updated: [SPARK-26629][SS] Fixed error with multiple file stream in a query + restart on a batch that has no data for one file stream

2019-01-16 Thread zsxwing
This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 1843c16 [SPARK-26629][SS] Fixed error

[spark] branch master updated: [SPARK-25992][PYTHON] Document SparkContext cannot be shared for multiprocessing

2019-01-16 Thread gurwls223
This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 670bc55 [SPARK-25992][PYTHON] Document

svn commit: r31992 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_16_10_30-190814e-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 18:42:49 2019 New Revision: 31992 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_16_10_30-190814e docs [This commit notification would consist of 1777 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch master updated: [SPARK-26625] Add oauthToken to spark.redaction.regex

2019-01-16 Thread mcheah
This is an automated email from the ASF dual-hosted git repository. mcheah pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 01301d0 [SPARK-26625] Add oauthToken to

svn commit: r31993 - in /dev/spark/2.3.4-SNAPSHOT-2019_01_16_12_57-c0fc6d0-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 21:12:23 2019 New Revision: 31993 Log: Apache Spark 2.3.4-SNAPSHOT-2019_01_16_12_57-c0fc6d0 docs [This commit notification would consist of 1443 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch master updated: [SPARK-26619][SQL] Prune the unused serializers from SerializeFromObject

2019-01-16 Thread dbtsai
This is an automated email from the ASF dual-hosted git repository. dbtsai pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 8f17078 [SPARK-26619][SQL] Prune the unused

[spark] branch master updated: [SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream

2019-01-16 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new dc3b35c [SPARK-26633][REPL] Add

[spark] branch branch-2.4 updated: [SPARK-26633][REPL] Add ExecutorClassLoader.getResourceAsStream

2019-01-16 Thread lixiao
This is an automated email from the ASF dual-hosted git repository. lixiao pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new d608325 [SPARK-26633][REPL] Add

svn commit: r31994 - in /dev/spark/2.4.1-SNAPSHOT-2019_01_16_12_58-1843c16-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 21:14:11 2019 New Revision: 31994 Log: Apache Spark 2.4.1-SNAPSHOT-2019_01_16_12_58-1843c16 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r31996 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_16_15_24-dc3b35c-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Wed Jan 16 23:36:36 2019 New Revision: 31996 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_16_15_24-dc3b35c docs [This commit notification would consist of 1777 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch master updated: [MINOR][BUILD] ensure call to translate_component has correct number of arguments

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 4915cb3 [MINOR][BUILD] ensure call to

[GitHub] felixcheung commented on issue #172: Update documentation.md

2019-01-16 Thread GitBox
felixcheung commented on issue #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172#issuecomment-455042131 tbh, we don't list every book though. but if you'd like, you will need to run the command in the PR description to re-generate the HTML, otherwise the

svn commit: r32000 - in /dev/spark/2.4.1-SNAPSHOT-2019_01_16_17_46-d608325-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Thu Jan 17 02:01:07 2019 New Revision: 32000 Log: Apache Spark 2.4.1-SNAPSHOT-2019_01_16_17_46-d608325 docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch master updated: [SPARK-26466][CORE] Use ConfigEntry for hardcoded configs for submit categories.

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 38f0307 [SPARK-26466][CORE] Use ConfigEntry for

[spark] branch master updated: [SPARK-26600] Update spark-submit usage message

2019-01-16 Thread srowen
This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 272428d [SPARK-26600] Update spark-submit usage

svn commit: r32003 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_16_20_13-4915cb3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

2019-01-16 Thread pwendell
Author: pwendell Date: Thu Jan 17 04:25:17 2019 New Revision: 32003 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_16_20_13-4915cb3 docs [This commit notification would consist of 1778 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

svn commit: r32004 - /dev/spark/v2.3.3-rc1-docs/

2019-01-16 Thread yamamuro
Author: yamamuro Date: Thu Jan 17 04:51:37 2019 New Revision: 32004 Log: Removing RC artifacts. Removed: dev/spark/v2.3.3-rc1-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands,

svn commit: r32005 - /dev/spark/v2.3.3-rc1-bin/

2019-01-16 Thread yamamuro
Author: yamamuro Date: Thu Jan 17 04:53:00 2019 New Revision: 32005 Log: Removing RC artifacts. Removed: dev/spark/v2.3.3-rc1-bin/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands,

svn commit: r32006 - in /dev/spark/v2.3.3-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _site/api/java/org/apache/spark

2019-01-16 Thread yamamuro
Author: yamamuro Date: Thu Jan 17 05:16:42 2019 New Revision: 32006 Log: Apache Spark v2.3.3-rc1 docs [This commit notification would consist of 1447 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] Diff for: [GitHub] wangshuo128 closed pull request #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

2019-01-16 Thread GitBox
diff --git a/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java b/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java index 20d840baeaf6c..8d46671f9581a 100644 ---