[GitHub] packtpartner commented on issue #172: Update documentation.md

packtpartner commented on issue #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172#issuecomment-454746306 We have added a new book listing like the previous ones. This is an automated message

[spark] Diff for: [GitHub] dongjoon-hyun closed pull request #23291: [SPARK-26203][SQL][TEST] Benchmark performance of In and InSet expressions

diff --git a/sql/core/benchmarks/InExpressionBenchmark-results.txt b/sql/core/benchmarks/InExpressionBenchmark-results.txt new file mode 100644 index 0..d2adbded66149 --- /dev/null +++ b/sql/core/benchmarks/InExpressionBenchmark-results.txt @@ -0,0 +1,551 @@

[GitHub] srowen opened a new pull request #171: Remove old releases from download page. Remove unused 'stable' flag and old info

srowen opened a new pull request #171: Remove old releases from download page. Remove unused 'stable' flag and old info URL: https://github.com/apache/spark-website/pull/171 This is an automated message from the Apache Git

[spark] Diff for: [GitHub] liupc closed pull request #23537: [SPARK-26614]Fix speculation kill might cause job failure

diff --git a/core/src/main/scala/org/apache/spark/executor/Executor.scala b/core/src/main/scala/org/apache/spark/executor/Executor.scala index a30a501e5d4a1..f92ea7873f9ce 100644 --- a/core/src/main/scala/org/apache/spark/executor/Executor.scala +++

[GitHub] srowen commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

srowen commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247895304 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on issue #172: Update documentation.md

felixcheung commented on issue #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172#issuecomment-455042131 tbh, we don't list every book though. but if you'd like, you will need to run the command in the PR description to re-generate the HTML, otherwise the

[GitHub] srowen opened a new pull request #173: Tiny cleanup of merge script; use print()

srowen opened a new pull request #173: Tiny cleanup of merge script; use print() URL: https://github.com/apache/spark-website/pull/173 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] srowen closed pull request #173: Tiny cleanup of merge script; use print()

srowen closed pull request #173: Tiny cleanup of merge script; use print() URL: https://github.com/apache/spark-website/pull/173 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] HyukjinKwon commented on issue #174: More minor style fixes for merge script

HyukjinKwon commented on issue #174: More minor style fixes for merge script URL: https://github.com/apache/spark-website/pull/174#issuecomment-455832125 Thanks Sean and Felix! This is an automated message from the Apache Git

[GitHub] HyukjinKwon commented on issue #173: Tiny cleanup of merge script; use print()

HyukjinKwon commented on issue #173: Tiny cleanup of merge script; use print() URL: https://github.com/apache/spark-website/pull/173#issuecomment-455778698 Oops yea.will do tomorrow. This is an automated message from the

[GitHub] dongjoon-hyun merged pull request #170: Update 2.3.1 to use archive

dongjoon-hyun merged pull request #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, commits@spark.apache.org

[spark-website] Diff for: [GitHub] dongjoon-hyun merged pull request #170: Update 2.3.1 to use archive

diff --git a/js/downloads.js b/js/downloads.js index 560896909..1d4c1e77f 100644 --- a/js/downloads.js +++ b/js/downloads.js @@ -34,7 +34,7 @@ var packagesV9 = [hadoop2p7, hadoop2p6, hadoopFree, scala2p12_hadoopFree, source addRelease("2.4.0", new Date("11/02/2018"), packagesV9, true, true);

[GitHub] dongjoon-hyun commented on issue #171: Remove old releases from download page. Remove unused 'stable' flag and old info

dongjoon-hyun commented on issue #171: Remove old releases from download page. Remove unused 'stable' flag and old info URL: https://github.com/apache/spark-website/pull/171#issuecomment-454429410 Oh, I didn't see this PR. Could you rebase please?

[GitHub] dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive

dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170#issuecomment-454428520 Thank you, @HyukjinKwon . This is an automated message from the Apache Git

[GitHub] dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive

dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170#issuecomment-454428645 Merged. This is an automated message from the Apache Git Service. To respond to

[spark] Diff for: [GitHub] gatorsmile closed pull request #23535: [SPARK-26613][SQL] Add another rename table grammar for spark sql

diff --git a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 b/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 index b39681d886c5c..de18fc93cba2d 100644 --- a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

[spark] Diff for: [GitHub] asfgit closed pull request #23348: [SPARK-25857][core] Add developer documentation regarding delegation tokens.

diff --git a/core/src/main/scala/org/apache/spark/deploy/security/README.md b/core/src/main/scala/org/apache/spark/deploy/security/README.md new file mode 100644 index 0..c3ef60a231f0e --- /dev/null +++ b/core/src/main/scala/org/apache/spark/deploy/security/README.md @@ -0,0 +1,249 @@

[spark] Diff for: [GitHub] asfgit closed pull request #23511: [SPARK-26592][SS] Throw exception when kafka delegation token tried to obtain with proxy user

diff --git a/core/src/main/scala/org/apache/spark/deploy/security/KafkaTokenUtil.scala b/core/src/main/scala/org/apache/spark/deploy/security/KafkaTokenUtil.scala index aec0f72feb3c1..f3638533e1b7d 100644 --- a/core/src/main/scala/org/apache/spark/deploy/security/KafkaTokenUtil.scala +++

[spark] Diff for: [GitHub] srowen closed pull request #23447: [SPARK-26462][CORE] Use ConfigEntry for hardcoded configs for execution categories

diff --git a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala b/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala index ab0ae55ed357d..67f2c279dca5a 100644 --- a/core/src/main/scala/org/apache/spark/HeartbeatReceiver.scala +++

[spark] Diff for: [GitHub] gatorsmile closed pull request #23496: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL

diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala index cd321d41f43e8..20b1e1abce9c6 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala +++

[spark] Diff for: [GitHub] asfgit closed pull request #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md index 7040f8da2c614..88a772610578d 100644 --- a/docs/structured-streaming-kafka-integration.md +++ b/docs/structured-streaming-kafka-integration.md @@ -379,7 +379,25 @@ The following

[GitHub] srowen closed pull request #171: Remove old releases from download page. Remove unused 'stable' flag and old info

srowen closed pull request #171: Remove old releases from download page. Remove unused 'stable' flag and old info URL: https://github.com/apache/spark-website/pull/171 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list,

[spark-website] Diff for: [GitHub] srowen closed pull request #171: Remove old releases from download page. Remove unused 'stable' flag and old info

diff --git a/downloads.md b/downloads.md index 9cc5414a4..a4ae5f494 100644 --- a/downloads.md +++ b/downloads.md @@ -26,23 +26,6 @@ $(document).ready(function() { 4. Verify this release using the and [project release KEYS](https://www.apache.org/dist/spark/KEYS). -_Note: Starting version

[GitHub] srowen commented on issue #171: Remove old releases from download page. Remove unused 'stable' flag and old info

srowen commented on issue #171: Remove old releases from download page. Remove unused 'stable' flag and old info URL: https://github.com/apache/spark-website/pull/171#issuecomment-454599623 I merged this to ensure that the web page matches what is currently mirrored and in the archives.

[spark] Diff for: [GitHub] srowen closed pull request #17726: [SPARK-17928] [Mesos] No driver.memoryOverhead setting for mesos cluster mode

diff --git a/docs/configuration.md b/docs/configuration.md index ff9b802617f08..b961e5b2f32a6 100644 --- a/docs/configuration.md +++ b/docs/configuration.md @@ -169,7 +169,7 @@ of the most common options to set are: The amount of off-heap memory to be allocated per driver in cluster mode, in

[spark] Diff for: [GitHub] asfgit closed pull request #23208: [SPARK-25530][SQL] data source v2 API refactor (batch write)

diff --git a/sql/core/src/main/java/org/apache/spark/sql/sources/v2/BatchWriteSupportProvider.java b/sql/core/src/main/java/org/apache/spark/sql/sources/v2/BatchWriteSupportProvider.java deleted file mode 100644 index df439e2c02fe3..0 ---

[spark] Diff for: [GitHub] asfgit closed pull request #23544: [SPARK-26350][FOLLOWUP] Add actual verification on new UT introduced on SPARK-26350

diff --git a/external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala b/external/kafka-0-10-sql/src/test/scala/org/apache/spark/sql/kafka010/KafkaMicroBatchSourceSuite.scala index 64020882b306e..cb453846134ed 100644 ---

[spark] Diff for: [GitHub] cloud-fan closed pull request #23543: [SPARK-25935][SQL] Allow null rows for bad records from JSON/CSV parsers

diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R index a1805f57b1dcf..88f2286219525 100644 --- a/R/pkg/tests/fulltests/test_sparkSQL.R +++ b/R/pkg/tests/fulltests/test_sparkSQL.R @@ -1694,7 +1694,7 @@ test_that("column functions", { # check for

[spark] Diff for: [GitHub] cloud-fan closed pull request #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource

diff --git a/docs/sql-migration-guide-upgrade.md b/docs/sql-migration-guide-upgrade.md index 0fcdd420bcfe3..8cb7ee78b00d2 100644 --- a/docs/sql-migration-guide-upgrade.md +++ b/docs/sql-migration-guide-upgrade.md @@ -17,7 +17,7 @@ displayTitle: Spark SQL Upgrading Guide - Since Spark 3.0,

[spark] Diff for: [GitHub] srowen closed pull request #23538: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

diff --git a/dev/create-release/release-build.sh b/dev/create-release/release-build.sh index 2fdb5c8dd38a1..3b5f9ef2afe8f 100755 --- a/dev/create-release/release-build.sh +++ b/dev/create-release/release-build.sh @@ -176,10 +176,14 @@ if [[ "$1" == "package" ]]; then # Source and binary

[spark] Diff for: [GitHub] cloud-fan closed pull request #23521: [SPARK-26604][CORE] Clean up channel registration for StreamManager

diff --git a/common/network-common/src/main/java/org/apache/spark/network/server/ChunkFetchRequestHandler.java b/common/network-common/src/main/java/org/apache/spark/network/server/ChunkFetchRequestHandler.java index f08d8b0f984cf..43c3d23b6304d 100644 ---

[spark] Diff for: [GitHub] HyukjinKwon closed pull request #23506: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL

diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala index 597eef129f63e..688376e634f9d 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala +++

[GitHub] packtpartner opened a new pull request #172: Update documentation.md

packtpartner opened a new pull request #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172 *Make sure that you generate site HTML with `jekyll build`, and include the changes to the HTML in your pull request also. See README.md for more information. Please

[GitHub] dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 This PR adds or updates the followings. **1. News**

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787593 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, commits@spark.apache.org

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787955 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789120 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive

dongjoon-hyun commented on issue #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170#issuecomment-454301569 cc @felixcheung This is an automated message from the Apache Git Service. To

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454294453 Thank you, @felixcheung and @HyukjinKwon . This is an

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247788371 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[spark] Diff for: [GitHub] asfgit closed pull request #23533: [CORE][MINOR] Fix some typos about MemoryMode

diff --git a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java b/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java index 2cd39bd60c2ac..305cc1c5d1115 100644 --- a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java +++

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454289763 Hi, @srowen . Could you review this PR? This is an

[GitHub] HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783477 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247782800 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783039 ## File path: site/js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783110 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783418 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247791974 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247791974 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun opened a new pull request #170: Update 2.3.1 to use archive

dongjoon-hyun opened a new pull request #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170 We need to update 2.3.1 download to use archive and remove it from mirror. This is an automated

[spark] Diff for: [GitHub] wangshuo128 closed pull request #23355: [SPARK-26418][SHUFFLE] Only OpenBlocks without any ChunkFetch for one stream will cause memory leak in ExternalShuffleService

diff --git a/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java b/common/network-common/src/main/java/org/apache/spark/network/client/TransportClient.java index 20d840baeaf6c..8d46671f9581a 100644 ---

[GitHub] HyukjinKwon commented on issue #170: Update 2.3.1 to use archive

HyukjinKwon commented on issue #170: Update 2.3.1 to use archive URL: https://github.com/apache/spark-website/pull/170#issuecomment-454337315 +1 This is an automated message from the Apache Git Service. To respond to the

[GitHub] felixcheung commented on issue #174: More minor style fixes for merge script

felixcheung commented on issue #174: More minor style fixes for merge script URL: https://github.com/apache/spark-website/pull/174#issuecomment-455819101 LGTM This is an automated message from the Apache Git

[GitHub] srowen opened a new pull request #174: More minor style fixes for merge script

srowen opened a new pull request #174: More minor style fixes for merge script URL: https://github.com/apache/spark-website/pull/174 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] srowen commented on issue #172: Update documentation.md

srowen commented on issue #172: Update documentation.md URL: https://github.com/apache/spark-website/pull/172#issuecomment-455806313 @packtpartner just run `jekyll build` and add the updated .html file to this PR. This is an

[GitHub] srowen closed pull request #174: More minor style fixes for merge script

srowen closed pull request #174: More minor style fixes for merge script URL: https://github.com/apache/spark-website/pull/174 This is an automated message from the Apache Git Service. To respond to the message, please log

[spark] Diff for: [GitHub] HyukjinKwon closed pull request #21135: [SPARK-24060][TEST] StreamingSymmetricHashJoinHelperSuite should initialize after SparkSession creation

diff --git a/sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingSymmetricHashJoinHelperSuite.scala b/sql/core/src/test/scala/org/apache/spark/sql/streaming/StreamingSymmetricHashJoinHelperSuite.scala index 69b7154895341..56378085be0be 100644 ---

[spark] Diff for: [GitHub] yanlin-Lynn closed pull request #23369: [SPARK-26429][SS]add jdbc sink for Structured Streaming.

diff --git a/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister b/sql/core/src/main/resources/META-INF/services/org.apache.spark.sql.sources.DataSourceRegister index 1b37905543b4e..f574224b8ba96 100644 ---

[spark] Diff for: [GitHub] asfgit closed pull request #23530: [SPARK-26576][SQL][TEST] Broadcast hint not applied to partitioned table

diff --git a/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala b/sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/PruneFileSourcePartitionsSuite.scala index 94384185d190a..6b2d0c656b371 100644 ---

[GitHub] felixcheung commented on issue #167: Add Spark 2.2.3 docs

felixcheung commented on issue #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167#issuecomment-453791295 I did a quick check after merging, looks good This is an automated message from the Apache

[GitHub] dongjoon-hyun commented on issue #167: Add Spark 2.2.3 docs

dongjoon-hyun commented on issue #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167#issuecomment-453782582 Could you review this, @srowen , @felixcheung , @dbtsai ? This is an automated message

[GitHub] felixcheung commented on issue #167: Add Spark 2.2.3 docs

felixcheung commented on issue #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167#issuecomment-453791131 yeah, it's hard to review. if you could double check only site/ is changing then it should be ok

[GitHub] felixcheung opened a new pull request #168: add checker note in release process

felixcheung opened a new pull request #168: add checker note in release process URL: https://github.com/apache/spark-website/pull/168 add note to check checker after release This is an automated message from the Apache Git

[GitHub] felixcheung closed pull request #168: add checker note in release process

felixcheung closed pull request #168: add checker note in release process URL: https://github.com/apache/spark-website/pull/168 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a foreign

[GitHub] srowen commented on issue #167: Add Spark 2.2.3 docs

srowen commented on issue #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167#issuecomment-453791488 @dongjoon-hyun there's a separate change to add a news item and the download link to come right?

[GitHub] dongjoon-hyun commented on issue #167: Add Spark 2.2.3 docs

dongjoon-hyun commented on issue #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167#issuecomment-453791540 Thank you, @felixcheung and @srowen . Yes. Right, @srowen . I'm working on them~ This

[GitHub] dongjoon-hyun opened a new pull request #167: Add Spark 2.2.3 docs

dongjoon-hyun opened a new pull request #167: Add Spark 2.2.3 docs URL: https://github.com/apache/spark-website/pull/167 This PR aims to add the voted Apache Spark 2.2.3 `docs` directory only. In the followup PR, I'll update the others (the links and announce and committer guide update

[spark] Diff for: [GitHub] asfgit closed pull request #23392: [SPARK-26450][SQL] Avoid rebuilding map of schema for every column in projection

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/BoundAttribute.scala index ea8c369ee49ed..7ae5924b20faf 100644 ---

[spark] Diff for: [GitHub] asfgit closed pull request #23524: [FOLLOW-UP][SPARK-26065][SQL] Revert hint behavior in join reordering

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/CostBasedJoinReorder.scala index 743d3ce944fe2..6540e95b01e3f 100644 ---

[spark] Diff for: [GitHub] srowen closed pull request #20512: [SPARK-23182][CORE] Allow enabling TCP keep alive on the RPC connections

diff --git a/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java b/common/network-common/src/main/java/org/apache/spark/network/server/TransportServer.java index 0719fa7647bcc..35155bb4eef15 100644 ---

[spark] Diff for: [GitHub] cloud-fan closed pull request #23391: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala index ee463bf5eb6ac..ff6a68b290206 100644 ---

[spark] Diff for: [GitHub] rberenguel closed pull request #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes before 1900

diff --git a/python/pyspark/sql/tests.py b/python/pyspark/sql/tests.py index f0a9a0400e392..71559af624f6c 100644 --- a/python/pyspark/sql/tests.py +++ b/python/pyspark/sql/tests.py @@ -1568,6 +1568,18 @@ def test_datetime_at_epoch(self): self.assertEqual(first['date'], epoch)

[GitHub] [spark-website] dbtsai merged pull request #187: Add docs for Spark 2.4.1

dbtsai merged pull request #187: Add docs for Spark 2.4.1 URL: https://github.com/apache/spark-website/pull/187 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark-website] dbtsai commented on issue #187: Add docs for Spark 2.4.1

dbtsai commented on issue #187: Add docs for Spark 2.4.1 URL: https://github.com/apache/spark-website/pull/187#issuecomment-480053942 @srowen yes, since this part is not possible to review, I decide to submit it as a separate PR. Thanks.

[GitHub] [spark-website] dbtsai opened a new pull request #187: Add docs for Spark 2.4.1

dbtsai opened a new pull request #187: Add docs for Spark 2.4.1 URL: https://github.com/apache/spark-website/pull/187 cc @srowen , @felixcheung *Make sure that you generate site HTML with `jekyll build`, and include the changes to the HTML in your pull request also. See README.md

[GitHub] [spark-website] dbtsai commented on a change in pull request #190: Add Apache Spark 2.4.1 news link.

dbtsai commented on a change in pull request #190: Add Apache Spark 2.4.1 news link. URL: https://github.com/apache/spark-website/pull/190#discussion_r272451038 ## File path: releases/_posts/2019-04-01-spark-release-2-4-1.md ## @@ -13,6 +13,8 @@ meta: Spark 2.4.1 is a

[GitHub] [spark-website] srowen commented on a change in pull request #190: Add Apache Spark 2.4.1 release link.

srowen commented on a change in pull request #190: Add Apache Spark 2.4.1 release link. URL: https://github.com/apache/spark-website/pull/190#discussion_r272391922 ## File path: js/downloads.js ## @@ -15,14 +15,14 @@ var sources = {pretty: "Source Code", tag: "sources"};

[GitHub] [spark-website] dbtsai commented on a change in pull request #190: Add Apache Spark 2.4.1 release link.

dbtsai commented on a change in pull request #190: Add Apache Spark 2.4.1 release link. URL: https://github.com/apache/spark-website/pull/190#discussion_r272393591 ## File path: releases/_posts/2019-04-01-spark-release-2-4-1.md ## @@ -13,6 +13,8 @@ meta: Spark 2.4.1 is

[GitHub] [spark-website] dbtsai merged pull request #190: Add Apache Spark 2.4.1 news link.

dbtsai merged pull request #190: Add Apache Spark 2.4.1 news link. URL: https://github.com/apache/spark-website/pull/190 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark-website] srowen merged pull request #185: Add stopwatch performance library

srowen merged pull request #185: Add stopwatch performance library URL: https://github.com/apache/spark-website/pull/185 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark-website] dbtsai opened a new pull request #190: Add Apache Spark 2.4.1 release link.

dbtsai opened a new pull request #190: Add Apache Spark 2.4.1 release link. URL: https://github.com/apache/spark-website/pull/190 *Make sure that you generate site HTML with `jekyll build`, and include the changes to the HTML in your pull request also. See README.md for more information.

[GitHub] [spark-website] srowen opened a new pull request #191: Remove local copies of JS, CSS files we don't use directly in the site

srowen opened a new pull request #191: Remove local copies of JS, CSS files we don't use directly in the site URL: https://github.com/apache/spark-website/pull/191 These aren't used anymore; copies from the internet are used or they are simply stale. The site appears fine without them

[GitHub] [spark-website] srowen commented on issue #191: Remove local copies of JS, CSS files we don't use directly in the site

srowen commented on issue #191: Remove local copies of JS, CSS files we don't use directly in the site URL: https://github.com/apache/spark-website/pull/191#issuecomment-480252276 Merged to asf-site. Yeah we shouldn't be distributing these in any way if we can avoid it, even if they

[GitHub] [spark-website] srowen commented on a change in pull request #190: Add Apache Spark 2.4.1 news link.

srowen commented on a change in pull request #190: Add Apache Spark 2.4.1 news link. URL: https://github.com/apache/spark-website/pull/190#discussion_r272556702 ## File path: releases/_posts/2019-04-01-spark-release-2-4-1.md ## @@ -13,6 +13,8 @@ meta: Spark 2.4.1 is a

[GitHub] [spark-website] srowen closed pull request #191: Remove local copies of JS, CSS files we don't use directly in the site

srowen closed pull request #191: Remove local copies of JS, CSS files we don't use directly in the site URL: https://github.com/apache/spark-website/pull/191 This is an automated message from the Apache Git Service. To

[GitHub] [spark-website] dongjoon-hyun opened a new pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun opened a new pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192 The followings are the fixed screen shots. **2.4.1**

[GitHub] [spark-website] dongjoon-hyun commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#issuecomment-480341564 Could you review this, @dbtsai , @maropu , @srowen ? This is an

[GitHub] [spark-website] dongjoon-hyun edited a comment on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun edited a comment on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#issuecomment-480341564 I missed this at 2.2.3. Could you review this, @dbtsai , @maropu , @srowen ?

[GitHub] [spark-website] dongjoon-hyun commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#discussion_r272698135 ## File path: site/docs/2.2.3/configuration.html ## @@ -134,10 +134,33 @@ Spark Configuration

[GitHub] [spark-website] dongjoon-hyun commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#issuecomment-480381918 Thank you, @srowen . This is an automated message from the

[GitHub] [spark-website] srowen commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

srowen commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#discussion_r272680095 ## File path: site/docs/2.2.3/configuration.html ## @@ -134,10 +134,33 @@ Spark Configuration

[GitHub] [spark-website] dongjoon-hyun commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun commented on a change in pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#discussion_r272698135 ## File path: site/docs/2.2.3/configuration.html ## @@ -134,10 +134,33 @@ Spark Configuration

[GitHub] [spark-website] dongjoon-hyun merged pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dongjoon-hyun merged pull request #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark-website] dbtsai commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3)

dbtsai commented on issue #192: Fix configuration pages (2.4.1/2.3.3/2.2.3) URL: https://github.com/apache/spark-website/pull/192#issuecomment-480472633 Thank you @dongjoon-hyun to take care of it! This is an automated

[GitHub] [spark-website] dbtsai opened a new pull request #188: Add Apache Spark 2.4.1 official release news

dbtsai opened a new pull request #188: Add Apache Spark 2.4.1 official release news URL: https://github.com/apache/spark-website/pull/188 *Make sure that you generate site HTML with `jekyll build`, and include the changes to the HTML in your pull request also. See README.md for more

[GitHub] [spark-website] dbtsai commented on issue #188: Add Apache Spark 2.4.1 official release news

dbtsai commented on issue #188: Add Apache Spark 2.4.1 official release news URL: https://github.com/apache/spark-website/pull/188#issuecomment-480065373 I will merge this now as it's pretty trivial. Thanks! This is an

[GitHub] [spark-website] dbtsai merged pull request #188: Add Apache Spark 2.4.1 official release news

dbtsai merged pull request #188: Add Apache Spark 2.4.1 official release news URL: https://github.com/apache/spark-website/pull/188 This is an automated message from the Apache Git Service. To respond to the message, please

  1   2   3   4   5   6   7   8   9   10   >