[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789120 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02/2

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247788371 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02/2

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787955 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787593 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02/2

[GitHub] dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, commits@spark.apache.org ---

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454294453 Thank you, @felixcheung and @HyukjinKwon . This is an au

[GitHub] HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783477 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -https://spar

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783418 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247782800 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11/02/2

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783039 ## File path: site/js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new Date("11

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783110 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -https://spar

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454289763 Hi, @srowen . Could you review this PR? This is an au

[GitHub] dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 This PR adds or updates the followings. **1. News** https://user-images.githubusercontent.com/9700541/51164265-a7548180-1859-11e

[spark] Diff for: [GitHub] asfgit closed pull request #23533: [CORE][MINOR] Fix some typos about MemoryMode

diff --git a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java b/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java index 2cd39bd60c2ac..305cc1c5d1115 100644 --- a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java +++ b/common/un

[spark] branch master updated: [CORE][MINOR] Fix some typos about MemoryMode

This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a77505d [CORE][MINOR] Fix some typos about Me

[spark] Diff for: [GitHub] cloud-fan closed pull request #23543: [SPARK-25935][SQL] Allow null rows for bad records from JSON/CSV parsers

diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R index a1805f57b1dcf..88f2286219525 100644 --- a/R/pkg/tests/fulltests/test_sparkSQL.R +++ b/R/pkg/tests/fulltests/test_sparkSQL.R @@ -1694,7 +1694,7 @@ test_that("column functions", { # check for unpars

[spark] Diff for: [GitHub] cloud-fan closed pull request #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource

diff --git a/docs/sql-migration-guide-upgrade.md b/docs/sql-migration-guide-upgrade.md index 0fcdd420bcfe3..8cb7ee78b00d2 100644 --- a/docs/sql-migration-guide-upgrade.md +++ b/docs/sql-migration-guide-upgrade.md @@ -17,7 +17,7 @@ displayTitle: Spark SQL Upgrading Guide - Since Spark 3.0, the

svn commit: r31963 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_20_51-abc937b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 15 05:03:26 2019 New Revision: 31963 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_20_51-abc937b docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[spark] branch master updated (abc937b -> 33b5039)

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from abc937b [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only add 33b5039

svn commit: r31962 - in /dev/spark/2.4.1-SNAPSHOT-2019_01_14_18_37-743dedb-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 15 02:51:25 2019 New Revision: 31962 Log: Apache Spark 2.4.1-SNAPSHOT-2019_01_14_18_37-743dedb docs [This commit notification would consist of 1476 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[spark] Diff for: [GitHub] srowen closed pull request #23538: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

diff --git a/dev/create-release/release-build.sh b/dev/create-release/release-build.sh index 2fdb5c8dd38a1..3b5f9ef2afe8f 100755 --- a/dev/create-release/release-build.sh +++ b/dev/create-release/release-build.sh @@ -176,10 +176,14 @@ if [[ "$1" == "package" ]]; then # Source and binary tarball

[spark] branch branch-2.4 updated: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 743dedb [MINOR][BUILD] Remove binary lic

[spark] branch master updated: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new abc937b [MINOR][BUILD] Remove binary license/not

svn commit: r31961 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_16_23-bafc7ac-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 15 00:35:20 2019 New Revision: 31961 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_16_23-bafc7ac docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[spark] Diff for: [GitHub] asfgit closed pull request #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md index 7040f8da2c614..88a772610578d 100644 --- a/docs/structured-streaming-kafka-integration.md +++ b/docs/structured-streaming-kafka-integration.md @@ -379,7 +379,25 @@ The following config

[spark] branch master updated: [SPARK-26350][SS] Allow to override group id of the Kafka consumer

This is an automated email from the ASF dual-hosted git repository. zsxwing pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new bafc7ac [SPARK-26350][SS] Allow to override gro

[spark] Diff for: [GitHub] gatorsmile closed pull request #23496: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL

diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala index cd321d41f43e8..20b1e1abce9c6 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala +++ b/sql/hive/src/main/scala/org/apa

[spark] Diff for: [GitHub] gatorsmile closed pull request #23535: [SPARK-26613][SQL] Add another rename table grammar for spark sql

diff --git a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 b/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 index b39681d886c5c..de18fc93cba2d 100644 --- a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 ++

svn commit: r31954 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_06_38-115fecf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 14 14:51:04 2019 New Revision: 31954 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_06_38-115fecf docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] ---

[spark] Diff for: [GitHub] cloud-fan closed pull request #23391: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala index ee463bf5eb6ac..ff6a68b290206 100644 --- a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/

[spark] branch master updated: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 115fecf [SPARK-26456][SQL] Cast date/timestamp

[spark] Diff for: [GitHub] rberenguel closed pull request #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes before 1900

diff --git a/python/pyspark/sql/tests.py b/python/pyspark/sql/tests.py index f0a9a0400e392..71559af624f6c 100644 --- a/python/pyspark/sql/tests.py +++ b/python/pyspark/sql/tests.py @@ -1568,6 +1568,18 @@ def test_datetime_at_epoch(self): self.assertEqual(first['date'], epoch) self