[spark] Diff for: [GitHub] gatorsmile closed pull request #23535: [SPARK-26613][SQL] Add another rename table grammar for spark sql

diff --git a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 b/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4 index b39681d886c5c..de18fc93cba2d 100644 --- a/sql/catalyst/src/main/antlr4/org/apache/spark/sql/catalyst/parser/SqlBase.g4

svn commit: r31954 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_06_38-115fecf-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Mon Jan 14 14:51:04 2019 New Revision: 31954 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_06_38-115fecf docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] Diff for: [GitHub] gatorsmile closed pull request #23496: [SPARK-26577][SQL] Add input optimizer when reading Hive table by SparkSQL

diff --git a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala b/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala index cd321d41f43e8..20b1e1abce9c6 100644 --- a/sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala +++

[spark] Diff for: [GitHub] asfgit closed pull request #23301: [SPARK-26350][SS]Allow to override group id of the Kafka consumer

diff --git a/docs/structured-streaming-kafka-integration.md b/docs/structured-streaming-kafka-integration.md index 7040f8da2c614..88a772610578d 100644 --- a/docs/structured-streaming-kafka-integration.md +++ b/docs/structured-streaming-kafka-integration.md @@ -379,7 +379,25 @@ The following

svn commit: r31961 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_16_23-bafc7ac-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 15 00:35:20 2019 New Revision: 31961 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_16_23-bafc7ac docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] branch branch-2.4 updated: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

This is an automated email from the ASF dual-hosted git repository. srowen pushed a commit to branch branch-2.4 in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/branch-2.4 by this push: new 743dedb [MINOR][BUILD] Remove binary

svn commit: r31963 - in /dev/spark/3.0.0-SNAPSHOT-2019_01_14_20_51-abc937b-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/java/ _site/api/java/lib/ _site/api/java/org/ _site/api/java/org/apache/ _s

Author: pwendell Date: Tue Jan 15 05:03:26 2019 New Revision: 31963 Log: Apache Spark 3.0.0-SNAPSHOT-2019_01_14_20_51-abc937b docs [This commit notification would consist of 1775 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.]

[spark] Diff for: [GitHub] cloud-fan closed pull request #23543: [SPARK-25935][SQL] Allow null rows for bad records from JSON/CSV parsers

diff --git a/R/pkg/tests/fulltests/test_sparkSQL.R b/R/pkg/tests/fulltests/test_sparkSQL.R index a1805f57b1dcf..88f2286219525 100644 --- a/R/pkg/tests/fulltests/test_sparkSQL.R +++ b/R/pkg/tests/fulltests/test_sparkSQL.R @@ -1694,7 +1694,7 @@ test_that("column functions", { # check for

[spark] Diff for: [GitHub] cloud-fan closed pull request #23325: [SPARK-26376][SQL] Skip inputs without tokens by JSON datasource

diff --git a/docs/sql-migration-guide-upgrade.md b/docs/sql-migration-guide-upgrade.md index 0fcdd420bcfe3..8cb7ee78b00d2 100644 --- a/docs/sql-migration-guide-upgrade.md +++ b/docs/sql-migration-guide-upgrade.md @@ -17,7 +17,7 @@ displayTitle: Spark SQL Upgrading Guide - Since Spark 3.0,

[spark] Diff for: [GitHub] srowen closed pull request #23538: [MINOR][BUILD] Remove binary license/notice files in a source release for branch-2.4+ only

diff --git a/dev/create-release/release-build.sh b/dev/create-release/release-build.sh index 2fdb5c8dd38a1..3b5f9ef2afe8f 100755 --- a/dev/create-release/release-build.sh +++ b/dev/create-release/release-build.sh @@ -176,10 +176,14 @@ if [[ "$1" == "package" ]]; then # Source and binary

[GitHub] dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun opened a new pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 This PR adds or updates the followings. **1. News**

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787593 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun closed pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169 As this is a foreign pull request (from a fork), the diff has been sent to your commit mailing list, commits@spark.apache.org

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247787955 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789120 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[spark] branch master updated: [CORE][MINOR] Fix some typos about MemoryMode

This is an automated email from the ASF dual-hosted git repository. gurwls223 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new a77505d [CORE][MINOR] Fix some typos about

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454294453 Thank you, @felixcheung and @HyukjinKwon . This is an

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247788371 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[spark] Diff for: [GitHub] asfgit closed pull request #23533: [CORE][MINOR] Fix some typos about MemoryMode

diff --git a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java b/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java index 2cd39bd60c2ac..305cc1c5d1115 100644 --- a/common/unsafe/src/main/java/org/apache/spark/unsafe/array/LongArray.java +++

[GitHub] dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on issue #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#issuecomment-454289763 Hi, @srowen . Could you review this PR? This is an

[GitHub] HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

HyukjinKwon commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783477 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247782800 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783039 ## File path: site/js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

felixcheung commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783110 ## File path: site/mailing-lists.html ## @@ -12,7 +12,7 @@ -

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247783418 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[GitHub] dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links

dongjoon-hyun commented on a change in pull request #169: Add Apache Spark 2.2.3 release news and update links URL: https://github.com/apache/spark-website/pull/169#discussion_r247789724 ## File path: js/downloads.js ## @@ -36,7 +36,8 @@ addRelease("2.4.0", new

[spark] branch master updated: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

This is an automated email from the ASF dual-hosted git repository. wenchen pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/spark.git The following commit(s) were added to refs/heads/master by this push: new 115fecf [SPARK-26456][SQL] Cast date/timestamp

[spark] Diff for: [GitHub] cloud-fan closed pull request #23391: [SPARK-26456][SQL] Cast date/timestamp to string by Date/TimestampFormatter

diff --git a/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala index ee463bf5eb6ac..ff6a68b290206 100644 ---

[spark] Diff for: [GitHub] rberenguel closed pull request #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes before 1900

diff --git a/python/pyspark/sql/tests.py b/python/pyspark/sql/tests.py index f0a9a0400e392..71559af624f6c 100644 --- a/python/pyspark/sql/tests.py +++ b/python/pyspark/sql/tests.py @@ -1568,6 +1568,18 @@ def test_datetime_at_epoch(self): self.assertEqual(first['date'], epoch)