This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-2.4
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-2.4 by this push:
new 3ff5021 [SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for
MsSQLServer JDBC dialect
3ff5021 is described below
commit 3ff502107fdc9c8c6738268581011bc6e6f8fc6b
Author: Dongjoon Hyun <dh...@apple.com>
AuthorDate: Fri Jan 17 17:20:15 2020 -0800
[SPARK-28152][DOCS][FOLLOWUP] Add a migration guide for MsSQLServer JDBC
dialect
This PR adds a migration guide for MsSQLServer JDBC dialect for Apache
Spark 2.4.4 and 2.4.5.
Apache Spark 2.4.4 updates the type mapping correctly according to MS SQL
Server, but missed to mention that in the migration guide. In addition, 2.4.4
adds a configuration for the legacy behavior.
Yes. This is a documentation change.
Manually generate and see the doc.
Closes #27270 from dongjoon-hyun/SPARK-28152-DOC.
Authored-by: Dongjoon Hyun <dh...@apple.com>
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
(cherry picked from commit 505693c282d94ebb0f763477309f0bba90b5acbc)
Signed-off-by: Dongjoon Hyun <dh...@apple.com>
---
docs/sql-migration-guide-upgrade.md | 6 ++++++
1 file changed, 6 insertions(+)
diff --git a/docs/sql-migration-guide-upgrade.md
b/docs/sql-migration-guide-upgrade.md
index 2ac4733..8170637 100644
--- a/docs/sql-migration-guide-upgrade.md
+++ b/docs/sql-migration-guide-upgrade.md
@@ -16,6 +16,12 @@ displayTitle: Spark SQL Upgrading Guide
- Since Spark 2.4.5, `TRUNCATE TABLE` command tries to set back original
permission and ACLs during re-creating the table/partition paths. To restore
the behaviour of earlier versions, set
`spark.sql.truncateTable.ignorePermissionAcl.enabled` to `true`.
+ - Since Spark 2.4.5, `spark.sql.legacy.mssqlserver.numericMapping.enabled`
configuration is added in order to support the legacy MsSQLServer dialect
mapping behavior using IntegerType and DoubleType for SMALLINT and REAL JDBC
types, respectively. To restore the behaviour of 2.4.3 and earlier versions,
set `spark.sql.legacy.mssqlserver.numericMapping.enabled` to `true`.
+
+## Upgrading from Spark SQL 2.4.3 to 2.4.4
+
+ - Since Spark 2.4.4, according to [MsSqlServer
Guide](https://docs.microsoft.com/en-us/sql/connect/jdbc/using-basic-data-types?view=sql-server-2017),
MsSQLServer JDBC Dialect uses ShortType and FloatType for SMALLINT and REAL,
respectively. Previously, IntegerType and DoubleType is used.
+
## Upgrading from Spark SQL 2.4 to 2.4.1
- The value of `spark.executor.heartbeatInterval`, when specified without
units like "30" rather than "30s", was
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
