GitHub user dongjoon-hyun opened a pull request:
https://github.com/apache/spark/pull/21269
[SPARK-23355][SQL][DOC][FOLLOWUP] Add migration doc for TBLPROPERTIES
## What changes were proposed in this pull request?
In Apache Spark 2.4,
[SPARK-23355](https://issues.apache.org/jira/browse/SPARK-23355) fixes a bug
which ignores table properties during convertMetastore for tables created by
STORED AS ORC/PARQUET.
For some Parquet tables having table properties like TBLPROPERTIES
(parquet.compression 'NONE'), it was ignored by default before Apache Spark
2.4. After upgrading cluster, Spark will write uncompressed file which is
different from Apache Spark 2.3 and old.
This PR adds a migration note for that.
## How was this patch tested?
N/A
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/dongjoon-hyun/spark SPARK-23355-DOC
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/21269.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #21269
----
commit 1647961162a9cb50b69bd5885bdc01e4fa550dac
Author: Dongjoon Hyun <dongjoon@...>
Date: 2018-05-08T15:58:20Z
[SPARK-23355][SQL][DOC][FOLLOWUP] Add migration doc for `convertMetastore`
conf
----
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
