[jira] [Commented] (SPARK-23355) convertMetastore should not ignore table properties
[ https://issues.apache.org/jira/browse/SPARK-23355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16467610#comment-16467610 ] Apache Spark commented on SPARK-23355: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/21269 > convertMetastore should not ignore table properties > --- > > Key: SPARK-23355 > URL: https://issues.apache.org/jira/browse/SPARK-23355 > Project: Spark > Issue Type: Bug > Components: SQL >Affects Versions: 2.0.2, 2.1.2, 2.2.1, 2.3.0 >Reporter: Dongjoon Hyun >Assignee: Dongjoon Hyun >Priority: Major > Fix For: 2.4.0 > > > `convertMetastoreOrc/Parquet` ignores table properties. > This happens for a table created by `STORED AS ORC/PARQUET`. > Currently, `convertMetastoreParquet` is `true` by default. So, it's a > well-known user-facing issue. For `convertMetastoreOrc`, it has been `false` > and SPARK-22279 tried to turn on that for Feature Parity with Parquet. > However, it's indeed a regression for the existing Hive ORC table users. So, > it'll be reverted for Apache Spark 2.3 via > https://github.com/apache/spark/pull/20536 . -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-23355) convertMetastore should not ignore table properties
[ https://issues.apache.org/jira/browse/SPARK-23355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16356076#comment-16356076 ] Apache Spark commented on SPARK-23355: -- User 'dongjoon-hyun' has created a pull request for this issue: https://github.com/apache/spark/pull/20522 > convertMetastore should not ignore table properties > --- > > Key: SPARK-23355 > URL: https://issues.apache.org/jira/browse/SPARK-23355 > Project: Spark > Issue Type: Test > Components: SQL >Affects Versions: 2.0.2, 2.1.2, 2.2.1, 2.3.0 >Reporter: Dongjoon Hyun >Priority: Major > > `convertMetastoreOrc/Parquet` ignores table properties. > This happens for a table created by `STORED AS ORC/PARQUET`. > Currently, `convertMetastoreParquet` is `true` by default. So, it's a > well-known user-facing issue. For `convertMetastoreOrc`, it has been `false` > and SPARK-22279 tried to turn on that for Feature Parity with Parquet. > However, it's indeed a regression for the existing Hive ORC table users. So, > it'll be reverted for Apache Spark 2.3 via > https://github.com/apache/spark/pull/20536 . -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
