Xiao Li created SPARK-17166:
-------------------------------
Summary: CTAS lost table properties after conversion to data
source tables.
Key: SPARK-17166
URL: https://issues.apache.org/jira/browse/SPARK-17166
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 2.0.0
Reporter: Xiao Li
CTAS lost table properties after conversion to data source tables. For example,
{noformat}
CREATE TABLE t TBLPROPERTIES('prop1' = 'c', 'prop2' = 'd') AS SELECT 1 as a, 1
as b
{noformat}
The output of `DESC FORMATTED t` does not have the related properties.
{noformat}
|Table Parameters: |
| |
| rawDataSize |-1
| |
| numFiles |1
| |
| transient_lastDdlTime |1471670983
| |
| totalSize |496
| |
| spark.sql.sources.provider|parquet
| |
| EXTERNAL |FALSE
| |
| COLUMN_STATS_ACCURATE |false
| |
| numRows |-1
| |
| |
| |
|# Storage Information |
| |
|SerDe Library:
|org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe
| |
|InputFormat:
|org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat
| |
|OutputFormat:
|org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat
| |
|Compressed: |No
| |
|Storage Desc Parameters: |
| |
| serialization.format |1
| |
| path
|file:/private/var/folders/4b/sgmfldk15js406vk7lw5llzw0000gn/T/warehouse-f3aa2927-6464-4a35-a715-1300dde6c614/t|
|
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
