Istvan Szukacs created PARQUET-1206:
---------------------------------------
Summary: Parquet properties are ignored at table creation time
Key: PARQUET-1206
URL: https://issues.apache.org/jira/browse/PARQUET-1206
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.6.0
Environment: Versions: Impalad version 2.6.0-cdh5.8.5 RELEASE (build
d460423934c1689082f6297101a45b28c49bd39f)
CDH 5.8.5
Reporter: Istvan Szukacs
Create table ignores table properties.
{{CREATE EXTERNAL TABLE db.test (}}{{ month INT}}
{{)}}
{{STORED AS PARQUET}}
{{LOCATION 'hdfs://nn/user/user/test'}}
{{TBLPROPERTIES (}}
{{
'STATS_GENERATED_VIA_STATS_TASK'='true',}}{{'PARQUET.COMPRESSION'='GZIP',}}{{'PARQUET.VERSION'='PARQUET_2_0');}}
After inserting into this table with the following:
{{INSERT INTO TABLE db.test}}
{{SELECT * FROM db.source;}}
The created Parquet files are SNAPPY compressed according to parquet-tools
meta. Is there a difference which query engine is used? Impala or Hive? Should
this be resulting GZIP compressed files or Parquet ignores TBLPROPERTIES?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)