[
https://issues.apache.org/jira/browse/HIVE-26888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17651657#comment-17651657
]
Indhumathi Muthumurugesh commented on HIVE-26888:
-------------------------------------------------
closing this, as duplicate jira
> Hive gives empty results with partition column filter for hive parquet table
> when data loaded through spark dataframe
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-26888
> URL: https://issues.apache.org/jira/browse/HIVE-26888
> Project: Hive
> Issue Type: Bug
> Reporter: Indhumathi Muthumurugesh
> Assignee: Indhumathi Muthumurugesh
> Priority: Major
>
> 1. From Spark sql:
> create table test(a int, b string) partitioned by (c string) stored as
> parquet;
> insert into test select 1,'abc','part1';
>
> 2. Use spark dataframe to generate new parquet file
> val df = spark.sql("select * from test");
> df.write.mode("overwrite").parquet("/Users/indhu/Downloads/part=part1");
>
> 3. From hive, create a external table with parquet format and add partition,
> with the location
> create external table test(a int, b string) partitioned by (c string)
> ROW FORMAT SERDE
> 'org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe'
> STORED AS INPUTFORMAT
> 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetInputFormat'
> OUTPUTFORMAT 'org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat';
> alter table test add partition(part='part1') location
> '/Users/indhu/Downloads/part=part1';
> select * from test where part='part1';
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
