sassai edited a comment on issue #1962: URL: https://github.com/apache/hudi/issues/1962#issuecomment-704079007
@bvaradar: I dropped and synced the table again. Issue still exists unless I
set `set hive.fetch.task.conversion=none;` before executing the query. Then
everything works as expected.
Please find the table description with and without partition below.
describe formatted address:
```console
+-------------------------------+----------------------------------------------------+-----------------------+
| col_name | data_type
| comment |
+-------------------------------+----------------------------------------------------+-----------------------+
| _hoodie_commit_time | string
| |
| _hoodie_commit_seqno | string
| |
| _hoodie_record_key | string
| |
| _hoodie_partition_path | string
| |
| _hoodie_file_name | string
| |
| id | int
| |
| zipcode | int
| |
| city | string
| |
| street | string
| |
| streetnumber | int
| |
| uuid | string
| |
| start_date | string
| |
| end_date | string
| |
| is_current | boolean
| |
| event_time | string
| |
| its | string
| |
| | NULL
| NULL |
| # Partition Information | NULL
| NULL |
| # col_name | data_type
| comment |
| year | int
| |
| month | int
| |
| day | int
| |
| | NULL
| NULL |
| # Detailed Table Information | NULL
| NULL |
| Database: | nyc_taxi
| NULL |
| OwnerType: | USER
| NULL |
| Owner: | srv_tu_usecase2_producer
| NULL |
| CreateTime: | Tue Oct 06 07:06:03 UTC 2020
| NULL |
| LastAccessTime: | UNKNOWN
| NULL |
| Retention: | 0
| NULL |
| Location: |
abfs://[email protected]/data/hudi/batch/tables/nyc_taxi/address
| NULL |
| Table Type: | EXTERNAL_TABLE
| NULL |
| Table Parameters: | NULL
| NULL |
| | EXTERNAL
| TRUE |
| | bucketing_version
| 2 |
| | discover.partitions
| true |
| | last_commit_time_sync
| 20201006065754 |
| | numFiles
| 82 |
| | numPartitions
| 1 |
| | numRows
| 0 |
| | rawDataSize
| 0 |
| | totalSize
| 642825967 |
| | transient_lastDdlTime
| 1601967963 |
| | NULL
| NULL |
| # Storage Information | NULL
| NULL |
| SerDe Library: |
org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe | NULL
|
| InputFormat: |
org.apache.hudi.hadoop.HoodieParquetInputFormat | NULL |
| OutputFormat: |
org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat | NULL
|
| Compressed: | No
| NULL |
| Num Buckets: | -1
| NULL |
| Bucket Columns: | []
| NULL |
| Sort Columns: | []
| NULL |
| Storage Desc Params: | NULL
| NULL |
| | serialization.format
| 1 |
+-------------------------------+----------------------------------------------------+-----------------------+
```
describe formatted address partition(year=2020,month=10,day=6):
```console
+-----------------------------------+----------------------------------------------------+-----------------------+
| col_name | data_type
| comment |
+-----------------------------------+----------------------------------------------------+-----------------------+
| _hoodie_commit_time | string
| |
| _hoodie_commit_seqno | string
| |
| _hoodie_record_key | string
| |
| _hoodie_partition_path | string
| |
| _hoodie_file_name | string
| |
| id | int
| |
| zipcode | int
| |
| city | string
| |
| street | string
| |
| streetnumber | int
| |
| uuid | string
| |
| start_date | string
| |
| end_date | string
| |
| is_current | boolean
| |
| event_time | string
| |
| its | string
| |
| | NULL
| NULL |
| # Partition Information | NULL
| NULL |
| # col_name | data_type
| comment |
| year | int
| |
| month | int
| |
| day | int
| |
| | NULL
| NULL |
| # Detailed Partition Information | NULL
| NULL |
| Partition Value: | [2020, 10, 6]
| NULL |
| Database: | nyc_taxi
| NULL |
| Table: | address
| NULL |
| CreateTime: | Tue Oct 06 07:06:04 UTC 2020
| NULL |
| LastAccessTime: | UNKNOWN
| NULL |
| Location: |
abfs://[email protected]/data/hudi/batch/tables/nyc_taxi/address/year=2020/month=10/day=6
| NULL |
| Partition Parameters: | NULL
| NULL |
| | numFiles
| 82 |
| | totalSize
| 642825967 |
| | transient_lastDdlTime
| 1601967964 |
| | NULL
| NULL |
| # Storage Information | NULL
| NULL |
| SerDe Library: |
org.apache.hadoop.hive.ql.io.parquet.serde.ParquetHiveSerDe | NULL
|
| InputFormat: |
org.apache.hudi.hadoop.HoodieParquetInputFormat | NULL |
| OutputFormat: |
org.apache.hadoop.hive.ql.io.parquet.MapredParquetOutputFormat | NULL
|
| Compressed: | No
| NULL |
| Num Buckets: | -1
| NULL |
| Bucket Columns: | []
| NULL |
| Sort Columns: | []
| NULL |
| Storage Desc Params: | NULL
| NULL |
| | serialization.format
| 1 |
+-----------------------------------+----------------------------------------------------+-----------------------+
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
