yikuanlee commented on issue #5817: URL: https://github.com/apache/iceberg/issues/5817#issuecomment-1255098060
Not sure it related, the table created successfully had InputFormat and
OutputFormat properties
```
0: jdbc:hive2://cms.dv.net:2181/default> describe formatted t11_iceberg;
INFO : Compiling
command(queryId=hive_20220922133753_360c62be-8f68-455a-a27c-e553988ab90f):
describe formatted t11_iceberg
DEBUG : Encoding valid txns info
144:9223372036854775807::82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,116,118,119,120,126,129,130,131,136,141,142
txnid:144
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col_name,
type:string, comment:from deserializer), FieldSchema(name:data_type,
type:string, comment:from deserializer), FieldSchema(name:comment, type:string,
comment:from deserializer)], properties:null)
INFO : Completed compiling
command(queryId=hive_20220922133753_360c62be-8f68-455a-a27c-e553988ab90f); Time
taken: 0.074 seconds
INFO : Executing
command(queryId=hive_20220922133753_360c62be-8f68-455a-a27c-e553988ab90f):
describe formatted t11_iceberg
INFO : Starting task [Stage-0:DDL] in serial mode
DEBUG : Task getting executed using mapred tag :
hive_20220922133753_360c62be-8f68-455a-a27c-e553988ab90f,userid=hive
INFO : Completed executing
command(queryId=hive_20220922133753_360c62be-8f68-455a-a27c-e553988ab90f); Time
taken: 0.275 seconds
INFO : OK
DEBUG : Shutting down query describe formatted t11_iceberg
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
| col_name | data_type
| comment |
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
| a | int
| from deserializer |
| b | int
| from deserializer |
| | NULL
| NULL |
| # Detailed Table Information | NULL
| NULL |
| Database: | db2iuser
| NULL |
| OwnerType: | USER
| NULL |
| Owner: | hive
| NULL |
| CreateTime: | Thu Sep 22 12:59:53 UTC 2022
| NULL |
| LastAccessTime: | UNKNOWN
| NULL |
| Retention: | 0
| NULL |
| Location: |
hdfs://cms.dv.net:8020/warehouse/tablespace/external/hive/db2iuser.db/T11_ICEBERG
| NULL |
| Table Type: | EXTERNAL_TABLE
| NULL |
| Table Parameters: | NULL
| NULL |
| | EXTERNAL
| TRUE |
| | TRANSLATED_TO_EXTERNAL
| TRUE |
| | bucketing_version
| 2 |
| | current-schema
|
{\"type\":\"struct\",\"schema-id\":0,\"fields\":[{\"id\":1,\"name\":\"a\",\"required\":false,\"type\":\"int\"},{\"id\":2,\"name\":\"b\",\"required\":false,\"type\":\"int\"}]}
|
| | engine.hive.enabled
| true |
| | external.table.purge
| TRUE |
| | metadata_location
|
hdfs://cms.dv.net:8020/warehouse/tablespace/external/hive/db2iuser.db/T11_ICEBERG/metadata/00000-bc11bf8a-f55d-4ccd-b1e2-f28ec7f988d0.metadata.json
|
| | numFiles
| 0 |
| | numRows
| 0 |
| | rawDataSize
| 0 |
| | snapshot-count
| 0 |
| | storage_handler
| org.apache.iceberg.mr.hive.HiveIcebergStorageHandler |
| | table_type
| ICEBERG |
| | totalSize
| 0 |
| | transient_lastDdlTime
| 1663851593 |
| | uuid
| 441d50a9-6c8a-4fa7-bedd-cf24ceed3e0f |
| | NULL
| NULL |
| # Storage Information | NULL
| NULL |
| SerDe Library: |
org.apache.iceberg.mr.hive.HiveIcebergSerDe | NULL
|
| InputFormat: |
org.apache.iceberg.mr.hive.HiveIcebergInputFormat | NULL
|
| OutputFormat: |
org.apache.iceberg.mr.hive.HiveIcebergOutputFormat | NULL
|
| Compressed: | No
| NULL |
| Num Buckets: | 0
| NULL |
| Bucket Columns: | []
| NULL |
| Sort Columns: | []
| NULL |
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
38 rows selected (0.415 seconds)
```
but failed one those properties were null
```
0: jdbc:hive2://cms.dv.net:2181/default> describe formatted t21_iceberg;
INFO : Compiling
command(queryId=hive_20220922133713_f0803f51-f47a-44cb-b4ef-8ef4d920885e):
describe formatted t21_iceberg
DEBUG : Encoding valid txns info
143:9223372036854775807::82,83,84,85,86,87,88,89,90,91,92,93,94,95,96,97,98,99,100,101,102,103,116,118,119,120,126,129,130,131,136,141,142
txnid:143
INFO : Semantic Analysis Completed (retrial = false)
INFO : Created Hive schema: Schema(fieldSchemas:[FieldSchema(name:col_name,
type:string, comment:from deserializer), FieldSchema(name:data_type,
type:string, comment:from deserializer), FieldSchema(name:comment, type:string,
comment:from deserializer)], properties:null)
INFO : Completed compiling
command(queryId=hive_20220922133713_f0803f51-f47a-44cb-b4ef-8ef4d920885e); Time
taken: 0.139 seconds
INFO : Executing
command(queryId=hive_20220922133713_f0803f51-f47a-44cb-b4ef-8ef4d920885e):
describe formatted t21_iceberg
INFO : Starting task [Stage-0:DDL] in serial mode
DEBUG : Task getting executed using mapred tag :
hive_20220922133713_f0803f51-f47a-44cb-b4ef-8ef4d920885e,userid=hive
INFO : Completed executing
command(queryId=hive_20220922133713_f0803f51-f47a-44cb-b4ef-8ef4d920885e); Time
taken: 1.325 seconds
INFO : OK
DEBUG : Shutting down query describe formatted t21_iceberg
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
| col_name | data_type
| comment |
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
| a | int
| from deserializer |
| b | int
| from deserializer |
| | NULL
| NULL |
| # Detailed Table Information | NULL
| NULL |
| Database: | db2iuser
| NULL |
| OwnerType: | USER
| NULL |
| Owner: | db2iuser
| NULL |
| CreateTime: | Thu Sep 22 13:20:20 UTC 2022
| NULL |
| LastAccessTime: | UNKNOWN
| NULL |
| Retention: | 0
| NULL |
| Location: |
hdfs://cms.dv.net:8020/warehouse/tablespace/external/hive/db2iuser.db/T21_ICEBERG
| NULL |
| Table Type: | EXTERNAL_TABLE
| NULL |
| Table Parameters: | NULL
| NULL |
| | COLUMN_STATS_ACCURATE
|
{\"BASIC_STATS\":\"true\",\"COLUMN_STATS\":{\"a\":\"true\",\"b\":\"true\"}} |
| | EXTERNAL
| TRUE |
| | biginsights.sql.metadata
| {\"v\":1,\"source\":\"BIGSQL\",\"version\":\"4.0\"} |
| | bucketing_version
| 2 |
| | external.table.purge
| true |
| | numFiles
| 0 |
| | numRows
| 0 |
| | rawDataSize
| 0 |
| | storage_handler
| org.apache.iceberg.mr.hive.HiveIcebergStorageHandler |
| | table_type
| ICEBERG |
| | totalSize
| 0 |
| | transient_lastDdlTime
| 1663852820 |
| | NULL
| NULL |
| # Storage Information | NULL
| NULL |
| SerDe Library: |
org.apache.iceberg.mr.hive.HiveIcebergSerDe | NULL
|
| InputFormat: | null
| NULL |
| OutputFormat: | null
| NULL |
| Compressed: | No
| NULL |
| Num Buckets: | -1
| NULL |
| Bucket Columns: | []
| NULL |
| Sort Columns: | []
| NULL |
| Storage Desc Params: | NULL
| NULL |
| | serialization.format
| 1 |
+-------------------------------+----------------------------------------------------+----------------------------------------------------+
36 rows selected (1.557 seconds)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
