rlcyf opened a new issue #2260:
URL: https://github.com/apache/iceberg/issues/2260
icebergļ¼0.11
spark:3.0.1
bin/spark-shell \
--conf
spark.sql.extensions=org.apache.iceberg.spark.extensions.IcebergSparkSessionExtensions
\
--conf spark.sql.catalog.test=org.apache.iceberg.spark.SparkSessionCatalog \
--conf spark.sql.catalog.test.type=hive
```
CREATE TABLE ods.sample (id bigint COMMENT 'unique id',data string) USING
iceberg
```
2021-02-21 05:30:06,902 WARN hive.HiveExternalCatalog: Couldn't find
corresponding Hive SerDe for data source provider iceberg. Persisting data
source table `ods`.`sample` into Hive metastore in Spark SQL specific format,
which is NOT compatible with Hive.
```
desc formatted sample;
...
Table Parameters:
owner root
provider iceberg
spark.sql.create.version 3.0.1
spark.sql.partitionProvider catalog
spark.sql.sources.provider iceberg
spark.sql.sources.schema.numParts 1
spark.sql.sources.schema.part.0
{\"type\":\"struct\",\"fields\":[{\"name\":\"id\",\"type\":\"long\",\"nullable\":true,\"metadata\":{}},{\"name\":\"data\",\"type\":\"string\",\"nullable\":true,\"metadata\":{}}]}
transient_lastDdlTime 1613907771
# Storage Information
SerDe Library: org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe
<-------------
InputFormat: org.apache.hadoop.mapred.SequenceFileInputFormat
<-------------
OutputFormat:
org.apache.hadoop.hive.ql.io.HiveSequenceFileOutputFormat <------------
Compressed: No
Num Buckets: -1
Bucket Columns: []
Sort Columns: []
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
