Riddle4045 commented on issue #9435:
URL: https://github.com/apache/hudi/issues/9435#issuecomment-1678089145
@danny0405 I checked the Table props in metastore of a table that's synced
using Hudi HMS sync tool vs the Flink table I mentioned below. I see very
different properties here
Table props for table creating using Hudi HMS sync tool
```
TBL_ID PARAM_KEY PARAM_VALUE
250 EXTERNAL TRUE
250 last_commit_time_sync 20230601210025262
250 numFiles 0
250 spark.sql.sources.provider hudi
250 spark.sql.sources.schema.numParts 1
250 spark.sql.sources.schema.part.0
{"type":"struct","fields":[{"name":"_hoodie_commit_time","type":"string","nullable":true,"metadata":{}},{"name":"_hoodie_commit_seqno","type":"string","nullable":true,"metadata":{}},{"name":"_hoodie_record_key","type":"string","nullable":true,"metadata":{}},{"name":"_hoodie_partition_path","type":"string","nullable":true,"metadata":{}},{"name":"_hoodie_file_name","type":"string","nullable":true,"metadata":{}},{"name":"rideId","type":"long","nullable":true,"metadata":{}},{"name":"driverId","type":"long","nullable":false,"metadata":{}},{"name":"taxiId","type":"long","nullable":true,"metadata":{}},{"name":"startTime","type":"long","nullable":true,"metadata":{}},{"name":"tip","type":"float","nullable":true,"metadata":{}},{"name":"tolls","type":"float","nullable":true,"metadata":{}},{"name":"totalFare","type":"float","nullable":true,"metadata":{}}]}
250 totalSize 0
250 transient_lastDdlTime 1685653353
```
HMS props for the Hudi table creating using Flink SQL
```
TBL_ID PARAM_KEY PARAM_VALUE
335 flink.comment
335 flink.connector hudi
335 flink.hive_sync.enable true
335 flink.hive_sync.metastore.uris thrift://hive-metastore:9083
335 flink.hive_sync.mode hms
335 flink.partition.keys.0.name partition
335 flink.path abfs://[email protected]/hudi/t1hms4
335 flink.schema.0.data-type VARCHAR(20)
335 flink.schema.0.name uuid
335 flink.schema.1.data-type VARCHAR(10)
335 flink.schema.1.name name
335 flink.schema.2.data-type INT
335 flink.schema.2.name age
335 flink.schema.3.data-type TIMESTAMP(3)
335 flink.schema.3.name ts
335 flink.schema.4.data-type VARCHAR(20)
335 flink.schema.4.name partition
335 flink.table.type COPY_ON_WRITE
335 transient_lastDdlTime 1691804292
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
