cdmikechen edited a comment on issue #2544: URL: https://github.com/apache/hudi/issues/2544#issuecomment-776007206
I think it is still a problem in Hive2. In Hive2, Hive can not identify logical timestamp type. Spark3 user hive2 lib, if we use spark sql with `enableHiveSupport()` to read a hive table, it may appear that spark reads hive's field as timestamp type, and then uses hive2's parquet API to read timestamp. In hive2 serd class, the type of timestamp must be `int96`, if we force parquet-avro to declare timestamp, this error will occur. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
