cdmikechen edited a comment on issue #2544: URL: https://github.com/apache/hudi/issues/2544#issuecomment-776007206
I think it is still a problem in Hive2. In Hive2, Hive can not identify logical timestamp type. Spark3 use hive2 lib, if we use spark sql with `enableHiveSupport()` to read a hive table, it may appear that spark read hive's field as timestamp type, and use hive2's parquet API to read timestamp. In Hive2 serd class, the type of timestamp must be `int96`, if we force parquet-avro to declare timestamp (TIMESTAMP_MICROS), this error will occur. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
