satishkotha edited a comment on issue #2509: URL: https://github.com/apache/hudi/issues/2509#issuecomment-772020119
Hi If you set support_timestamp property mentioned [here](https://hudi.apache.org/docs/configurations.html#HIVE_SUPPORT_TIMESTAMP), hudi will convert the field to timestamp type. Note that hive/presto/athena query engines will need some more changes to interpret the field correctly as timestamp. Refer to [this](https://github.com/prestodb/presto/pull/15074) change in presto for example. We did similar changes in our internal hive deployment. Some more background: Hudi uses parquet-avro module which converts timestamp to INT64 with logical type TIMESTAMP_MICROS. Hive and other query engines expect timestamp to be in INT96 format. But INT96 is no longer supported. Recommended path forward is to deprecate int96 and change query engines to work with int64 type https://issues.apache.org/jira/browse/PARQUET-1883 has additional details. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
