Frogglet commented on issue #3965: URL: https://github.com/apache/hudi/issues/3965#issuecomment-965950614
@xushiyan Hey, I'm using AWS Glue for my Hive metastore, and according to glue the types for these timestamps is just "bigint". So, it's not changing the schema, it is just integer dividing by 1000. For example, before this change, a value might be `1628643404092`, which is a unix timestamp in milliseconds. After my upsert, if that row was affected the value would become `1628643404`, losing the millisecond information. One source for these timestamps for me is just calling the sparksql builtin `current_timestamp()`. Also I should have mentioned I have hive syncing turned on. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
