Sagar Sumit created HUDI-9359:
---------------------------------

             Summary: Hudi Timestamp Write Precision Incorrect
                 Key: HUDI-9359
                 URL: https://issues.apache.org/jira/browse/HUDI-9359
             Project: Apache Hudi
          Issue Type: Bug
            Reporter: Sagar Sumit
             Fix For: 1.1.0


When upgrading our stack from Hudi 0.14.0 to 0.15.0, writes on new tables with 
columns defined as {{logicalType: timestamp-millis}} are written into Parquet 
as {{{}timestamp{}}}, which in Spark defaults to {{{}micro{}}}. This means data 
read as the Long 1720631224939 (meant to represent 2024-07-10) will instead 
write back into the parquet as a date in January, 1970.

 

Reproducible script in https://github.com/apache/hudi/issues/13233



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to