Zoltan Ivanfi created PARQUET-1487: -------------------------------------- Summary: Do not write original type for timezone-agnostic timestamps Key: PARQUET-1487 URL: https://issues.apache.org/jira/browse/PARQUET-1487 Project: Parquet Issue Type: Improvement Components: parquet-mr Affects Versions: 1.11.0 Reporter: Zoltan Ivanfi Assignee: Nandor Kollar Fix For: 1.11.0
Historically, the TIMESTAMP_MILLIS and TIMESTAMP_MICROS original types used for the INT64 physical type were always UTC-normalized. The new TIMESTAMP logical type allows both UTC-normalized and timezone-agnostic timestamps and writes the legacy original types for compatibility reasons. However, the latter should only be written for UTC-normalized timestamps, because legacy readers are not prepared to handle timezone-agnostic timestamps correctly and the original type would just be misleading. -- This message was sent by Atlassian JIRA (v7.6.3#76005)