[
https://issues.apache.org/jira/browse/HIVE-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14304593#comment-14304593
]
Szehon Ho commented on HIVE-6394:
---------------------------------
Hi Yang, thanks for the observation. What you pointed is a type called
'timestamp_milis', whereas this is about 'timestamp', which has to have
nanosecond precision.
The spec at the time of implementation was based on this parquet discussion
[https://github.com/Parquet/parquet-mr/issues/218|https://github.com/Parquet/parquet-mr/issues/218],
as it was followed that way to get compatibility between Hive/Impala parquet
timestamps.
Now on the other hand, maybe parquet will soon come up with a proper Timestamp
logical type, at that time the tools can change implementation to that one,
although for now this works if you are using Hive/Impala.
> Implement Timestmap in ParquetSerde
> -----------------------------------
>
> Key: HIVE-6394
> URL: https://issues.apache.org/jira/browse/HIVE-6394
> Project: Hive
> Issue Type: Sub-task
> Components: Serializers/Deserializers
> Reporter: Jarek Jarcec Cecho
> Assignee: Szehon Ho
> Labels: Parquet
> Fix For: 0.14.0
>
> Attachments: HIVE-6394.2.patch, HIVE-6394.3.patch, HIVE-6394.4.patch,
> HIVE-6394.5.patch, HIVE-6394.6.patch, HIVE-6394.6.patch, HIVE-6394.7.patch,
> HIVE-6394.patch
>
>
> This JIRA is to implement timestamp support in Parquet SerDe.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)