[
https://issues.apache.org/jira/browse/PARQUET-675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17271692#comment-17271692
]
ASF GitHub Bot commented on PARQUET-675:
----------------------------------------
nevi-me commented on pull request #165:
URL: https://github.com/apache/parquet-format/pull/165#issuecomment-767132481
Thanks for the responses, I'll look at the interval vs duration support in
more detail in the coming weeks, and rather put together a Google doc for
discussion in the Parquet mailing list.
> The existing interval type seems reasonable in parquet.
It's reasonable for converted types, but has no equivalent logical type.
While this is still fine as we have to write converted types in the metadata
for backwards-compatibility, it still means that one has to write a 4-byte
value into a 12-byte FLA in order for the converted type to make sense when
being read by another application.
The Arrow schema is binary, so in the long-run I wouldn't expect a non-Arrow
reader to care about it. So, I was trying to approach adding INTERVAL to
logical types, so that one could drop the INTERVAL converted type (as it
wouldn't be correct to map Logical::INTERVAL to Converted::INTERVAL.
I'll research this subject, read and write files with v2 of the writer, and
come back with observations.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Add INTERVAL_YEAR_MONTH and INTERVAL_DAY_TIME types
> ---------------------------------------------------
>
> Key: PARQUET-675
> URL: https://issues.apache.org/jira/browse/PARQUET-675
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-format
> Reporter: Julien Le Dem
> Assignee: Julien Le Dem
> Priority: Major
>
> For completeness and compatibility with Arrow and SQL types.
> Those are related to the existing INTERVAL type.
> some references:
> - https://msdn.microsoft.com/en-us/library/ms716506(v=vs.85).aspx
> -
> http://www.techrepublic.com/article/sql-basics-datetime-and-interval-data-types/
> - https://www.postgresql.org/docs/9.3/static/datatype-datetime.html
> - https://docs.oracle.com/html/E26088_01/sql_elements001.htm
> -
> http://www.ibm.com/support/knowledgecenter/SSGU8G_12.1.0/com.ibm.sqlr.doc/ids_sqr_123.htm
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
