[
https://issues.apache.org/jira/browse/HIVE-30042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HIVE-30042:
----------------------------------
Labels: pull-request-available (was: )
> Fix LLAP encoded/vectorized read path for TIMESTAMP WITH LOCAL TIME ZONE on
> ORC tables
> --------------------------------------------------------------------------------------
>
> Key: HIVE-30042
> URL: https://issues.apache.org/jira/browse/HIVE-30042
> Project: Hive
> Issue Type: Bug
> Reporter: Vikram Ahuja
> Assignee: Vikram Ahuja
> Priority: Major
> Labels: pull-request-available
>
> HIVE-30020 fixed the plain (non-LLAP) ORC read/write path for TIMESTAMP WITH
> LOCAL TIME ZONE columns. However, any query that forces the read of such a
> column through LLAP's encoded/cached columnar IO path — e.g. adding an ORDER
> BY on a table with a TIMESTAMPLOCALTZ column, which introduces a Map+Reduce
> shuffle — still fails or silently produces incorrect results, because LLAP's
> specialized decode path duplicates (rather than reuses) ORC's type dispatch,
> and that duplication was never updated for TIMESTAMP_INSTANT/TIMESTAMPLOCALTZ.
> Steps to reproduce:
> {code:java}
> CREATE TABLE timestampltz_orc_format (formatid string, tsval timestamp with
> local time zone) STORED AS ORC;
> INSERT INTO timestampltz_orc_format SELECT * FROM timestampltz_formats;
> SELECT * FROM timestampltz_orc_format ORDER BY formatid;{code}
> This fails during Tez task execution with, progressively:
> {code:java}
> java.lang.RuntimeException: Vectorizaton is not supported for
> datatype:TIMESTAMPLOCALTZ
> java.lang.IllegalArgumentException: LLAP does not support TIMESTAMP_INSTANT
> java.lang.IllegalArgumentException: Unknown type timestamp with local time
> zone('...'){code}
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
