[
https://issues.apache.org/jira/browse/IMPALA-14783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18097913#comment-18097913
]
ASF subversion and git services commented on IMPALA-14783:
----------------------------------------------------------
Commit 779a8771b96ca5b8adee0123ad4bf89418a56f40 in impala's branch
refs/heads/master from Arnab Karmakar
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=779a8771b ]
IMPALA-14783: Add time travel support for SHOW FILES on Iceberg tables
Extends SHOW FILES to accept FOR SYSTEM_TIME AS OF and FOR SYSTEM_VERSION
AS OF clauses for Iceberg tables.
Reuses the existing opt_asof grammar rule shared with SELECT time-travel.
Syntax:
SHOW FILES IN <table>
[FOR SYSTEM_VERSION AS OF <integer_literal> |
FOR SYSTEM_TIME AS OF <timestamp_expr>]
[PARTITION (<filter>)]
The time-travel clause is placed before the optional PARTITION clause.
Both can be combined to filter filesby snapshot and partition
simultaneously.
Testing:
- ParserTest: positive cases for new syntax and negative cases with
invalid snapshot IDs.
- AnalyzeDDLTest: analysis-level validation with snapshot IDs,
timestamps and partition filters. Negative cases with non-Iceberg tables.
- E2E tests with dynamic snapshot IDs and timestamps;
covers version-based, timestamp-based, now(), partition filter combos,
SELECT consistency checks, and negative cases
Change-Id: I09215c4527cdc585af5340d5bb573d9da877a0c9
Reviewed-on: http://gerrit.cloudera.org:8080/24405
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Peter Rozsa <[email protected]>
> Support time-travel in SHOW FILES for Iceberg tables
> ----------------------------------------------------
>
> Key: IMPALA-14783
> URL: https://issues.apache.org/jira/browse/IMPALA-14783
> Project: IMPALA
> Issue Type: Improvement
> Reporter: Zoltán Borók-Nagy
> Assignee: Arnab Karmakar
> Priority: Major
> Labels: impala-iceberg, ramp-up
>
> Support time-travel in SHOW FILES for Iceberg tables:
> {noformat}
> SHOW FILES IN <iceberg_table> FOR SYSTEM_VERSION AS OF <snapshot-id>;
> SHOW FILES IN <iceberg_table> FOR SYSTEM_TIME AS OF <timestamp>;
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
