[
https://issues.apache.org/jira/browse/IMPALA-12862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zoltán Borók-Nagy updated IMPALA-12862:
---------------------------------------
Description:
To debug issues with position delete files, or detect table corruption we could
expose the delete records via the metadata table syntax, e.g.:
{noformat}
SELECT INPUT__FILE__NAME, file_path, pos
FROM db.ice_t.position_delete_records;{noformat}
Adding virtual column INPUT__FILE__NAME is useful because it can tell which
delete file contains the records.
We should re-use IcebergPositionDeleteTable for this:
[https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/IcebergPositionDeleteTable.java]
was:
To debug issues with position delete files, or detect table corruption we could
expose the delete records via the metadata table syntax, e.g.:
{noformat}
SELECT INPUT__FILE__NAME, file_path, pos
FROM db.ice_t.position_delete_records;{noformat}
We should re-use IcebergPositionDeleteTable for this:
[https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/IcebergPositionDeleteTable.java]
> Expose Iceberg position delete records via metadata table
> ---------------------------------------------------------
>
> Key: IMPALA-12862
> URL: https://issues.apache.org/jira/browse/IMPALA-12862
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Reporter: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg
>
> To debug issues with position delete files, or detect table corruption we
> could expose the delete records via the metadata table syntax, e.g.:
> {noformat}
> SELECT INPUT__FILE__NAME, file_path, pos
> FROM db.ice_t.position_delete_records;{noformat}
> Adding virtual column INPUT__FILE__NAME is useful because it can tell which
> delete file contains the records.
> We should re-use IcebergPositionDeleteTable for this:
> [https://github.com/apache/impala/blob/master/fe/src/main/java/org/apache/impala/catalog/IcebergPositionDeleteTable.java]
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
