[
https://issues.apache.org/jira/browse/IMPALA-15409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Noémi Pap-Takács updated IMPALA-15409:
--------------------------------------
Summary: Fix file paths in OPTIMIZE and replace deprecated
ContentFile.path() (was: Fix file paths in OPTIMIZE and deprecate
ContentFile.path())
> Fix file paths in OPTIMIZE and replace deprecated ContentFile.path()
> --------------------------------------------------------------------
>
> Key: IMPALA-15409
> URL: https://issues.apache.org/jira/browse/IMPALA-15409
> Project: IMPALA
> Issue Type: Bug
> Reporter: Noémi Pap-Takács
> Assignee: Noémi Pap-Takács
> Priority: Major
>
> OptimizeStmt with file filtering sends the paths of the selected data files
> to the catalog, which matches them against the DataFile locations to decide
> which files need to be replaced.
> With a partition value containing '/', '"' or '=', no path matches and
> OPTIMIZE fails with "Files to delete cannot be empty". It was a hidden bug
> because every existing OPTIMIZE test uses plain ASCII partition values.
> Using ContentFile.location() to retrieve the file paths can fix this issue.
> Also, we should replace the now deprecated Iceberg ContentFile.path() calls
> with ContentFile.location() throughout the frontend. It is not expected to
> impact performance because we call .toString() on ContentFile.path() anyway.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
