Noémi Pap-Takács created IMPALA-15409:
-----------------------------------------
Summary: Fix file paths in OPTIMIZE and deprecate
ContentFile.path()
Key: IMPALA-15409
URL: https://issues.apache.org/jira/browse/IMPALA-15409
Project: IMPALA
Issue Type: Bug
Reporter: Noémi Pap-Takács
Assignee: Noémi Pap-Takács
OptimizeStmt with file filtering sends the paths of the selected data files to
the catalog, which matches them against the DataFile locations to decide which
files need to be replaced.
With a partition value containing '/', '"' or '=', no path matches and OPTIMIZE
fails with "Files to delete cannot be empty". It was a hidden bug because every
existing OPTIMIZE test uses plain ASCII partition values.
Using ContentFile.location() to retrieve the file paths can fix this issue.
Also, we should replace the now deprecated Iceberg ContentFile.path() calls
with ContentFile.location() throughout the frontend. It is not expected to
impact performance because we call .toString() on ContentFile.path() anyway.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
