[
https://issues.apache.org/jira/browse/IMPALA-11821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17680567#comment-17680567
]
ASF subversion and git services commented on IMPALA-11821:
----------------------------------------------------------
Commit 78054727e42d81d30d8ac9bc61c6f92bd5504f11 in impala's branch
refs/heads/master from Gergely Fürnstáhl
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=78054727e ]
IMPALA-11807: Rewrite iceberg metadata if not on hdfs
Iceberg test tables are usually written on hdfs and the file paths start
with "hdfs://localhost:20500/test-warehouse".
Earlier we manually transformed the metadata so paths would start with
"/test-warehouse"
Since IMPALA-11821, testdata/bin/rewrite-iceberg-metadata.py supports
not only a custom WAREHOUSE_LOCATION_PREFIX, but the ability to trim the
beginning of the file paths.
This commit modifies the data load, so metadata rewrite always executes
if not on hdfs, even with empty WAREHOUSE_LOCATION_PREFIX.
Testing:
- Ran iceberg tests on ozone and S3
Change-Id: Ic04c5abdd42cb0c1cf5abd310b06c39cf8cd64ba
Reviewed-on: http://gerrit.cloudera.org:8080/19432
Reviewed-by: Michael Smith <[email protected]>
Tested-by: Impala Public Jenkins <[email protected]>
> Enable new avro/mixed iceberg tests for Ozone
> ---------------------------------------------
>
> Key: IMPALA-11821
> URL: https://issues.apache.org/jira/browse/IMPALA-11821
> Project: IMPALA
> Issue Type: Task
> Reporter: Michael Smith
> Assignee: Michael Smith
> Priority: Major
> Labels: ozone
>
> Revert https://gerrit.cloudera.org/c/19387/, remove {{/iceberg_test}} from
> https://github.com/apache/impala/blob/master/testdata/bin/load-test-warehouse-snapshot.sh#L119,
> and resolve any other issues needed for the tests to pass.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
