Gergely Fürnstáhl has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/19432


Change subject: IMPALA-11807: Rewrite iceberg metadata if not on hdfs
......................................................................

IMPALA-11807: Rewrite iceberg metadata if not on hdfs

Iceberg test tables are usually written on hdfs and the file paths start
with "hdfs://localhost:20500/test-warehouse".

Earlier we manually transformed the metadata so paths would start with
"/test-warehouse"

Since IMPALA-11821, testdata/bin/rewrite-iceberg-metadata.py supports
not only a custom WAREHOUSE_LOCATION_PREFIX, but the ability to trim the
beginning of the file paths.

This commit modifies the data load, so metadata rewrite always executes
if not on hdfs, even with empty WAREHOUSE_LOCATION_PREFIX.

Testing:
  - Ran iceberg tests on ozone and S3

Change-Id: Ic04c5abdd42cb0c1cf5abd310b06c39cf8cd64ba
---
M testdata/bin/load-test-warehouse-snapshot.sh
1 file changed, 4 insertions(+), 2 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/32/19432/1
--
To view, visit http://gerrit.cloudera.org:8080/19432
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ic04c5abdd42cb0c1cf5abd310b06c39cf8cd64ba
Gerrit-Change-Number: 19432
Gerrit-PatchSet: 1
Gerrit-Owner: Gergely Fürnstáhl <gfurnst...@cloudera.com>

Reply via email to