Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19432 )
Change subject: IMPALA-11807: Rewrite iceberg metadata if not on hdfs ...................................................................... IMPALA-11807: Rewrite iceberg metadata if not on hdfs Iceberg test tables are usually written on hdfs and the file paths start with "hdfs://localhost:20500/test-warehouse". Earlier we manually transformed the metadata so paths would start with "/test-warehouse" Since IMPALA-11821, testdata/bin/rewrite-iceberg-metadata.py supports not only a custom WAREHOUSE_LOCATION_PREFIX, but the ability to trim the beginning of the file paths. This commit modifies the data load, so metadata rewrite always executes if not on hdfs, even with empty WAREHOUSE_LOCATION_PREFIX. Testing: - Ran iceberg tests on ozone and S3 Change-Id: Ic04c5abdd42cb0c1cf5abd310b06c39cf8cd64ba Reviewed-on: http://gerrit.cloudera.org:8080/19432 Reviewed-by: Michael Smith <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M testdata/bin/load-test-warehouse-snapshot.sh 1 file changed, 5 insertions(+), 3 deletions(-) Approvals: Michael Smith: Looks good to me, approved Impala Public Jenkins: Verified -- To view, visit http://gerrit.cloudera.org:8080/19432 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ic04c5abdd42cb0c1cf5abd310b06c39cf8cd64ba Gerrit-Change-Number: 19432 Gerrit-PatchSet: 3 Gerrit-Owner: Gergely Fürnstáhl <[email protected]> Gerrit-Reviewer: Gergely Fürnstáhl <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Laszlo Gaal <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Noemi Pap-Takacs <[email protected]>
