Michael Smith has uploaded this change for review. ( http://gerrit.cloudera.org:8080/19262
Change subject: IMPALA-11736: Copy data between ofs buckets ...................................................................... IMPALA-11736: Copy data between ofs buckets When Impala moves a file - such as for a LOAD DATA statement - it checks whether the source and destination are the same filesystem. If the same, it uses hdfsRename, otherwise it uses hdfsMove to move between filesystems. Ozone's ofs protocol supports referencing multiple buckets by path in the same filesystem, but does not support rename between them. All other filesystems Impala supports include the bucket name (if they use that concept) in the authority. This patch updates the function used to determine whether two paths are in the same filesystem to also check that they're in the same bucket as a requirement for hdfsRename. Change-Id: Ic61f01672fa605fec0377885b13a1621573e424e --- M be/src/runtime/dml-exec-state.cc M be/src/runtime/exec-env.h M be/src/util/hdfs-util-test.cc M be/src/util/hdfs-util.cc M be/src/util/hdfs-util.h M fe/src/main/java/org/apache/impala/common/FileSystemUtil.java M fe/src/test/java/org/apache/impala/common/FileSystemUtilTest.java M tests/metadata/test_load.py 8 files changed, 198 insertions(+), 59 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/62/19262/2 -- To view, visit http://gerrit.cloudera.org:8080/19262 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: Ic61f01672fa605fec0377885b13a1621573e424e Gerrit-Change-Number: 19262 Gerrit-PatchSet: 2 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]>
