Quanlong Huang has uploaded this change for review. ( http://gerrit.cloudera.org:8080/24744
Change subject: IMPALA-15290: Retry for exists check in HadoopFsCommandLineClient ...................................................................... IMPALA-15290: Retry for exists check in HadoopFsCommandLineClient HadoopFsCommandLineClient.exists() currently ignores the stdout and stderr of the hdfs CLI command. When it returns false, it could due to transient errors like S3 503 Slow Down error. In such error cases, stderr is not empty. This adds a retry in exists() when the command exits with non-zero status and non-empty stderr. Also adds logging to show stdout and stderr for further debugging. Testing - Ran test_execute_remove_orphan_files locally. - Ran tests/query_test/test_iceberg.py on S3. Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011 --- M tests/util/hdfs_util.py 1 file changed, 13 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/44/24744/1 -- To view, visit http://gerrit.cloudera.org:8080/24744 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I071472529ec1b923e74e960a24e19b9e70c80011 Gerrit-Change-Number: 24744 Gerrit-PatchSet: 1 Gerrit-Owner: Quanlong Huang <[email protected]>
