Joe McDonnell has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/15799 )
Change subject: IMPALA-9677: Fix frontend tests using a non-existent S3 bucket ...................................................................... IMPALA-9677: Fix frontend tests using a non-existent S3 bucket With HADOOP-16711, Hadoop added extra validation during the initialization of S3AFileSystem that verified that the caller had permissions on the S3 bucket specified. Some frontend tests use non-existent S3 buckets in URIs to check analysis behavior. These started to fail with the new validation. This changes the core-site.xml configuration to disable the new validation by setting fs.s3a.bucket.probe=1. This is equivalent to the old behavior, and it can now run the frontend tests without AWS credentials. Testing: - Hand tested the failing tests (AnalyzeDDLTest, ExplainTest, PlannerTest) - Ran core job on USE_CDP_HIVE=true and USE_CDP_HIVE=false Change-Id: Id61ffbf686f8b7827e7fbf13167cfc1dfc06a325 Reviewed-on: http://gerrit.cloudera.org:8080/15799 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Anurag Mantripragada <[email protected]> Reviewed-by: Tim Armstrong <[email protected]> --- M testdata/cluster/node_templates/common/etc/hadoop/conf/core-site.xml.py 1 file changed, 8 insertions(+), 0 deletions(-) Approvals: Impala Public Jenkins: Verified Anurag Mantripragada: Looks good to me, but someone else must approve Tim Armstrong: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/15799 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Id61ffbf686f8b7827e7fbf13167cfc1dfc06a325 Gerrit-Change-Number: 15799 Gerrit-PatchSet: 2 Gerrit-Owner: Joe McDonnell <[email protected]> Gerrit-Reviewer: Anurag Mantripragada <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Tim Armstrong <[email protected]>
