Joe McDonnell has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/18872 )
Change subject: IMPALA-11514: Workaround s3 connection timeout issues ...................................................................... IMPALA-11514: Workaround s3 connection timeout issues When running on s3, dataload is failing with errors like "Timeout waiting for connection from pool". The underlying issue is a subtle issue in the async draining codepath (HADOOP-18410). As a temporary workaround, this adds fs.s3a.input.async.drain.threshold=512G to core-site.xml. This disables the async drain codepath. Testing: - An s3 job passed with this setting Change-Id: I08d03eb653fdcb6955340519b0cf5ba97b10d590 Reviewed-on: http://gerrit.cloudera.org:8080/18872 Tested-by: Impala Public Jenkins <[email protected]> Reviewed-by: Wenzhe Zhou <[email protected]> --- M testdata/cluster/node_templates/common/etc/hadoop/conf/core-site.xml.py 1 file changed, 3 insertions(+), 0 deletions(-) Approvals: Impala Public Jenkins: Verified Wenzhe Zhou: Looks good to me, approved -- To view, visit http://gerrit.cloudera.org:8080/18872 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I08d03eb653fdcb6955340519b0cf5ba97b10d590 Gerrit-Change-Number: 18872 Gerrit-PatchSet: 2 Gerrit-Owner: Joe McDonnell <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Wenzhe Zhou <[email protected]>
