Joe McDonnell has uploaded this change for review. ( http://gerrit.cloudera.org:8080/18872
Change subject: IMPALA-11514: Workaround s3 connection timeout issues ...................................................................... IMPALA-11514: Workaround s3 connection timeout issues When running on s3, dataload is failing with errors like "Timeout waiting for connection from pool". The underlying issue is a subtle issue in the async draining codepath (HADOOP-18410). As a temporary workaround, this adds fs.s3a.input.async.drain.threshold=512G to core-site.xml. This disables the async drain codepath. Testing: - An s3 job passed with this setting Change-Id: I08d03eb653fdcb6955340519b0cf5ba97b10d590 --- M testdata/cluster/node_templates/common/etc/hadoop/conf/core-site.xml.py 1 file changed, 3 insertions(+), 0 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/72/18872/1 -- To view, visit http://gerrit.cloudera.org:8080/18872 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I08d03eb653fdcb6955340519b0cf5ba97b10d590 Gerrit-Change-Number: 18872 Gerrit-PatchSet: 1 Gerrit-Owner: Joe McDonnell <[email protected]>
