Sahil Takiar has uploaded this change for review. ( http://gerrit.cloudera.org:8080/16532
Change subject: IMPALA-10202: Enable file handle cache for ABFS files ...................................................................... IMPALA-10202: Enable file handle cache for ABFS files Like IMPALA-8428, but for ABFS, instead of S3A. Adds support for adding ABFS file handles to the file handle cache. Support for ABFSInputStream unbuffer operations was added in HADOOP-16859. Ran a full table scan of a 1GB store_sales table on ABFS, made sure the file handles were cached (validated via the runtime profile); did this multiple times, against several different copies of the store_sales table, in order to increase the number of file handles cached by an impalad. Tested: * Tested against a ABFS storage account I have access to Change-Id: I64f12f832980f4e0207af78368402dd09e370fc3 --- M be/src/runtime/io/disk-io-mgr.cc M be/src/runtime/io/scan-range.cc M tests/custom_cluster/test_hdfs_fd_caching.py 3 files changed, 11 insertions(+), 6 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/32/16532/1 -- To view, visit http://gerrit.cloudera.org:8080/16532 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I64f12f832980f4e0207af78368402dd09e370fc3 Gerrit-Change-Number: 16532 Gerrit-PatchSet: 1 Gerrit-Owner: Sahil Takiar <[email protected]>
