Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/16532 )
Change subject: IMPALA-10202: Enable file handle cache for ABFS files ...................................................................... IMPALA-10202: Enable file handle cache for ABFS files Like IMPALA-8428, but for ABFS, instead of S3A. Adds support for adding ABFS file handles to the file handle cache. Support for ABFSInputStream unbuffer operations was added in HADOOP-16859. Ran a full table scan of a 1GB store_sales table on ABFS, made sure the file handles were cached (validated via the runtime profile); did this multiple times, against several different copies of the store_sales table, in order to increase the number of file handles cached by an impalad. Tested: * Tested against a ABFS storage account I have access to Change-Id: I64f12f832980f4e0207af78368402dd09e370fc3 Reviewed-on: http://gerrit.cloudera.org:8080/16532 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/runtime/io/disk-io-mgr.cc M be/src/runtime/io/scan-range.cc M tests/custom_cluster/test_hdfs_fd_caching.py 3 files changed, 11 insertions(+), 6 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/16532 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I64f12f832980f4e0207af78368402dd09e370fc3 Gerrit-Change-Number: 16532 Gerrit-PatchSet: 3 Gerrit-Owner: Sahil Takiar <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Sahil Takiar <[email protected]>
