Michael Smith has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/18853


Change subject: IMPALA-10214: Ozone remote file handle caching
......................................................................

IMPALA-10214: Ozone remote file handle caching

Enables support for caching remote file handles for Ozone. Local file
handles were already cached unintentionally, similar to HDFS. Updates
file handle cache enablement to be more stringent about enabling
caching, similar to what's suggested in IMPALA-10375.

File handle caching is enabled if a max_cached_file_handles is non-zero
and any of the following are true
- HDFS file is local
- HDFS file is remote and cache_remote_file_handles is enabled
- Ozone file is local or remote and cache_ozone_file_handles is enabled
- S3 file is remote and cache_s3_file_handles is enabled
- ABFS file is remote and cache_abfs_file_handles is enabled

Enables testing Ozone in test_hdfs_fd_caching, and adds a test that
remote caching can be disabled using individual flags.

Change-Id: I9df13208999c6d3b14f4c005a91ee2a92a05bdf9
---
M be/src/runtime/io/disk-io-mgr.cc
M be/src/runtime/io/scan-range.cc
M tests/custom_cluster/test_hdfs_fd_caching.py
3 files changed, 52 insertions(+), 20 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/53/18853/1
--
To view, visit http://gerrit.cloudera.org:8080/18853
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I9df13208999c6d3b14f4c005a91ee2a92a05bdf9
Gerrit-Change-Number: 18853
Gerrit-PatchSet: 1
Gerrit-Owner: Michael Smith <[email protected]>

Reply via email to