Michael Smith has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19496 )
Change subject: IMPALA-11920: Support spill to HDFS address by service ID ...................................................................... IMPALA-11920: Support spill to HDFS address by service ID Allows addressing HDFS (and Ozone) filesystems in `scratch_dirs` by a service identifier that doesn't include a port number. Examples - "hdfs://hdfs1/:10G" uses the root directory of HDFS with a 10G limit - "ofs://ozone1/tmp::" uses /tmp in Ozone with default limit/priority Updates `scratch_dirs` parsing to allow whitespace after each specifier, as in "hdfs://hdfs1/ , /tmp". This is unambiguous and avoids failures for simple mistakes. Testing: - new backend test cases run with HDFS and Ozone - manually tested that Impala starts with --impalad_args=--scratch_dirs=ofs://localhost/tmp,/tmp creates impala-scratch in both locations Change-Id: Ie069cba211df85fe90d174900b20a26fcc1f7167 Reviewed-on: http://gerrit.cloudera.org:8080/19496 Reviewed-by: Michael Smith <[email protected]> Tested-by: Michael Smith <[email protected]> --- M be/src/runtime/tmp-file-mgr-test.cc M be/src/runtime/tmp-file-mgr.cc 2 files changed, 59 insertions(+), 35 deletions(-) Approvals: Michael Smith: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/19496 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ie069cba211df85fe90d174900b20a26fcc1f7167 Gerrit-Change-Number: 19496 Gerrit-PatchSet: 7 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Abhishek Rawat <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Yida Wu <[email protected]>
