Hello Yida Wu, Abhishek Rawat, Impala Public Jenkins,
I'd like you to reexamine a change. Please visit
http://gerrit.cloudera.org:8080/19251
to look at the new patch set (#5).
Change subject: IMPALA-11730: Add support for spilling to Ozone
......................................................................
IMPALA-11730: Add support for spilling to Ozone
Adds support for spilling to Ozone for parity with HDFS. Only works with
the `ofs` scheme, as in ofs://localhost:9862/impala/tmp.
Updates tests to determine the correct path from the environment. Guards
them behind a new flag for filesystems that support spilling. Updates
metric verification to wait for scratch-space-bytes-used to be non-zero,
as it seems to update slower with Ozone.
Refactors TmpDir to remove extraneous variables and functions. Each
implementation is expected to handle its own token parsing.
Change-Id: I5837c30357363f727ca832fb94169f2474fb4f6f
---
M be/src/runtime/tmp-file-mgr-internal.h
M be/src/runtime/tmp-file-mgr.cc
M be/src/util/hdfs-util.h
M tests/common/skip.py
M tests/custom_cluster/test_scratch_disk.py
5 files changed, 151 insertions(+), 186 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/51/19251/5
--
To view, visit http://gerrit.cloudera.org:8080/19251
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: I5837c30357363f727ca832fb94169f2474fb4f6f
Gerrit-Change-Number: 19251
Gerrit-PatchSet: 5
Gerrit-Owner: Michael Smith <[email protected]>
Gerrit-Reviewer: Abhishek Rawat <[email protected]>
Gerrit-Reviewer: Impala Public Jenkins <[email protected]>
Gerrit-Reviewer: Michael Smith <[email protected]>
Gerrit-Reviewer: Yida Wu <[email protected]>