Michael Smith has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/19460


Change subject: IMPALA-11883: Calculate erasure-coded bytes read directly
......................................................................

IMPALA-11883: Calculate erasure-coded bytes read directly

Calculate the metric erasure-coded-bytes-read directly from HDFS reads
rather than through hdfsFileGetReadStatistics. This allows us to use it
for other filesystem implementations (Ozone).

Also renumbers is_erasure_coded in THdfsFileSplit to 8, where it was
originally before it was removed by IMPALA-9485 (and never replaced).

Testing:
- ran updated test_io_metrics.py with Ozone, with TODO: and without EC
- TODO: ran updated test_io_metrics.py with HDFS, with and without EC

Change-Id: Ide0fc806590b2328df8068a9a54645d1d1fb137c
---
M be/src/runtime/io/hdfs-file-reader.cc
M be/src/runtime/io/request-context.h
M be/src/runtime/io/scan-range.cc
M common/thrift/PlanNodes.thrift
M tests/query_test/test_io_metrics.py
5 files changed, 9 insertions(+), 9 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/60/19460/1
--
To view, visit http://gerrit.cloudera.org:8080/19460
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ide0fc806590b2328df8068a9a54645d1d1fb137c
Gerrit-Change-Number: 19460
Gerrit-PatchSet: 1
Gerrit-Owner: Michael Smith <[email protected]>

Reply via email to