Impala Public Jenkins has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/19178 )
Change subject: IMPALA-9488: Add metrics for EC reads ...................................................................... IMPALA-9488: Add metrics for EC reads Adds metric tracking erasure-coded bytes read. Adds ScanRange::TestInfo to pass file info through calls of AllocateScanRange so it's easier to add erasure coding as another piece of file info. Adds a test to verify that the expected number of bytes are read for existing read metrics and the new `erasure-coded-bytes-read` metric when doing a select. Change-Id: Ieb06bac9dea4b632621653d2935e9a7b2dc81341 Reviewed-on: http://gerrit.cloudera.org:8080/19178 Reviewed-by: Impala Public Jenkins <[email protected]> Tested-by: Impala Public Jenkins <[email protected]> --- M be/src/exec/base-sequence-scanner.cc M be/src/exec/hdfs-scan-node-base.cc M be/src/exec/hdfs-scan-node-base.h M be/src/exec/hdfs-scanner.cc M be/src/exec/orc/hdfs-orc-scanner.cc M be/src/exec/parquet/hdfs-parquet-scanner.cc M be/src/exec/parquet/parquet-page-index.cc M be/src/exec/parquet/parquet-page-reader.cc M be/src/exec/scanner-context.cc M be/src/exec/text/hdfs-text-scanner.cc M be/src/runtime/io/disk-io-mgr-stress.cc M be/src/runtime/io/disk-io-mgr-test.cc M be/src/runtime/io/hdfs-file-reader.cc M be/src/runtime/io/request-context.h M be/src/runtime/io/request-ranges.h M be/src/runtime/io/scan-range.cc M be/src/runtime/tmp-file-mgr.cc M be/src/scheduling/scheduler.cc M be/src/util/impalad-metrics.cc M be/src/util/impalad-metrics.h M common/thrift/PlanNodes.thrift M common/thrift/metrics.json M fe/src/main/java/org/apache/impala/planner/HdfsScanNode.java A tests/query_test/test_io_metrics.py 24 files changed, 259 insertions(+), 116 deletions(-) Approvals: Impala Public Jenkins: Looks good to me, approved; Verified -- To view, visit http://gerrit.cloudera.org:8080/19178 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Ieb06bac9dea4b632621653d2935e9a7b2dc81341 Gerrit-Change-Number: 19178 Gerrit-PatchSet: 17 Gerrit-Owner: Michael Smith <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Joe McDonnell <[email protected]> Gerrit-Reviewer: Michael Smith <[email protected]> Gerrit-Reviewer: Zoltan Borok-Nagy <[email protected]>
