This is an automated email from the ASF dual-hosted git repository.
arawat pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
from 12059ba14 IMPALA-11614: Fix test_metrics_are_zero for Ozone
new d47d305bf IMPALA-11418: A statement that returns at most one row need
not to spool results
new 6dfab93fe IMPALA-10791 Add batch reading for remote temporary files
new 55194a9c8 IMPALA-11576: Fix for test_multiple_storage_locations on S3
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/runtime/io/CMakeLists.txt | 2 +
be/src/runtime/io/disk-file-test.cc | 149 +++++++++
be/src/runtime/io/disk-file.cc | 50 +++
be/src/runtime/io/disk-file.h | 363 +++++++++++++++++++-
be/src/runtime/io/disk-io-mgr-test.cc | 122 +++++++
be/src/runtime/io/disk-io-mgr.cc | 117 ++++++-
be/src/runtime/io/request-context.cc | 28 +-
be/src/runtime/io/request-context.h | 31 ++
be/src/runtime/io/request-ranges.h | 43 ++-
be/src/runtime/io/scan-range.cc | 123 ++++---
be/src/runtime/tmp-file-mgr-internal.h | 118 ++++++-
be/src/runtime/tmp-file-mgr-test.cc | 175 +++++++++-
be/src/runtime/tmp-file-mgr.cc | 369 ++++++++++++++++++---
be/src/runtime/tmp-file-mgr.h | 62 +++-
be/src/util/mem-info.cc | 3 +-
be/src/util/mem-info.h | 3 +-
be/src/util/metrics.h | 4 +-
common/thrift/metrics.json | 20 ++
.../apache/impala/analysis/AnalysisContext.java | 9 +
.../org/apache/impala/catalog/FeIcebergTable.java | 5 +-
.../apache/impala/catalog/FileMetadataLoader.java | 2 +-
.../org/apache/impala/catalog/HdfsPartition.java | 8 +-
.../java/org/apache/impala/service/Frontend.java | 8 +-
.../PlannerTest/bloom-filter-assignment.test | 20 +-
.../queries/PlannerTest/constant-folding.test | 4 +-
...-runtime-filters-hdfs-num-rows-est-enabled.test | 2 +-
.../PlannerTest/min-max-runtime-filters.test | 10 +-
.../queries/PlannerTest/mt-dop-validation.test | 8 +-
.../PlannerTest/parquet-filtering-disabled.test | 8 +-
.../queries/PlannerTest/parquet-filtering.test | 16 +-
.../queries/PlannerTest/resource-requirements.test | 26 +-
.../queries/PlannerTest/result-spooling.test | 104 ++++++
.../PlannerTest/runtime-filter-query-options.test | 10 +-
.../queries/PlannerTest/tablesample.test | 4 +-
.../queries/PlannerTest/tpcds/tpcds-q13.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q16.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q23a.test | 14 +-
.../queries/PlannerTest/tpcds/tpcds-q32.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q38.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q48.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q87.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q92.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q94.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q95.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q96.test | 18 +-
.../queries/PlannerTest/tpcds/tpcds-q97.test | 18 +-
.../queries/PlannerTest/tpch-all.test | 32 +-
.../queries/PlannerTest/tpch-kudu.test | 4 +-
.../queries/PlannerTest/tpch-nested.test | 16 +-
.../QueryTest/admission-max-min-mem-limits.test | 12 +-
.../QueryTest/dedicated-coord-mem-estimates.test | 6 +-
.../queries/QueryTest/explain-level2.test | 2 +-
tests/custom_cluster/test_scratch_disk.py | 42 +++
tests/query_test/test_observability.py | 3 +-
54 files changed, 1990 insertions(+), 365 deletions(-)
create mode 100644 be/src/runtime/io/disk-file-test.cc
