This is an automated email from the ASF dual-hosted git repository.
joemcdonnell pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git.
from f9ced75 IMPALA-7999: clean up start-*d.sh scripts
new b571409 IMPALA-7694: Add host resource usage metrics to profile
new efd2478 IMPALA-8104: IF NOT EXISTS to ALTER TABLE ADD COLUMN(S)
new 72b8452 IMPALA-8091 addendum: use absolute path for ntp-wait
new 52af0bf Enable full stacktrace logging with surefire
new 2f5d001 test-with-docker: decrease image size by "de-duping" HDFS.
new 14996f4 IMPALA-8103: In Analyzed Query use /* and */ to delimit hints.
new ae96a9f IMPALA-8151: Use sizeof() in HiveUdfCall to specify
non-primitive type's size
new 24eab71 IMPALA-7928: Consistent remote read scheduling
The 8 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/experiments/CMakeLists.txt | 2 +
be/src/experiments/hash-ring-util.cc | 101 +++++++++
be/src/exprs/hive-udf-call.cc | 4 +-
be/src/kudu/util/logging.h | 2 +-
be/src/runtime/coordinator-backend-state.cc | 12 +-
be/src/runtime/coordinator-backend-state.h | 14 +-
be/src/runtime/coordinator.cc | 10 +-
be/src/runtime/coordinator.h | 5 +
be/src/runtime/exec-env.cc | 11 +
be/src/runtime/exec-env.h | 8 +
be/src/runtime/fragment-instance-state.cc | 4 +-
be/src/runtime/krpc-data-stream-recvr.cc | 2 +-
be/src/runtime/query-state.cc | 38 +++-
be/src/runtime/query-state.h | 3 +
be/src/runtime/runtime-state.cc | 7 +-
be/src/scheduling/CMakeLists.txt | 2 +
be/src/scheduling/backend-config.cc | 17 +-
be/src/scheduling/backend-config.h | 13 +-
be/src/scheduling/hash-ring-test.cc | 230 +++++++++++++++++++++
be/src/scheduling/hash-ring.cc | 125 +++++++++++
be/src/scheduling/hash-ring.h | 115 +++++++++++
be/src/scheduling/scheduler-test-util.cc | 4 +
be/src/scheduling/scheduler-test-util.h | 9 +-
be/src/scheduling/scheduler-test.cc | 111 +++++++++-
be/src/scheduling/scheduler.cc | 65 +++++-
be/src/scheduling/scheduler.h | 12 +-
be/src/service/impala-server.cc | 9 +
be/src/service/impala-server.h | 5 +
be/src/service/query-options.cc | 32 ++-
be/src/service/query-options.h | 5 +-
be/src/util/CMakeLists.txt | 2 +
be/src/util/periodic-counter-updater.cc | 16 +-
be/src/util/periodic-counter-updater.h | 26 ++-
be/src/util/pretty-printer.h | 10 +-
be/src/util/runtime-profile-counters.h | 133 +++++++++---
be/src/util/runtime-profile-test.cc | 175 ++++++++++++++++
be/src/util/runtime-profile.cc | 199 ++++++++++++++----
be/src/util/runtime-profile.h | 80 +++++--
be/src/util/streaming-sampler.h | 60 +-----
be/src/util/system-state-info-test.cc | 91 ++++++++
be/src/util/system-state-info.cc | 110 ++++++++++
be/src/util/system-state-info.h | 94 +++++++++
bin/parse-thrift-profile.py | 28 +--
common/thrift/ImpalaInternalService.thrift | 11 +
common/thrift/ImpalaService.thrift | 18 +-
common/thrift/Metrics.thrift | 3 +
common/thrift/RuntimeProfile.thrift | 7 +
docker/entrypoint.sh | 18 ++
docs/topics/impala_alter_table.xml | 44 ++--
fe/pom.xml | 1 +
.../org/apache/impala/analysis/BaseTableRef.java | 2 +-
.../org/apache/impala/analysis/InsertStmt.java | 4 +-
.../org/apache/impala/analysis/SelectStmt.java | 3 +-
.../java/org/apache/impala/analysis/TableRef.java | 3 +-
.../org/apache/impala/analysis/ToSqlUtils.java | 14 +-
.../java/org/apache/impala/common/PrintUtils.java | 15 +-
.../java/org/apache/impala/analysis/ToSqlTest.java | 33 ++-
.../org/apache/impala/util/PrintUtilsTest.java | 11 -
.../python/impala_py_lib/profiles.py | 45 +---
testdata/cluster/admin | 6 +-
.../queries/PlannerTest/max-row-size.test | 21 +-
.../queries/PlannerTest/resource-requirements.test | 93 ++++-----
.../PlannerTest/spillable-buffer-sizing.test | 82 +++-----
tests/beeswax/impala_beeswax.py | 9 +-
tests/query_test/test_observability.py | 130 +++++++-----
65 files changed, 2097 insertions(+), 477 deletions(-)
create mode 100644 be/src/experiments/hash-ring-util.cc
create mode 100644 be/src/scheduling/hash-ring-test.cc
create mode 100644 be/src/scheduling/hash-ring.cc
create mode 100644 be/src/scheduling/hash-ring.h
create mode 100644 be/src/util/system-state-info-test.cc
create mode 100644 be/src/util/system-state-info.cc
create mode 100644 be/src/util/system-state-info.h
copy bin/parse-thrift-profile.py => lib/python/impala_py_lib/profiles.py (58%)
mode change 100755 => 100644
