This is an automated email from the ASF dual-hosted git repository.
bikram pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git.
from d2f866f IMPALA-10935: Impala crashes on old Iceberg table property
new d8d44f3 IMPALA-9857: Batching of consecutive partition events
new 6196488 IMPALA-10914: Consistently schedule scan ranges for Iceberg
tables
new 5e3d439 IMPALA-10862 Optimization of the code structure of TmpDir
new cee2b42 IMPALA-10942: Fix memory leak in admission controller
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/runtime/tmp-file-mgr-internal.h | 114 ++++-
be/src/runtime/tmp-file-mgr-test.cc | 130 ++---
be/src/runtime/tmp-file-mgr.cc | 521 ++++++++++++---------
be/src/runtime/tmp-file-mgr.h | 50 +-
be/src/scheduling/admission-control-service.cc | 2 +-
be/src/scheduling/admission-controller.cc | 6 +-
be/src/scheduling/admission-controller.h | 2 +-
.../scheduling/local-admission-control-client.cc | 2 +-
common/thrift/CatalogService.thrift | 12 +
.../impala/catalog/CatalogServiceCatalog.java | 77 ++-
.../org/apache/impala/catalog/FeIcebergTable.java | 38 +-
.../org/apache/impala/catalog/HdfsPartition.java | 7 +-
.../java/org/apache/impala/catalog/HdfsTable.java | 101 +++-
.../org/apache/impala/catalog/IcebergTable.java | 29 +-
.../main/java/org/apache/impala/catalog/Table.java | 1 +
.../impala/catalog/events/MetastoreEvents.java | 477 ++++++++++++++++---
.../catalog/events/MetastoreEventsProcessor.java | 5 +-
.../impala/catalog/events/SelfEventContext.java | 38 +-
.../impala/catalog/iceberg/IcebergCatalogs.java | 25 +-
.../impala/catalog/iceberg/IcebergCtasTarget.java | 16 +-
.../impala/catalog/iceberg/IcebergHiveCatalog.java | 1 +
.../impala/catalog/local/CatalogdMetaProvider.java | 11 +
.../impala/catalog/local/DirectMetaProvider.java | 8 +
.../impala/catalog/local/LocalIcebergTable.java | 24 +-
.../apache/impala/catalog/local/MetaProvider.java | 6 +
.../apache/impala/service/CatalogOpExecutor.java | 231 ++++++---
.../impala/service/IcebergCatalogOpExecutor.java | 105 +++--
.../java/org/apache/impala/util/IcebergUtil.java | 8 +-
.../events/MetastoreEventsProcessorTest.java | 249 +++++++++-
.../queries/QueryTest/iceberg-catalogs.test | 2 -
.../queries/QueryTest/show-create-table.test | 2 +-
tests/custom_cluster/test_events_custom_configs.py | 193 +++++++-
tests/metadata/test_event_processing.py | 1 +
tests/metadata/test_show_create_table.py | 4 +-
tests/query_test/test_iceberg.py | 23 +
tests/stress/test_insert_stress.py | 26 +-
tests/util/event_processor_utils.py | 9 +-
37 files changed, 1866 insertions(+), 690 deletions(-)
