Bharath Vissapragada has uploaded this change for review. ( http://gerrit.cloudera.org:8080/11732
Change subject: IMPALA-7717: Handle concurrent partition changes in local catalog mode ...................................................................... IMPALA-7717: Handle concurrent partition changes in local catalog mode Current code throws a RuntimeException (RTE) when partial fetch RPCs looking up partition metadata and the corresponding partition ID is missing on the Catalog server. There are a couple of cases here. 1. The partition could be genuinely missing as it was dropped by a concurrent operation. 2. Partial fetch RPCs lookup partitions by IDs instead of names. This is problematic since the IDs can change over the lifetime of a table. In both the cases, throwing a RTE is not the right approach and for (2) we need to transparently retry the fetch with the new partition ID. We eventually need to fix (2) as looking up by partition ID is not the right approach. Change-Id: I2aa103ee159ce9478af9b5b27b36bc0cc286f442 Testing: Updated an e-e test which fails without the patch. --- M common/thrift/CatalogService.thrift M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/catalog/local/CatalogdMetaProvider.java M tests/custom_cluster/test_local_catalog.py 4 files changed, 27 insertions(+), 53 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/32/11732/2 -- To view, visit http://gerrit.cloudera.org:8080/11732 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I2aa103ee159ce9478af9b5b27b36bc0cc286f442 Gerrit-Change-Number: 11732 Gerrit-PatchSet: 2 Gerrit-Owner: Bharath Vissapragada <[email protected]>
