Riza Suminto has uploaded this change for review. ( 
http://gerrit.cloudera.org:8080/22956


Change subject: IMPALA-14107: Obtain partition early in 
HdfsTable.getPartialInfo()
......................................................................

IMPALA-14107: Obtain partition early in HdfsTable.getPartialInfo()

test_reload_events_with_transient_partitions can get stuck when running
in local catalog mode. From the catalod.INFO, it looks like catalog keep
looking for non-existent partition id.

The root cause seems to come from the gap between gathering partition
ids vs the partition itself in HdfsTable.getPartialInfo(). If
partitionMap_ is cleared or mutated in between the two gather, a missing
partition warning will be printed and
CatalogLookupStatus.PARTITION_NOT_FOUND will be returned.

This patch attempt to fix the issue by directly gathering all partitions
when Coordinator does not request for specific partitions.

Testing:
Split test_reload_events_with_transient_partitions into two setup:
legacy catalog mode and local catalog mode. Confirm that both tests
pass.

Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
---
M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java
M tests/custom_cluster/test_events_custom_configs.py
2 files changed, 36 insertions(+), 16 deletions(-)



  git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/56/22956/1
--
To view, visit http://gerrit.cloudera.org:8080/22956
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings

Gerrit-Project: Impala-ASF
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: I1bc91023d46a0b57916202d2b64e2cf07b687b74
Gerrit-Change-Number: 22956
Gerrit-PatchSet: 1
Gerrit-Owner: Riza Suminto <riza.sumi...@cloudera.com>

Reply via email to