Tianyi Wang has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/10792 )
Change subject: IMPALA-3040: Remove cache directives if a partition is dropped externally ...................................................................... IMPALA-3040: Remove cache directives if a partition is dropped externally HdfsTable.dropPartition() doesn't uncache the partition right now. If the partition is dropped from Hive and refreshed in Impala, the partition will be removed from the catalog but the cache directive remains. Because Impala directly uses HMS client to drop a table/database, the cache directive won't be removed even if the table is dropped in Impala, if the backgroud loading is run concurrenty with the HMS client RPC call. This patch removes the cache directive in dropPartition() if the partition is removed from HMS. Change-Id: Id7701a499405e961456adea63f3592b43bd69170 Reviewed-on: http://gerrit.cloudera.org:8080/10792 Reviewed-by: Bharath Vissapragada <[email protected]> Tested-by: Tianyi Wang <[email protected]> --- M fe/src/main/java/org/apache/impala/catalog/HdfsTable.java M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java M tests/query_test/test_hdfs_caching.py 3 files changed, 49 insertions(+), 13 deletions(-) Approvals: Bharath Vissapragada: Looks good to me, approved Tianyi Wang: Verified -- To view, visit http://gerrit.cloudera.org:8080/10792 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: Id7701a499405e961456adea63f3592b43bd69170 Gerrit-Change-Number: 10792 Gerrit-PatchSet: 13 Gerrit-Owner: Tianyi Wang <[email protected]> Gerrit-Reviewer: Bharath Vissapragada <[email protected]> Gerrit-Reviewer: Impala Public Jenkins <[email protected]> Gerrit-Reviewer: Tianyi Wang <[email protected]>
