Tianyi Wang has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/10792 )
Change subject: IMPALA-3040: Remove cache directive before dropping a table ...................................................................... IMPALA-3040: Remove cache directive before dropping a table One way to hit IMPALA-3040 is to drop a table while the catalog is loading it. The problematic test drops the cached table/database and then checks if the cache directive has been removed. When the table is dropped, the HMS metadata will be removed first. If a concurrent table loading operation is running, it will fail because it cannot find the table in HMS. When the loading procedure throws, the old partition objects have already been cleared from the table catalog object, so the catalog won't remove the cache directives because the metadata has gone. There are several potential solutions: - Lock the tables and the databases before dropping. We don't currently have database lock so this is not trivial. - Fix the table loading procedure so that it loads and replaces existing partitions atomically. - Remove the cache directives first. This patch takes the last approach. Change-Id: Id7701a499405e961456adea63f3592b43bd69170 --- M fe/src/main/java/org/apache/impala/service/CatalogOpExecutor.java 1 file changed, 7 insertions(+), 6 deletions(-) git pull ssh://gerrit.cloudera.org:29418/Impala-ASF refs/changes/92/10792/2 -- To view, visit http://gerrit.cloudera.org:8080/10792 To unsubscribe, visit http://gerrit.cloudera.org:8080/settings Gerrit-Project: Impala-ASF Gerrit-Branch: master Gerrit-MessageType: newpatchset Gerrit-Change-Id: Id7701a499405e961456adea63f3592b43bd69170 Gerrit-Change-Number: 10792 Gerrit-PatchSet: 2 Gerrit-Owner: Tianyi Wang <[email protected]> Gerrit-Reviewer: Bharath Vissapragada <[email protected]> Gerrit-Reviewer: Tianyi Wang <[email protected]>
